HP StorageWorks File System Extender Software user guide
 File System Extender Software user guide
 Contents
 Managing media
Migration, release, recall, and deletion
 Introduction FSE startup and shut-down problems
Backup, restore, and recovery
Troubleshooting
Monitoring and maintaining FSE
 Directory layout B FSE configuration templates
 Related documentation
Document conventions and symbols
Intended audience
Document conventions Convention Element
 HP web sites
Subscription service
HP technical support
Documentation feedback
 FSE basics
What is FSE?
What is FSE?, FSE basics, FSE architecture,
Infinite file system
 Automatic detection of low storage space
Automatic error detection
Library tape compatibility
NFS and Cifs support
 Migration
FSE architecture
FSE operations
 \Program Files\Hewlett-Packard\FSE
Release
Recall
 HSM file system
FSE components
Deletion
FSE partition
 FSE library
FSE media pool
FSE medium
File System Catalog
 Consolidated implementation
FSE implementation options
FSE drive
 Distributed implementation
Page
 FSE daemons services and FSE agents
FSE implementation with multiple libraries
 Fse-svc
Fse-fsevtmgr
Fse-hsm
Fse.exe
 Fse-bea
FSE utility daemons services
Fse-la-s
 FSE user interfaces
FSE command-line interface
Introduction to the FSE command-line interface
 FSE command list
Remove,--list,--show,--status, and so on
 FSE Management Console
Accessing the online FSE command-line reference
FSE command Description
 FSE Management Console server
FSE Management Console client
 Configuring the FSE Management Console
 InstallPath%\var\log\fse.log
InstallPath%\var\log\guisrv.log
InstallPath%\var\cfg\gui\guisrv.users.db
Var/opt/fse/log/guisrv.log
 Configuring the logging level
Parameter Description
 Starting and stopping the FSE Management Console server
Example of a configured FSE Management Console logging
Starting and stopping the FSE Management Console
Debuglevel = -d4 -DAll Debuglevel = -dTrc -DAllD
 # /opt/fse/lbin/guisrv Options
Starting the FSE Management Console server on Linux systems
# /etc/init.d/guisrv start
 Stopping the FSE Management Console server on Linux systems
# /etc/init.d/guisrv stop
 HP StorageWorks File System Extender Software user guide
 InstallPath%\binguisrv Options
InstallPath%\binguisrv -F
 \cd %InstallPath%\bin
 Starting the FSE Management Console client on Linux systems
\Documents and Settings\Username\Application Data\guicltrc
Starting and stopping the FSE Management Console client
# export DISPLAY=fsemcclient0
 Stopping the FSE Management Console client on Linux systems
# guiclt Options
Page
 Configuring FSE
Before you start
 FSE configuration file elements
Configuration basics
Configuration files
 Configuration Database
Templates
 Var/opt/fse/cfg
Configuring a new FSE resource
Resource Management Database
Var/opt/fse/rmdb
 Fsepartition --show Partition01 MyFile
Modifying the configuration of an FSE resource
Fsepartition --list --detail
Fsepartition --modify Partition01 MyFile
 Operational modes of the FSE Management Console client
Fsepartition --show PartitionName --history
 Choosing online operational mode
# /opt/fse/bin/guiclt
 Choosing offline operational mode
Graphical user interface overview
 Graphical user interface layout
GUI layout
 Object tree
SystemName
Page
 Configuring FSE
 HP StorageWorks File System Extender Software user guide
 Configuring FSE
 HP StorageWorks File System Extender Software user guide
 Configuration dialog box
 Menu bar
Menu bar contains several menus
 New Connection
 Menu item action Applicable objects Action description
 Toolbar
View is displayed
 Status bar
 Unusable
Recovery mode
Open
Unreliable
 Managing FSE Management Console users
FSE Management Console users
Keyboard shortcuts
 FSE Management Console user properties
Configuration procedure
Configuring an FSE resource using an FSE user interface
 About Scsi identification
Overview of the configuration procedure
Phase 1 configuring FSE libraries and FSE drives
 Library and drive configuration procedure
 Name Library MediaFamily
Opt/fse/newconfig. Windows specific
Name Host ControlDevice LibType MediaFamily Slots
 DriveIndex Capabilities Host ControlDevice
Fselibrary --addLibraryCfgFileName
 Library and tape drive configuration examples
Example of a library configuration file
 # AIT Sony AIT Family # LTO LTO Ultrium MediaFamily
= LTO
 Example of an LTO Ultrium tape drive configuration file
 Example of an LTO Ultrium Worm tape drive configuration file
 Phase 2 configuring FSE media pools
Name
 Phase 3 preparing HSM file systems
Name MediaFamily PoolType BlockSize VolumeSize
 Preparing HSM file systems on the Windows platform
Creating and preparing new HSM file systems
Preparing HSM file systems on the Linux platform
\mkdir hsmfsfolder
 Integrating existing file systems on the Windows platform
Integrating existing file systems in the FSE implementation
Integrating existing file systems on the Linux platform
 Phase 4 configuring FSE partitions
Configuring a regular FSE partition on the Linux platform
 Fsepartition --status PartitionName
 Configuring a regular FSE partition on the Windows platform
Configuring an FSE partition Click OK
 \\?\Volumef6f3e1b6-b2ac-11d7-9c99-00b0d02fadef\
 Fsepartition --addPartitionCfgFileName
 Configuring a Worm FSE partition
Examples of configuration files for Worm FSE partitions
 Fsemedium --format Barcode
Phase 5 preparing FSE media
Fselibrary --update-inventory LibraryName --rescan
Fsemedium --format Barcode --force
 Fsemedium --init Barcode --force
For forced initialization use the following command
Fsemedium --init Barcode
 Fsesystem --status
Phase 6 mounting HSM file systems
Mounting HSM file systems on the Linux platform
 Command generates an output similar to the following
 Mounting HSM file systems on the Windows platform
Reconfiguring FSE interprocess communication
\\?\VolumeVolumeGUID\
\fsepartition --list
 Var/opt/fse/omniorb. Windows specific
Reconfiguration procedure
Services.cfg Etc/opt/fse
OmniORB.cfg Etc/opt/fse
 Server = fse-server1.company.com
Ordinary LAN connection
Private network connection
Hostname = fseserver.fsenet Server = fseserver.fsenet
 Services.cfg and omniORB.cfg files
OmniORB.cfg file, configure the parameters in the section
Services.cfg file
 Reconfiguring communication on external Linux FSE clients
Hostname = fseclient.fsenet Server = fseserver.fsenet
 Reconfiguring communication on external Windows FSE clients
 Changing the IP address of an FSE host
 Configuring FSE
 FSE media pools
Media pool types and their characteristics
Introduction
Introduction, FSE media pools, FSE media,
 Configuring a media pool
MyConfiguration. Linux specific
 LTO
# Regular Regular media pool for FSE partition
 Example of an LTO Worm media pool configuration file
SysVolLocation = None SizeOfSysVol = 0MB
 Fsepool --list --detail
Determining the configured media pools
Example of a disk media pool configuration file
 Managing media
 Excerpt from the fsepool --list --detail output
Checking the status of a particular media pool
Excerpt from the fsepool --list output
 Excerpt from the fsepartition --status output
FSE medium volumes
FSE media
 LTO Ultrium 3 Worm
FSE media types
Disk media
Disk media
 Var/opt/fse/dm/dm000001 Var/opt/fse/dm/dm000002
Local and remote file systems as disk media
Capacity disk
 `-- dm000001
Disk media specifics
Mnt/diskmedium linuxhost.company.comrw,nosquashroot
 Adding media to an FSE media pool
Formatting media
 Initializing media
Medium is formatted using the following command
Medium is initialized using the following command
Skipping media formatting
 Duplicating media
 Prerequisites
Procedure for duplicating media
How it works
LTO 1 100 GiB * 2 = 200 GiB
 LTO 2 200 GiB * 2 = 400 GiB LTO 3 400 GiB * 2 = 800 GiB
Normal duplication
Forced duplication
 Limitation
Reorganizing media
Media reorganization process
 Fsemedium --list Barcode --volume
Enabled/mounted
 Boundary migration date and time parameter
Media reorganization parameters
Exceptions to the reorganizational rule
Number of latest generations parameter
 Displaying the FSE media pool-based statistics
Example command output
Scanning media for obsolete data
Meaning of the columns is the following
 Displaying the FSE media-based statistics
Job to the command shell for --no-monitoroption
Running the media reorganization job
 Fsemedium --list
Reusing the recycled medium volumes
An example output is the following
 052002 Data 5949 Open, scanned Empty System 1019
Recreating redundant copies of migrated data
Redundant copy recreation process
 Media Pool
 Determining the unusable media
Command output will be similar to the following
Fsemedium --copy-contents Barcode --no-monitor
Starting redundant copy recreation
 Resolving situations with no alternative migrated copies
Fsefile -M Filename
 Checking the status of media
 PoolLTO Open LiblibLTO3 000046
Example output of the fsemedium --list command
Example output of the fsemedium --list --detail command
PoolLTO Open LiblibLTO5 000116
 Status of the medium can be one of the following
Changing the condition status of media
Checking the status of a particular medium
 Preventing writing to an FSE medium
Closing medium volumes
Recreating Fast Recovery Information from media
Preventing reading from and writing to an FSE medium
 Removing FSE media
Fselibrary --update-inventory command for this purpose
Fsemedium --recreate-fri Barcode --volume VolumeNumber
Fsemedium --remove Barcode
 Managing media
 Policies
FSE operation basics
How does FSE function?
HSM lists
 FSE disk buffer
 Hierarchical Storage Manager lists
Storage space allocation in an extended FSE disk buffer
 Policies
Changes of states of files under FSE
 Migration policy parameters
What is a retried migration?
Migration
Minimum file age for migration MinFileAge
 Minimum number of files for migration MinNumMigFiles
Minimum wait time for migration MinWaitTime
Maximum wait time for migration MaxWaitTime
Maximum number of files for migration MaxNumMigFiles
 Example situations that trigger migration
Default migration policy
Release
Watermarks
 High watermark
Reaching the critical watermark on an HSM file system
 Exclusion from release
Low watermark
 Limitations
Considerations before configuring exclusion from release
Filename pattern conventions
 Special pattern-matching characters
 Release policy parameters
 Recall retention time RecallRetentionTime
Example situations that trigger release
Migration retention time MigRetentionTime
Minimum file size for release MinFileSize
 Recall parameters
Default release policy
Recall
 Deletion
Default recall policy
Recall timeout RecallTimeout
Automatic deletion process
 Directory paths Path
Deletion policy parameters
File expiration time FileExpiration
 Examples of a configured deletion policy
Default deletion policy
 Recalling deleted files
Resource allocation
Starting the deletion job
Resource allocation concepts
 Several allocation parameters
Central FSE resource manager
Media selection by media location
 Job priorities
System allocation and job priority policy
System allocation and job priority policy parameters
ThresholdJobCount = 3/2 * MaxNumDrives
 Resource allocation threshold ResourceAllocationThreshold
Time step TimeStep
 Partition allocation and job priority policy
Partition allocation and job priority policy parameters
 Maintenance priority MaintenancePriority
Maximum number of drives for recovery MaxNumDrivesRecovery
Recovery priority RecoveryPriority
Default partition allocation and job priority policy
 Administrative and backup job priority calculation
Priority calculation
 Example of resource allocation
Multiple copying
Parallel copying
 Sequential copying
HSM file system access modes
Limited Access Mode LAM and Full Access Mode FAM
 HP StorageWorks File System Extender Software user guide
 Migration, release, recall, and deletion
 Monitoring general FSE implementation status
Procedures in this chapter provide instructions for
About monitoring and maintaining in FSE
Number of running jobs
 Monitoring FSE partition status
Example output of the fsesystem --status command
Managing FSE partitions
Host and mount point of the belonging HSM file system
 Displaying the status of an FSE partition
 Example output of the fsepartition --status command
Disabling an FSE partition
 Enabling an FSE partition
To enable an FSE partition, do the following
Windows specific Invoke the following command
Removing an FSE partition
 Switching the access mode for an HSM file system
Retrieving detailed information for an FSE partition
 Limited Access Mode error messages
Switching to Limited Access Mode
Switching to Full Access Mode
Monitoring FSE jobs
 Fsejob --list --maint PartitionName --detail
Example output of the fsejob --list command
Example output of the fsejob --list --detail command
 Displaying the status of a particular FSE job
Fsejob --status JobID
 Example output of the fsejob --status command
Recalling older generations of a file
 Example output of the fsefile --history command
 Example of recall by file migration ID
Recalling sets of files in an efficient way
Example of recall by date
Example of recall by file ID instead of filename
 Logging file recalls
Command fsefile --recall --if
Efficient recall invocation
512MBc, and 512MBd
 Managing FSE recall jobs
Example excerpt from the FSE error log file
Retrieving detailed information
 Fsedrive --list
Fsemedium --list --volume
Fselibrary --list
Fsepool --list
 Scsi
Name Drv01 Family
 Ac3050b1-a838-458e-9a21-d3d3429cade9
UsageCount 137 Capabilities Key Name Drv02 Family
Pool Pool01
 33d4ef52-7ec8-4926-97f9-909edfe66c41
47b5fddc-03f7-4b80-8dab-5d2f6fe18cc1
 HP StorageWorks File System Extender Software user guide
 Barcode 000009 VolNum
1acf6a41-a23f-4836-9e4d-539d31ad572f
 Eca50ba5-f068-4650-a587-945fcffda287
Cfe954e0-21bb-428b-84fa-076754539f76
 B8e4d73b-890c-41d0-bb20-eefe19d3f057
8920cdd9-57ee-4f2e-a09a-d701249c6434
 583
LastVer 1970/01/01 ValidData TotalData
Partition Part01
Bfca4697-a1e0-4881-ba12-953acbb72a02
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Extending storage space of FSE disk buffer
 How to extend the FSE disk buffer?
Benefits of extended FSE disk buffer
 Removing a file system from the FSE disk buffer
Checking the consistency of the File System Catalog
Consistency check of FSC vs. HSM file system
 Types of inconsistencies
Fsecheck --fsc-hsmfs PartitionName
 OwnerID 154336
Hsmfs Notes
MigID 273932147200 FileSize 18691
 MigID 273931007488 FileSize 2815
REPORTING-BUGS REPORTING-BUGS
 Consistency check of FSC vs. FSE media
Starting the consistency check
 Options for consistency check of FSC against FSE media
 MigID MediaKey MedVolNum
Inconsistency types
Example results of the FSC vs. FSE media consistency check
 Dump FRI
 Low storage space detection
Var/opt/fse
 Var/opt/fse/part Var/opt/fse/log
HHM configuration file
General HHM settings
 Triggered actions definitions
Mail settings
Key Description Default value on Linux Windows
 Variable Description Examples or possible values
 Triggered actions section of the configuration file
Monitored items definitions
 CriticalActionGE
Filesystemtype
CriticalThreshold
CriticalActionLT
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Monitoring and maintaining FSE
 Modifying the contents of the HHM configuration file
Configuring low storage space detection
Listing the contents of the HHM configuration file
 FSE log files
Viewing FSE log files
 FSE event log /var/opt/fse/log/fse.log
Configuring monitoring and analysis of FSE log files
Monitoring and analyzing FSE log files
 General configuration file
LogAnalyzerRules.py
 LogAnalyzer
# --- Debug
 ActivityLog = /var/opt/fse/log/loganalyzermessages.log
 # --- To # To-Part of the mailheader
# --- Subject # Subject-Part of the mailheader
# --- From # From-Part of the mailheader
 SleepTime
# Default is 1 minute
# CommunityName # The community name of the machine
Debug
 IgnoreCase
UseSMTPAuthentication
ProcessFileFromBeginning
ServerName
 Rules configuration file
Rules = \
 MailCurrentLogMessagesbj
MailLogMessages
MailLogMessagessbj
 Starting the monitoring and analysis of log files
Action Name Description
 Logging FSE media operations
Reconfiguring the monitoring and analysis of log files
FSE event log
Example FSE event log
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Windows specific
 HP StorageWorks File System Extender Software user guide
 FSE error log
Example FSE error log
 HP StorageWorks File System Extender Software user guide
 Monitoring and maintaining FSE
 Windows specific
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 # cd /opt/fse/sbin/tools # ./checklic
Determining total offline storage capacity
Generated report conforms to the following example
Checklic checklic-output.txt
 Backup, Restore, Recovery,
Defining your backup strategy
Introduction, Defining your backup strategy,
 Recovery methods for FSE components
See HSM file system
 FSE component Description Recovery method
Backup
What is FSE backup?
 Prerequisites
Backup configuration file on Linux platform
How it works?
# modprobe dm-snapshot
 MODULESLOADEDONBOOT=dm-snapshot
Backup media management
Backup process
 Preparation of new media
Configuring a backup media pool
Estimating resources
Preparation of already used media
 Estimating backup frequency
Defining the backup policy
Backup media recycling
Fsebackup --medium Barcode --init
 Examples of backing up to disk
Starting FSE backup
Fsebackup command
 Example of backing up to tape
Example FSE backup log file
Activity logging
Example of backing up to disk and tape
 CMD
 HP StorageWorks File System Extender Software user guide
 Aborting FSE backup
Restore
What is FSE restore?
 Restore process
 Examples of retrieving backup images from tape
Starting FSE restore
Fserestore command
Examples of restoring from disk
 Opt/fse/lbin/fserestore.py -f /root/test.tar.bz2
Example FSE restore log file
Fsebackup --device /dev/sg1 --offset 3 --count
 CMD
 File System Catalog recovery
Recovery
Post-restore steps
Aborting FSE restore
 Enable the FSE partition Start the recovery of FSC
HSM file system recovery
HSM file system recovery procedure
Prerequisite
 \fserecover --hsmfs PartitionName
Status of user data on the recovered HSM file system
# fserecover --hsmfs PartitionName
 Backup, restore, and recovery
 Troubleshooting
 Defaults to C\Program Files\Hewlett-Packard\FSE
FSE startup and shut-down problems
# ps -ef grep CommandName
Examining the process list in Windows Task Manager
 Cli-user.pkg Client.pkg Common.pkg
Agent.pkg Cli-admin.pkg Common.pkg Server.pkg
# ls -a /etc/opt/fse
# rpm -qa grep fse- grep -v fse-gui.client.pkg
 OmniORB cannot work with such a configuration
Resolve it
 Operating system tools to terminate all FSE processes
Use the kill command to terminate the FSE processes
Try to start them manually, the following error is reported
Use Task Manager to terminate the FSE processes
 # /etc/init.d/firebird status
Firebird server problems
Firebird.sourceforge.net
Ibserver pid 896 895 581 577 576 is running
 Communication problems
It defaults to C\Program Files\Hewlett-Packard\FSE
 Stop the FSE processes with the fse --stopcommand
Service daemon service
Run the command omniNames --statusand inspect its output
You must restart FSE with the fse --restartcommand
 Use the command ps -ef grep fse-hsm
Fsepartition --status PartitionName
 Scsi problems
Driver is disabled
 Cat /proc/scsi/scsi
Etc/rc.d/rc.local
Hprescan -a
 # echo scsi scan-new-devices /proc/scsi/scsi
Tape library problems
Options scsimod maxscsiluns=255
# cat /proc/scsi/scsi
 Fselibrary --update-inventory LibraryName --rescan
Fsedrive --remove Name
 Volume Overflow 0x00,0x02 End-of-partition/medium detected
Media management problems
FseError 11005 Medium overflow physical EOM
 Into the Rmdb
Problematic medium volume
Is known
Execution
 Workaround
 HSM file system mounting problems
 Fse --umount I\fse\fsefs01 \\?\Volume...\
\fse --dismount-ntfs VolumeName
Fse --mount I\fse\fsefs01 \\?\Volume
Fse --mount I\fse\fsefs01 \\?\Volume...\
 Fsepartition --remove PartitionName
Fsepartition --disable PartitionName
Fsepartition --enable PartitionName
Fsepartition --add PartitionName
 Accessed for the first time
HSM file system filter problems
Fse --dismount-ntfs VolumeName
HSM file system mounting problems on
 Fsecheck --fsc-hsmfs PartitionName
Fse --stop
Fse --start
 Runs out of free space
Migration problems
Start writing to tape
Prevent it from running out of free space
 Fsefile --history FileName
Fsefile --recall --id PartitionName FileID --into Path
 Complete
FSE error log
File DirectoryPath/FileName
Migration of the file is started
 Has been allocated for recall
Recall problems
Use the ps -ef grep fse-hsmcommand for this purpose
Unusable FSE medium to become good usable
 Scanning against viruses
 Recall them manually
Backup, restore, and recovery problems
Not indicate data loss
 \fse --stop
Section Verifying and repairing the installed FSE software
FSE Windows Service stopped
 Layout
FSE backup cannot be started
File backup.pid and start FSE backup once again
Status of the medium will be empty
 # modprobe dm-snapshot
Dm-snapshot to the variable Modulesloadedonboot in the file
Etc/sysconfig/kernel, like shown in the following example
 Sharing problems
To directories cannot be shared
 Fsefile --migrate FileName
Other problems
Acpi=oldboot pci=noacpi apm=power-off
 No space left on device
Directory and its contents from the external FSE client
Following message is written to the FSE event log
On this partition
 File System Catalog recovery on
Explanation Workaround
 Is running on the associated FSE partition
Log
For files that cannot be deleted
 FSE troubleshooting tools
 Tool name Description
Debugging and operation fine-tuning options
Debugging FSE processes
 Example
InstallPath%\var\log\debug
Debugging options
Var/opt/fse/log/debug
 Var/opt/fse/log/error.log
InstallPath%\var\log\error.log
 Windows specific Flag value Description
 Operation fine-tuning options
 Export HSMBEAVERIFYPOSITION=ALWAYS
Export HSMFRISAFETYBUFTAPE=1000
Export HSMPTDIRECT=no
Export HSMLASERIALUNLOAD=yes
 Restart the syslogd daemon
Debugging FSE backup and restore processes
Debugging HSM file system filter
 Backup or restore debugging results in job failure
Potential problems with debugging
Gathering information about your problem
Checklist for required information
 FSE error codes
Contact
 1002
999
1001
1003
 2006
2004
2005
2007
 3003
3001
3002
3004
 4025
4023
4024
4026
 8006
8004
8005
8007
 10004
10002
10003
10005
 13004
13002
13003
13005
 Opt/fse/doc
OmniNames command
Opt/fse/bin
Opt/fse/lbin
 Path on Linux platform Path on Windows platform Contents
 FSE configuration templates
 Template for FSE libraries
Libraryhostname
 Slots Slots = 1-15
 Template for FSE drives
# Tips
 HP StorageWorks File System Extender Software user guide
 Template for LTO media pools
 SysVolLocation = None SizeOfSysVol = 0MB
 Template for disk media pools
 Template for FSE partitions General part
Write-Once-Read-Many file system
 Template for FSE partitions Migration part
 Template for FSE partitions Release part
 FSE configuration templates
 Template for FSE partitions Recall and Allocation part
 Template for FSE partitions Deletion part
 Template for FSE system configuration
 FSE configuration templates
 Media pool FSE media pool
 External client FSE external client
FSE configuration file template
Configuration file
File System Catalog FSC
 Disk buffer
Needs cleaning or servicing
Own deletion policy
See media duplication
 Also Data Location Catalog DLC and Name Space Catalog NSC
See recovery FSE recovery
See recovery FSE recovery, recovery job
 Mode LAM
 FSE job
It, you must use forced initialization
Job
 Retention time
See Medium Auxiliary Memory MAM
Medium
 Online medium
Offline medium
Library
Set to unusable
 InstallPath%\var\rmdb directory on Windows platform
An FSE users request with the fserecover command
Recovery job
Recall, recall job
 FSE implementation
See media pool FSE media pool
 See LTO Ultrium
Is set by enabling the drive with the fsedrive command
Ultrium
Unusable medium
 320
 Index
 184
Default job priority policy 144
Default partition allocation policy
 Configuring, consolidated FSE system
 GUI
 HP StorageWorks File System Extender Software user guide
 326
 FSE Management Console GUI 57 status check
Media 117, 119 media pools
 328