HP StorageWorks File System Extender Software user guide
 File System Extender Software user guide
 Contents
 Migration, release, recall, and deletion
Managing media
 Monitoring and maintaining FSE
Backup, restore, and recovery
Troubleshooting
Introduction FSE startup and shut-down problems
 Directory layout B FSE configuration templates
 Document conventions Convention Element
Document conventions and symbols
Intended audience
Related documentation
 Documentation feedback
Subscription service
HP technical support
HP web sites
 Infinite file system
What is FSE?
What is FSE?, FSE basics, FSE architecture,
FSE basics
 NFS and Cifs support
Automatic error detection
Library tape compatibility
Automatic detection of low storage space
 FSE operations
FSE architecture
Migration
 Recall
Release
\Program Files\Hewlett-Packard\FSE
 FSE partition
FSE components
Deletion
HSM file system
 File System Catalog
FSE media pool
FSE medium
FSE library
 FSE drive
FSE implementation options
Consolidated implementation
 Distributed implementation
Page
 FSE implementation with multiple libraries
FSE daemons services and FSE agents
 Fse.exe
Fse-fsevtmgr
Fse-hsm
Fse-svc
 Fse-la-s
FSE utility daemons services
Fse-bea
 Introduction to the FSE command-line interface
FSE command-line interface
FSE user interfaces
 Remove,--list,--show,--status, and so on
FSE command list
 FSE command Description
Accessing the online FSE command-line reference
FSE Management Console
 FSE Management Console client
FSE Management Console server
 Configuring the FSE Management Console
 Var/opt/fse/log/guisrv.log
InstallPath%\var\log\guisrv.log
InstallPath%\var\cfg\gui\guisrv.users.db
InstallPath%\var\log\fse.log
 Parameter Description
Configuring the logging level
 Debuglevel = -d4 -DAll Debuglevel = -dTrc -DAllD
Example of a configured FSE Management Console logging
Starting and stopping the FSE Management Console
Starting and stopping the FSE Management Console server
 # /etc/init.d/guisrv start
Starting the FSE Management Console server on Linux systems
# /opt/fse/lbin/guisrv Options
 # /etc/init.d/guisrv stop
Stopping the FSE Management Console server on Linux systems
 HP StorageWorks File System Extender Software user guide
 InstallPath%\binguisrv -F
InstallPath%\binguisrv Options
 \cd %InstallPath%\bin
 # export DISPLAY=fsemcclient0
\Documents and Settings\Username\Application Data\guicltrc
Starting and stopping the FSE Management Console client
Starting the FSE Management Console client on Linux systems
 # guiclt Options
Stopping the FSE Management Console client on Linux systems
Page
 Before you start
Configuring FSE
 Configuration files
Configuration basics
FSE configuration file elements
 Templates
Configuration Database
 Var/opt/fse/rmdb
Configuring a new FSE resource
Resource Management Database
Var/opt/fse/cfg
 Fsepartition --modify Partition01 MyFile
Modifying the configuration of an FSE resource
Fsepartition --list --detail
Fsepartition --show Partition01 MyFile
 Fsepartition --show PartitionName --history
Operational modes of the FSE Management Console client
 # /opt/fse/bin/guiclt
Choosing online operational mode
 Graphical user interface overview
Choosing offline operational mode
 GUI layout
Graphical user interface layout
 SystemName
Object tree
Page
 Configuring FSE
 HP StorageWorks File System Extender Software user guide
 Configuring FSE
 HP StorageWorks File System Extender Software user guide
 Configuration dialog box
 Menu bar contains several menus
Menu bar
 New Connection
 Menu item action Applicable objects Action description
 View is displayed
Toolbar
 Status bar
 Unreliable
Recovery mode
Open
Unusable
 Keyboard shortcuts
FSE Management Console users
Managing FSE Management Console users
 Configuring an FSE resource using an FSE user interface
Configuration procedure
FSE Management Console user properties
 Phase 1 configuring FSE libraries and FSE drives
Overview of the configuration procedure
About Scsi identification
 Library and drive configuration procedure
 Name Host ControlDevice LibType MediaFamily Slots
Opt/fse/newconfig. Windows specific
Name Library MediaFamily
 Fselibrary --addLibraryCfgFileName
DriveIndex Capabilities Host ControlDevice
 Example of a library configuration file
Library and tape drive configuration examples
 = LTO
# AIT Sony AIT Family # LTO LTO Ultrium MediaFamily
 Example of an LTO Ultrium tape drive configuration file
 Example of an LTO Ultrium Worm tape drive configuration file
 Name
Phase 2 configuring FSE media pools
 Name MediaFamily PoolType BlockSize VolumeSize
Phase 3 preparing HSM file systems
 \mkdir hsmfsfolder
Creating and preparing new HSM file systems
Preparing HSM file systems on the Linux platform
Preparing HSM file systems on the Windows platform
 Integrating existing file systems on the Linux platform
Integrating existing file systems in the FSE implementation
Integrating existing file systems on the Windows platform
 Configuring a regular FSE partition on the Linux platform
Phase 4 configuring FSE partitions
 Fsepartition --status PartitionName
 Configuring an FSE partition Click OK
Configuring a regular FSE partition on the Windows platform
 \\?\Volumef6f3e1b6-b2ac-11d7-9c99-00b0d02fadef\
 Fsepartition --addPartitionCfgFileName
 Examples of configuration files for Worm FSE partitions
Configuring a Worm FSE partition
 Fsemedium --format Barcode --force
Phase 5 preparing FSE media
Fselibrary --update-inventory LibraryName --rescan
Fsemedium --format Barcode
 Fsemedium --init Barcode
For forced initialization use the following command
Fsemedium --init Barcode --force
 Mounting HSM file systems on the Linux platform
Phase 6 mounting HSM file systems
Fsesystem --status
 Command generates an output similar to the following
 \fsepartition --list
Reconfiguring FSE interprocess communication
\\?\VolumeVolumeGUID\
Mounting HSM file systems on the Windows platform
 OmniORB.cfg Etc/opt/fse
Reconfiguration procedure
Services.cfg Etc/opt/fse
Var/opt/fse/omniorb. Windows specific
 Hostname = fseserver.fsenet Server = fseserver.fsenet
Ordinary LAN connection
Private network connection
Server = fse-server1.company.com
 Services.cfg file
OmniORB.cfg file, configure the parameters in the section
Services.cfg and omniORB.cfg files
 Hostname = fseclient.fsenet Server = fseserver.fsenet
Reconfiguring communication on external Linux FSE clients
 Reconfiguring communication on external Windows FSE clients
 Changing the IP address of an FSE host
 Configuring FSE
 Introduction, FSE media pools, FSE media,
Media pool types and their characteristics
Introduction
FSE media pools
 MyConfiguration. Linux specific
Configuring a media pool
 # Regular Regular media pool for FSE partition
LTO
 SysVolLocation = None SizeOfSysVol = 0MB
Example of an LTO Worm media pool configuration file
 Example of a disk media pool configuration file
Determining the configured media pools
Fsepool --list --detail
 Managing media
 Excerpt from the fsepool --list output
Checking the status of a particular media pool
Excerpt from the fsepool --list --detail output
 FSE media
FSE medium volumes
Excerpt from the fsepartition --status output
 Disk media
FSE media types
Disk media
LTO Ultrium 3 Worm
 Capacity disk
Local and remote file systems as disk media
Var/opt/fse/dm/dm000001 Var/opt/fse/dm/dm000002
 Mnt/diskmedium linuxhost.company.comrw,nosquashroot
Disk media specifics
`-- dm000001
 Formatting media
Adding media to an FSE media pool
 Skipping media formatting
Medium is formatted using the following command
Medium is initialized using the following command
Initializing media
 Duplicating media
 LTO 1 100 GiB * 2 = 200 GiB
Procedure for duplicating media
How it works
Prerequisites
 Forced duplication
Normal duplication
LTO 2 200 GiB * 2 = 400 GiB LTO 3 400 GiB * 2 = 800 GiB
 Media reorganization process
Reorganizing media
Limitation
 Enabled/mounted
Fsemedium --list Barcode --volume
 Number of latest generations parameter
Media reorganization parameters
Exceptions to the reorganizational rule
Boundary migration date and time parameter
 Meaning of the columns is the following
Example command output
Scanning media for obsolete data
Displaying the FSE media pool-based statistics
 Running the media reorganization job
Job to the command shell for --no-monitoroption
Displaying the FSE media-based statistics
 An example output is the following
Reusing the recycled medium volumes
Fsemedium --list
 Redundant copy recreation process
Recreating redundant copies of migrated data
052002 Data 5949 Open, scanned Empty System 1019
 Media Pool
 Starting redundant copy recreation
Command output will be similar to the following
Fsemedium --copy-contents Barcode --no-monitor
Determining the unusable media
 Fsefile -M Filename
Resolving situations with no alternative migrated copies
 Checking the status of media
 PoolLTO Open LiblibLTO5 000116
Example output of the fsemedium --list command
Example output of the fsemedium --list --detail command
PoolLTO Open LiblibLTO3 000046
 Checking the status of a particular medium
Changing the condition status of media
Status of the medium can be one of the following
 Preventing reading from and writing to an FSE medium
Closing medium volumes
Recreating Fast Recovery Information from media
Preventing writing to an FSE medium
 Fsemedium --remove Barcode
Fselibrary --update-inventory command for this purpose
Fsemedium --recreate-fri Barcode --volume VolumeNumber
Removing FSE media
 Managing media
 HSM lists
FSE operation basics
How does FSE function?
Policies
 FSE disk buffer
 Storage space allocation in an extended FSE disk buffer
Hierarchical Storage Manager lists
 Changes of states of files under FSE
Policies
 Minimum file age for migration MinFileAge
What is a retried migration?
Migration
Migration policy parameters
 Maximum number of files for migration MaxNumMigFiles
Minimum wait time for migration MinWaitTime
Maximum wait time for migration MaxWaitTime
Minimum number of files for migration MinNumMigFiles
 Watermarks
Default migration policy
Release
Example situations that trigger migration
 Reaching the critical watermark on an HSM file system
High watermark
 Low watermark
Exclusion from release
 Filename pattern conventions
Considerations before configuring exclusion from release
Limitations
 Special pattern-matching characters
 Release policy parameters
 Minimum file size for release MinFileSize
Example situations that trigger release
Migration retention time MigRetentionTime
Recall retention time RecallRetentionTime
 Recall
Default release policy
Recall parameters
 Automatic deletion process
Default recall policy
Recall timeout RecallTimeout
Deletion
 File expiration time FileExpiration
Deletion policy parameters
Directory paths Path
 Default deletion policy
Examples of a configured deletion policy
 Resource allocation concepts
Resource allocation
Starting the deletion job
Recalling deleted files
 Media selection by media location
Central FSE resource manager
Several allocation parameters
 ThresholdJobCount = 3/2 * MaxNumDrives
System allocation and job priority policy
System allocation and job priority policy parameters
Job priorities
 Time step TimeStep
Resource allocation threshold ResourceAllocationThreshold
 Partition allocation and job priority policy parameters
Partition allocation and job priority policy
 Default partition allocation and job priority policy
Maximum number of drives for recovery MaxNumDrivesRecovery
Recovery priority RecoveryPriority
Maintenance priority MaintenancePriority
 Priority calculation
Administrative and backup job priority calculation
 Parallel copying
Multiple copying
Example of resource allocation
 Limited Access Mode LAM and Full Access Mode FAM
HSM file system access modes
Sequential copying
 HP StorageWorks File System Extender Software user guide
 Migration, release, recall, and deletion
 Number of running jobs
Procedures in this chapter provide instructions for
About monitoring and maintaining in FSE
Monitoring general FSE implementation status
 Host and mount point of the belonging HSM file system
Example output of the fsesystem --status command
Managing FSE partitions
Monitoring FSE partition status
 Displaying the status of an FSE partition
 Disabling an FSE partition
Example output of the fsepartition --status command
 Removing an FSE partition
To enable an FSE partition, do the following
Windows specific Invoke the following command
Enabling an FSE partition
 Retrieving detailed information for an FSE partition
Switching the access mode for an HSM file system
 Monitoring FSE jobs
Switching to Limited Access Mode
Switching to Full Access Mode
Limited Access Mode error messages
 Example output of the fsejob --list --detail command
Example output of the fsejob --list command
Fsejob --list --maint PartitionName --detail
 Fsejob --status JobID
Displaying the status of a particular FSE job
 Recalling older generations of a file
Example output of the fsejob --status command
 Example output of the fsefile --history command
 Example of recall by file ID instead of filename
Recalling sets of files in an efficient way
Example of recall by date
Example of recall by file migration ID
 512MBc, and 512MBd
Command fsefile --recall --if
Efficient recall invocation
Logging file recalls
 Retrieving detailed information
Example excerpt from the FSE error log file
Managing FSE recall jobs
 Fsepool --list
Fsemedium --list --volume
Fselibrary --list
Fsedrive --list
 Name Drv01 Family
Scsi
 Pool Pool01
UsageCount 137 Capabilities Key Name Drv02 Family
Ac3050b1-a838-458e-9a21-d3d3429cade9
 47b5fddc-03f7-4b80-8dab-5d2f6fe18cc1
33d4ef52-7ec8-4926-97f9-909edfe66c41
 HP StorageWorks File System Extender Software user guide
 1acf6a41-a23f-4836-9e4d-539d31ad572f
Barcode 000009 VolNum
 Cfe954e0-21bb-428b-84fa-076754539f76
Eca50ba5-f068-4650-a587-945fcffda287
 8920cdd9-57ee-4f2e-a09a-d701249c6434
B8e4d73b-890c-41d0-bb20-eefe19d3f057
 Bfca4697-a1e0-4881-ba12-953acbb72a02
LastVer 1970/01/01 ValidData TotalData
Partition Part01
583
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Extending storage space of FSE disk buffer
 Benefits of extended FSE disk buffer
How to extend the FSE disk buffer?
 Consistency check of FSC vs. HSM file system
Checking the consistency of the File System Catalog
Removing a file system from the FSE disk buffer
 Fsecheck --fsc-hsmfs PartitionName
Types of inconsistencies
 MigID 273932147200 FileSize 18691
Hsmfs Notes
OwnerID 154336
 REPORTING-BUGS REPORTING-BUGS
MigID 273931007488 FileSize 2815
 Starting the consistency check
Consistency check of FSC vs. FSE media
 Options for consistency check of FSC against FSE media
 Example results of the FSC vs. FSE media consistency check
Inconsistency types
MigID MediaKey MedVolNum
 Dump FRI
 Var/opt/fse
Low storage space detection
 General HHM settings
HHM configuration file
Var/opt/fse/part Var/opt/fse/log
 Key Description Default value on Linux Windows
Mail settings
Triggered actions definitions
 Variable Description Examples or possible values
 Monitored items definitions
Triggered actions section of the configuration file
 CriticalActionLT
Filesystemtype
CriticalThreshold
CriticalActionGE
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Monitoring and maintaining FSE
 Listing the contents of the HHM configuration file
Configuring low storage space detection
Modifying the contents of the HHM configuration file
 Viewing FSE log files
FSE log files
 Monitoring and analyzing FSE log files
Configuring monitoring and analysis of FSE log files
FSE event log /var/opt/fse/log/fse.log
 LogAnalyzerRules.py
General configuration file
 # --- Debug
LogAnalyzer
 ActivityLog = /var/opt/fse/log/loganalyzermessages.log
 # --- From # From-Part of the mailheader
# --- Subject # Subject-Part of the mailheader
# --- To # To-Part of the mailheader
 Debug
# Default is 1 minute
# CommunityName # The community name of the machine
SleepTime
 ServerName
UseSMTPAuthentication
ProcessFileFromBeginning
IgnoreCase
 Rules = \
Rules configuration file
 MailLogMessagessbj
MailLogMessages
MailCurrentLogMessagesbj
 Action Name Description
Starting the monitoring and analysis of log files
 Example FSE event log
Reconfiguring the monitoring and analysis of log files
FSE event log
Logging FSE media operations
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Windows specific
 HP StorageWorks File System Extender Software user guide
 Example FSE error log
FSE error log
 HP StorageWorks File System Extender Software user guide
 Monitoring and maintaining FSE
 Windows specific
 Monitoring and maintaining FSE
 HP StorageWorks File System Extender Software user guide
 Checklic checklic-output.txt
Determining total offline storage capacity
Generated report conforms to the following example
# cd /opt/fse/sbin/tools # ./checklic
 Introduction, Defining your backup strategy,
Defining your backup strategy
Backup, Restore, Recovery,
 See HSM file system
Recovery methods for FSE components
 What is FSE backup?
Backup
FSE component Description Recovery method
 # modprobe dm-snapshot
Backup configuration file on Linux platform
How it works?
Prerequisites
 Backup process
Backup media management
MODULESLOADEDONBOOT=dm-snapshot
 Preparation of already used media
Configuring a backup media pool
Estimating resources
Preparation of new media
 Fsebackup --medium Barcode --init
Defining the backup policy
Backup media recycling
Estimating backup frequency
 Fsebackup command
Starting FSE backup
Examples of backing up to disk
 Example of backing up to disk and tape
Example FSE backup log file
Activity logging
Example of backing up to tape
 CMD
 HP StorageWorks File System Extender Software user guide
 What is FSE restore?
Restore
Aborting FSE backup
 Restore process
 Examples of restoring from disk
Starting FSE restore
Fserestore command
Examples of retrieving backup images from tape
 Fsebackup --device /dev/sg1 --offset 3 --count
Example FSE restore log file
Opt/fse/lbin/fserestore.py -f /root/test.tar.bz2
 CMD
 Aborting FSE restore
Recovery
Post-restore steps
File System Catalog recovery
 Prerequisite
HSM file system recovery
HSM file system recovery procedure
Enable the FSE partition Start the recovery of FSC
 # fserecover --hsmfs PartitionName
Status of user data on the recovered HSM file system
\fserecover --hsmfs PartitionName
 Backup, restore, and recovery
 Troubleshooting
 Examining the process list in Windows Task Manager
FSE startup and shut-down problems
# ps -ef grep CommandName
Defaults to C\Program Files\Hewlett-Packard\FSE
 # rpm -qa grep fse- grep -v fse-gui.client.pkg
Agent.pkg Cli-admin.pkg Common.pkg Server.pkg
# ls -a /etc/opt/fse
Cli-user.pkg Client.pkg Common.pkg
 Resolve it
OmniORB cannot work with such a configuration
 Use Task Manager to terminate the FSE processes
Use the kill command to terminate the FSE processes
Try to start them manually, the following error is reported
Operating system tools to terminate all FSE processes
 Ibserver pid 896 895 581 577 576 is running
Firebird server problems
Firebird.sourceforge.net
# /etc/init.d/firebird status
 It defaults to C\Program Files\Hewlett-Packard\FSE
Communication problems
 You must restart FSE with the fse --restartcommand
Service daemon service
Run the command omniNames --statusand inspect its output
Stop the FSE processes with the fse --stopcommand
 Fsepartition --status PartitionName
Use the command ps -ef grep fse-hsm
 Driver is disabled
Scsi problems
 Hprescan -a
Etc/rc.d/rc.local
Cat /proc/scsi/scsi
 # cat /proc/scsi/scsi
Tape library problems
Options scsimod maxscsiluns=255
# echo scsi scan-new-devices /proc/scsi/scsi
 Fsedrive --remove Name
Fselibrary --update-inventory LibraryName --rescan
 FseError 11005 Medium overflow physical EOM
Media management problems
Volume Overflow 0x00,0x02 End-of-partition/medium detected
 Execution
Problematic medium volume
Is known
Into the Rmdb
 Workaround
 HSM file system mounting problems
 Fse --mount I\fse\fsefs01 \\?\Volume...\
\fse --dismount-ntfs VolumeName
Fse --mount I\fse\fsefs01 \\?\Volume
Fse --umount I\fse\fsefs01 \\?\Volume...\
 Fsepartition --add PartitionName
Fsepartition --disable PartitionName
Fsepartition --enable PartitionName
Fsepartition --remove PartitionName
 HSM file system mounting problems on
HSM file system filter problems
Fse --dismount-ntfs VolumeName
Accessed for the first time
 Fse --start
Fse --stop
Fsecheck --fsc-hsmfs PartitionName
 Prevent it from running out of free space
Migration problems
Start writing to tape
Runs out of free space
 Fsefile --recall --id PartitionName FileID --into Path
Fsefile --history FileName
 Migration of the file is started
FSE error log
File DirectoryPath/FileName
Complete
 Unusable FSE medium to become good usable
Recall problems
Use the ps -ef grep fse-hsmcommand for this purpose
Has been allocated for recall
 Scanning against viruses
 Not indicate data loss
Backup, restore, and recovery problems
Recall them manually
 FSE Windows Service stopped
Section Verifying and repairing the installed FSE software
\fse --stop
 Status of the medium will be empty
FSE backup cannot be started
File backup.pid and start FSE backup once again
Layout
 Etc/sysconfig/kernel, like shown in the following example
Dm-snapshot to the variable Modulesloadedonboot in the file
# modprobe dm-snapshot
 To directories cannot be shared
Sharing problems
 Acpi=oldboot pci=noacpi apm=power-off
Other problems
Fsefile --migrate FileName
 On this partition
Directory and its contents from the external FSE client
Following message is written to the FSE event log
No space left on device
 Explanation Workaround
File System Catalog recovery on
 For files that cannot be deleted
Log
Is running on the associated FSE partition
 FSE troubleshooting tools
 Debugging FSE processes
Debugging and operation fine-tuning options
Tool name Description
 Var/opt/fse/log/debug
InstallPath%\var\log\debug
Debugging options
Example
 InstallPath%\var\log\error.log
Var/opt/fse/log/error.log
 Windows specific Flag value Description
 Operation fine-tuning options
 Export HSMLASERIALUNLOAD=yes
Export HSMFRISAFETYBUFTAPE=1000
Export HSMPTDIRECT=no
Export HSMBEAVERIFYPOSITION=ALWAYS
 Debugging HSM file system filter
Debugging FSE backup and restore processes
Restart the syslogd daemon
 Checklist for required information
Potential problems with debugging
Gathering information about your problem
Backup or restore debugging results in job failure
 Contact
FSE error codes
 1003
999
1001
1002
 2007
2004
2005
2006
 3004
3001
3002
3003
 4026
4023
4024
4025
 8007
8004
8005
8006
 10005
10002
10003
10004
 13005
13002
13003
13004
 Opt/fse/lbin
OmniNames command
Opt/fse/bin
Opt/fse/doc
 Path on Linux platform Path on Windows platform Contents
 FSE configuration templates
 Libraryhostname
Template for FSE libraries
 Slots Slots = 1-15
 # Tips
Template for FSE drives
 HP StorageWorks File System Extender Software user guide
 Template for LTO media pools
 SysVolLocation = None SizeOfSysVol = 0MB
 Template for disk media pools
 Write-Once-Read-Many file system
Template for FSE partitions General part
 Template for FSE partitions Migration part
 Template for FSE partitions Release part
 FSE configuration templates
 Template for FSE partitions Recall and Allocation part
 Template for FSE partitions Deletion part
 Template for FSE system configuration
 FSE configuration templates
 Media pool FSE media pool
 File System Catalog FSC
FSE configuration file template
Configuration file
External client FSE external client
 See media duplication
Needs cleaning or servicing
Own deletion policy
Disk buffer
 See recovery FSE recovery, recovery job
See recovery FSE recovery
Also Data Location Catalog DLC and Name Space Catalog NSC
 Mode LAM
 Job
It, you must use forced initialization
FSE job
 Medium
See Medium Auxiliary Memory MAM
Retention time
 Set to unusable
Offline medium
Library
Online medium
 Recall, recall job
An FSE users request with the fserecover command
Recovery job
InstallPath%\var\rmdb directory on Windows platform
 See media pool FSE media pool
FSE implementation
 Unusable medium
Is set by enabling the drive with the fsedrive command
Ultrium
See LTO Ultrium
 320
 Index
 Default partition allocation policy
Default job priority policy 144
184
 Configuring, consolidated FSE system
 GUI
 HP StorageWorks File System Extender Software user guide
 326
 Media 117, 119 media pools
FSE Management Console GUI 57 status check
 328