Data Migration | ADIC FileServ Version 4.0 600716 Rev A instruction

AdministrativeTasks

Data Migration

File Cleanup

A migration directory is controlled by FileServ (for example, a directory that has a DataClass association.) Files stored under this directory, as well as any subsequent subdirectories, are migrated from disk to media as specified by the DataClass parameters.

A DataClass group can be created so that files of associated directories exhibit certain distinctive migration behavior. These behaviors are controlled by a combination of setting the:

•File Cleanup.

•Minimum Time parameters.

•Policies.

These are described below.

After a file is copied to media (migrated), the disk copy of the file remains or is removed from the disk. The fschfiat-ecommand allows a file to remain on the disk indefinitely.

The file retention for the DataClass group definition defines how a disk copy is removed. By setting this parameter to immediate, after a file is known to contain the required number of copies on media, the disk copy is immediately removed. By setting the parameter to “policy application”, the file remains on disk even after the required number of media copies exist.

The amount of time the file remains on disk after storage is partially determined by setting the DataClass Minimum Time Parameter (mintime). As long as the file system contains empty disk space (as set by the LOBLK_THRESHOLD in the fs_sysparm file on SGI systems), the file remains on disk until the Minimum Time interval passes.

2-30

Operating Tasks

600716 Rev A

Image 106

ADIC FileServ Version 4.0 600716 Rev A manual Data Migration, File Cleanup

Contents

Administrative Tasks FileServ Version February Rev a Trademark Notice East Peakview Ave Englewood, CO 80111 USA Phone FAX Reader Comment Form Page Contents Administrative Tasks Operating Tasks Administrative Tasks Utilities Index Preface Preface Troubleshooting Tools Troubleshoot operating problems Are listed below ConventionsConventions used throughout the FileServ technical books Su root Books Online Books Contact Publications Department Secured Web Site RelatedPublications Publications described in the table below are created System Tasks Roadmap Topic Refer To Chapter Access the Host Server FileServ Interface to VolServ Drive Pools MediaClass with AssociateLibrary Define DataClass Groups These files are stored using the fsstore command Associate Directories Media Under FileServ Management Policies CreateMigration Tape Routine Processing Part of the FileServ system routine processing includes Faster and more reliable when regular checkpoints are taken Script checkpoints the Raima database database recovery isChkpoint.pl CheckDBALL Monthly Bi-weekly Daily# $FSHOME/util/checkDBAll tempfilename KeyBuildAll Utilities that operate on specific file systems are Command Line Mode Options Description Frequency of Use # su root # $FSHOME/util/fsrecover Trashcan Cleanup System Tasks Startup and Shutdown Normal Startup Processing RecoveryContingency Startup Run the FileServ -ccommand FileServ -c Normal Shutdown # ps -elf grep fs # ps -elf grep fsadm Managing System Configuration System Tasks System AdministrationGeneral Parameters Parameters Filelblfmttape DLT Maximum number of drives allowed Parameters can be tuned, if Maximum number of retries for any Maxtapetotapeallocti Threshold value when equalled or YES None Default media type D2S, D2M, D2L Following list shows parameters that are used by the file Retry the commandFile Retention Comment keyword search and file expiration processes. To VolServ-specific Following parameters are specific to the VolServ system Completely reinitialized and reinstalled InstallationInstallation script for this purpose Following list shows the system parameters that are to be Default component ID only for Maintenance Software Logging Parameters Media StatsFollowing list shows parameters that can be modified, as Fsfacility Edit System Configurable system parameters are modified by editingEdit the fssysparm file using a text editor FileServ system parameters $FSHOME/fssysparm file Recycle FileServ by running the command below An example for the Classmtime parameter is shown below Administrative Tasks Add a Library Edit Device Delete a Device Fsconfig Run the fsconfig commandGenerate Report Fsconfig command can configure various drives. Change Component State Drive Names Supported Drives Supported Media Media Types Unavail Maint OFF Unknown Add and Delete Drives Tasks Cshrc Reallocate Drives Using a text editor, open the fssysparm fileFine-tune Parameters Located in the $FSHOME/sysparms directory Modify Tape Usage Modify any of the default tape utilization parametersIdentified in the table below Redirect Policy Applications Administrative Tasks Operating Tasks Topic Refer To DataClass Management Special DataClass Groups Topic To create a DataClass group, follow the steps below Fsaddclass prodclass Use fsclassinfo to compare each DataClass Run the fsmodclass command and specify aDataClass group name Group parameter. Then either change the class Remove Group with fsrmclass Command Table below describes the report’s fields Fsclassinfo lowtwr6 -l Operaitng Tasks Manipulate Relations Add Relations with fsaddrelation CommandRelation is added with the fsaddrelation operation Associate New Data with New Relations Associate New Directories with Files Dir1 Use the Unix ls command to verify that Directory to be associated already exists Fsaddrelation production -c england Fsdump -f /arch1/site1production.dumpfile /site1/production Specify the name of the directory to disassociate Run the fsrmrelation commandFsrmrelation production Change Relation Points Roll Up DataClass Groups Dir1 Dir2 Dir6 Fsrollup production Dir7 Fsrolldown production Fsdirclass /production Links File ManagementPathname FileServ supports hard links and soft links Spanning Clustering Operaitng Tasks Modify File Attributes Fschfiat -i test1 Generate Report Operaitng Tasks File Cleanup Data Migration Cleanup policies using the fspolicy command with various Rather, the planned execution of migration and disk cleanupPolicies as well as the DataClass characteristics provide Time parameters does not establish the DataClass migration Storage Policy Example only ######################################################## Cleanup Policy Overflow Policy Running as a cron Event Minutes hours day-of-month month day-of-week command 1,15 AdministrativeTasks Storing Retrieving Data Store Files Operaitng Tasks Cleanup by File Clean Up Data from DiskName Secondary Files Cleanup byCopy DataClass General Storage Processing Operaitng Tasks Retrieve Files Operaitng Tasks For more information on the fsundelete command, refer to Operaitng Tasks AdministrativeTasks Retrieve Partial Files Delayed Dismount Operaitng Tasks Media Management Media ServicesVolServ performs media services to manage the physical Libraries and movement of media Media Class Type Definition Load and Unload Media Remove Media Add Blank Media Import command and the MediaClass Marred when the media is entered, the media isMedia are entered by the VolServ operator using Run the fsmedin command with the -boption Remove Blank Fsmedout command allows the removal of blank mediaMedia Remove Blank Media Format Media Media Duplication Copy Media Media States Copy Files State Description Storage Limit Generate Media Reports Fsmedinfo -l feu002 Blank pool Media ListFor media in all DataClass groups and media in the general Fsmedlist -c testclass Each of the categories previously described. If no -loption generates a longer report shownBelow that includes the identifiers of the media for Options are specified, all of the media identifiers AdministrativeTasks Utilities Utilities Autostart UtilitiesFspic Scripts Dbcheck Directory for files ending with the .dbd To determine the name of the databaseExtension Keybuild Trouble- shooting Tools Trouble- shooting Tools Data Retrieval Fails Commands that ID Problems Disaster Recovery Messages Status Messages Extract Syslog Messages Log File Maintenance Syslog Messages Set Up FileServ Logging Change directory cd to the directory where the log Issue the Unix tail command of the fileDetermine the log file where you can extract Run the fsextlog command specifying the log Recover Data Xfscheck /dev/dsk/dks2d6s7 Restore Data Run the xfsrestore command Data restored from tape by using the Unix dfCommand /arch3 file system is used throughout this Example Xfsrestore -f /dev/rmt/tps0d3 /arch3 If the procedure fails, call technical support Use the Unix mkdir command to create the parentRerun the fsaudit -r -f command Run the keyBuildAll utility to update the key Run the xfsrestore -i command Add home add mrktg add junk Extract Cd ../trunccandidates Database maintenance compares Unix file system Fsaudit command serves two purposesRecovery of file systems File System Recovery Database CommandRunning fsaudit Rev a Trouble- shooting Tools Troubleshoot System Performance Reports Report Media Fragmentation Report Class Media Movement Report Fsmoverpt Table below lists the Request Types and State fields Fsqueue History Report Component Statistics Report Fshistrpt -h V0, 10, V0, 11, V0, 12, V0, 13, V0 Hardware Configuration Report Fschstate Drive Contact Technical Support Administrative Tasks Index INX-2 INX-3 Commandextractheader Commandinfodetail -43 Commandlogging Connectretries -32 Connectsleeptime Deffileretentionperiod Percentfulltomigrate