Data Protector internal database, About the IDB | HP B6960-96035

5 The Data Protector internal database

In this chapter

This chapter describes the Data Protector internal database (IDB) architecture, as well as its usage and operation. Explanations of the database parts and their records are presented, along with recommendations on how to manage database growth and performance, including formulas for calculating its size. This information is needed to effectively administer the database configuration and maintenance.

It is organized as follows:

“About the IDB” on page 187

“IDB architecture” on page 189

“IDB operation” on page 194

“Overview of IDB management” on page 196

“IDB growth and performance” on page 197

About the IDB

What is the Data Protector Internal Database (IDB)?

The IDB is an embedded database, located on the Cell Manager, which keeps information regarding what data is backed up, on which media it resides, the result of backup, restore, copy, object consolidation, and media management sessions, and what devices and libraries are configured.

Why is the IDB used?

There are three key reasons for using the IDB:

Concepts guide

187

Image 187

HP B6960-96035 manual Data Protector internal database, About the IDB

Contents

HP Data Protector A.06.10 Concepts guide Page Contents Planning your backup strategy Types of incremental backups Media management and devices 133 Users and user groups 183 Data Protector internal database 187 Service management 205 Integration with database applications 237 How Data Protector operates 219 This chapter 265 Overview Supported configurations 269 Direct backup 243Disk backup 253 Synthetic backup 257 Further information 331 Microsoft Volume Shadow Copy service 289Backup scenarios 297 Snapshot concepts 275 Glossary 345 Index 403 Figures 149 Backup session information flow multiple sessions Page Page Tables Page Page Edition history Publication historyPart number Guide edition Product Publication history Guides About this guideIntended audience Documentation set HP Data Protector integration guides HP Data Protector installation and licensing guideHP Data Protector troubleshooting guide HP Data Protector disaster recovery guide HP Data Protector integration guide for HP Reporter HP Data Protector zero downtime backup concepts guideHP Data Protector zero downtime backup administrators guide HP Data Protector zero downtime backup integration guide This guide fulfills a similar function for Media Operations HP Data Protector command line interface referenceOnline Help HP Data Protector Media Operations users guide Abbreviations Documentation mapGuide Abbreviation Guide Map Integrations Integration Guide Document conventions Document conventions and symbolsConvention Element Provides additional information Data Protector graphical user interfaceProvides helpful hints and shortcuts Data Protector graphical user interface General information HP technical support For additional information, see the following HP websites Subscription serviceHP websites Documentation feedback This chapter About backup and Data ProtectorAbout Data Protector High Availability Support Page What is a backup? Introducing backups and restoresThis section explains basic backup and restore concepts Backing up a network environment What is a restore? Data Protector architecture Direct backup Cell Manager Data Protector cell physical view and logical view Systems to be backed up Systems with backup devicesInstallation Server Operations in the cell What is a backup session? Backup sessionsHow does it work? What is a restore session? Restore sessions Splitting an environment into multiple cells What is an enterprise environment?When to use an enterprise environment Enterprise environments MoM Why split large environments into multiple cells? Manager-of-Managers environment Media management What is a media pool?Media management functionality Backup devices Data Protector GUI User interfacesPage Original Data Protector GUI Data Protector Java GUI Data Protector Java GUI architecture Differences from the Original Data Protector GUI Benefits of Java GUI Overview of tasks to set up Data Protector Install and configure your Data Protector environment Restoring data on Planning your backup strategyDisaster recovery on Clustering on Defining the requirements of a backup strategy Backup strategy planningWhat is backup strategy planning? Page Preparing a backup strategy plan Factors influencing your backup strategyPage One cell or multiple cells? Planning cellsPage Installation Servers and the Cell Manager Installing and maintaining client systemsCreating cells in the Unix environment Windows domains Creating cells in the Windows environmentMapping a Data Protector cell into a Windows domain Considerations for geographically remote cells Creating cells in a mixed environmentGeographically remote cells Windows workgroups MoM environment Network versus local backupsUnderstanding and planning performance Infrastructure Devices Network or server versus direct backupsDevice performance High performance hardware other than devices Advanced high performance configurationUsing hardware in parallel When to use parallelism Software compression Configuring backups and restoresHardware compression Disk image versus filesystem backups Full and incremental backupsObject distribution to media Compression Disk image backupsDisk performance Disk fragmentation Online database application performance What is security?Planning security SAN performance Data Protector users accounts Cells Data Protector user rights Data Protector user groups Hiding data from other users Visibility of backed up dataData encryption How Data Protector AES 256-bit encryption works How Data Protector drive-based encryption works Backup session with AES 256-bit encryption Restore from encrypted backups What is backup ownership?Who owns a backup session? Cluster concepts Backup ownership and restoreWhat is a cluster? Clustering Shared disks Cluster nodesCluster network What is a virtual server? What is a package or group?What is a failover? Load balancing at failover Automatic restart of backupsCluster support High availability of the Data Protector Cell Manager This section gives three example cluster configurations Cell Manager installed outside a clusterExample cluster environments Virtual server backup Cell Manager installed outside a cluster Condition Backup behaviorResult Virtual server backup Condition Result FC/SCSI MUX Virtual server backup Failover before a backup starts Comparison of full and incremental backup Full and incremental backupsIncremental backup Full backup Incremental backup Full backupsIncremental backups Synthetic backup Enhanced incremental backup Conventional incremental backupTypes of incremental backups Backup saves all changes since the last Incr4 backup. An Level that is still protected. For example, an Incr1 backupIncr1-9 backup never references an existing Incr backup Relative referencing of backup runs Incremental backups How to read on Considering restoreExamples TIP Media needed to restore from leveled incremental backups Data Protector Internal Database What is data protection?Keeping backed up data and information about the data Data protection Catalog protection Browsing files for restoreWhat is catalog protection? What is logging level? Enabling the restore of files, but not browsing Enabling the browsing of files and quick restoreOverwriting backed up files with new data Exporting media from a cell Backing up data How to create a backup specification Creating a backup specificationSelecting backup objects What is a backup specification? Examples of backup options Object mirrors Backup types and scheduled backupsWhat is an object mirror? What is a media set? Optimizing backup performance Scheduling, backup configurations, and sessionsBackup configuration Backup session Staggered approach When to schedule backupsStaggering full backups Optimizing for restore Example Full backup with daily simple incremental backups Full backup with daily level 1 incremental backups Automated or unattended operation Considerations for unattended backupsPage Data Protector data duplication methods Duplicating backed up dataObject copy Object mirror Media copy Smart Media Copy Copying objects What is object copy? Start of object copy session Post-backup object copyingScheduled object copying Selection of the media set to copy from Selection of devicesObject copy session performance Vaulting Why use object copy?Freeing media Demultiplexing of media Freeing media Migration to another media type Consolidating a restore chainDisk staging Object mirroring What is object mirroring? Object mirror operation Benefits of object mirroring Object mirroring Backup performance Copying media What is media copying?How to copy media What is the result? Scheduled media copying What is automated media copying?Post-backup media copying Automated media copying Automated smart media copying Smart media copying using VLSWhat is smart media copying? What happens after the backup? Factors affecting restore duration Restore durationRestoring data Media set selection algorithm Selection of restore chainSelection of the media set Selection of devices When to use this policy Operators are allowed to restoreWhat needs to be done End users are allowed to restore Disaster recoveryPage Disaster recovery methods Recovery methods supported by operating system vendors Alternative disaster recovery methodsRecovery using third-party tools for Windows 132 Planning your backup strategy Devices on Media management and devicesMedia management on Media life cycle on Media pools on Typical media life cycle consists of the following steps Media life cycle See Calculating media condition on Media poolsConcepts guide 135 Media pool property examples How to use media poolsMedia pools and dcbf directories Free pools Default media pools When is a free pool used? What is a free pool?Free pool benefits Media quality calculation Free pool propertiesFree pool limitations Simple one device/one media pool relation Media pool usage examples Configuration of media pools for large libraries Multiple devices, single media pool Implementing a media rotation policy What is a media rotation policy? Estimating the quantity of needed media Media rotation and Data ProtectorMedia needed for rotation Automatic media rotation and media handling Labeling Data Protector media Media management before backups beginWhat is initializing formatting media? Initializing or formatting media How are labels used? Location field Selecting media for backups Media management during backup sessions Distributing objects over media Adding data to media during backup sessionsMedia condition Media usage policy Multiple objects and sessions per medium, sequential writes Calculating media condition Writing data to several media sets during backupMedia condition factors What is vaulting? Media management after backup sessionsVaulting Vaulting usage example Implementing vaulting Concepts guide 153 Using devices with Data ProtectorDevices Restoring from media in a vault TapeAlert Library management console support Device lists and load balancing How load balancing works What is device streaming?How to configure device streaming Device streaming and concurrency Multiple data streams Segment sizeDisk agent concurrency Increased performance Data format Block size Device locking and lock names Number of disk agent buffersDevice names What are standalone devices? Standalone devicesPhysical device collision Preventing collision Small magazine devices Size of a library Configuring a libraryLarge libraries Handling of media Advantages of barcodes Sharing a library with other applicationsEnter / eject mail slots Barcode support What is library sharing? Cleaning tape supportSharing a library with multiple systems Control protocols and Data Protector Media Agents Connecting drives to multiple systems Ndmp Scsi Drive controlRequired Data Protector Media Agent for drive control Drive control protocol Scsi Ndmp ACS Exemplary configurationsRequired Data Protector Media Agent for robotic control ADIC/GRAU 168 Media management and devices Sharing a Scsi library robotics attached to an Ndmp Server Sharing an ADIC/GRAU or StorageTek ACS library Data Protector and Storage Area Networks Storage Area Networks Storage Area Network Fibre Channel Loop topology Point-to-point topology Loop initialization protocol Switched topology Device sharing in SAN Configuring multiple paths to physical devicesConcepts guide 175 Path selection Why use multiple paths Device locking within Data Protector Device lockingBackward compatibility Device locking with multiple applications Indirect Library Access Indirect and Direct Library Access Indirect Library Access Direct Library Access Static drives Device sharing in clusters Concepts guide 181 Floating drives 182 Media management and devices Visibility of backed up data Access to backed up dataUsers and user groups Increased security for Data Protector users Users and user groups Default administratorsPredefined user groups Data Protector predefined user groups Using predefined user groupsFollowing default groups are provided by Data Protector User group Access rights 186 Users and user groups About the IDB Data Protector internal database IDB format IDB on the Windows Cell ManagerIDB size and growth consideration IDB location IDB on the Unix Cell Manager IDB architectureIDB in the Manager-of-Managers environment Underlying technology Media Management Database MmdbMmdb records CDB records Catalog Database CDBMmdb size and growth Mmdb location Dcbf information Detail Catalog Binary Files DcbfSize and growth for CDB objects and positions CDB location Smbf size and growth Session Messages Binary Files SmbfDcbf location Smbf records IDB operation During backupServerless Integrations Binary Files Sibf During object copying or object consolidation During restoreExporting media Filenames purge IDB configurationOverview of IDB management Removing the detail catalog Key IDB growth and performance factors IDB maintenanceIDB recovery IDB growth and performance IDB growth and performance key tunable parameters Concepts guide 199 Logging level as an IDB key tunable parameter Logging level and restore speed Logging level and browsing for restoreImpact on performance Expired catalog protection Catalog protection and restoreCatalog protection as an IDB key tunable parameter Recommended usage of logging level and catalog protection Different logging levels for object copies Use different logging levels in the same cellSpecifics for small cells Specifics for large cells IDB size estimationOn the Windows Cell Manager 204 Overview Service managementIt is organized as follows Overview on Data Protector and service management Key functions Native Data Protector functionalityConcepts guide 207 Application Response Measurement version 2.0 ARM 2.0 API What Is ARM? ARM functionality Functionality of the Data Protector OM integration Integration with HP Operations Manager softwareSnmp traps Monitor Reporting and notification Reporting and notification examples Event logging and notification Java-based online reporting Windows application logData Protector log files What can I do with the data? Data Protector checking and maintenance mechanismUsing the data provided by Data Protector Central management, distributed environment Backup Session Reports Concepts guide 215 Service management integrationsData Protector OM-R integration Data Protector Reporter example Data Protector OM SIP Operational error status report Direct SIP integration example Protector Inet process Data Protector processes or servicesHow Data Protector operates Systems, the system inet daemon Inetd starts the Data RDS Backup sessionsCRS MMD Interactive backup session Scheduled and interactive backup sessionsBackup session data flow and processes Scheduled backup session How many sessions can run concurrently? Backup session information flow On page 223 shows multiple sessions running concurrently Pre-exec and post-exec commands Mount requests in backup sessions Queuing of backup sessions Backing up with disk discovery Restore sessions What happens in a restore session? Restore session data flow and processes How many restore sessions can run concurrently? Queuing of restore sessions How does it compare to a standard restore? Mount requests in a restore sessionParallel restores What is a parallel restore? Object copy sessions Fast multiple single file restore Object copy session data flow and processes Automated and interactive object copy sessions How many sessions can run concurrently? Mount requests in an object copy session Queuing of object copy sessions Automated and interactive object consolidation sessions Object consolidation sessionsObject consolidation session data flow and processes Queuing of object consolidation sessions Mount requests in an object consolidation session Media management sessionsMedia management session data flow How many sessions can run? Overview of database operation Integration with database applications Relational database Online backup of databases and applications Filesystem backup of databases and applications Data Protector integration with databases Concepts guide 241 242 Requirements and support on Supported configurations on Direct backup Configurations on Direct backup benefits How direct backup worksBackup types Environment Direct backup architecture About XCopy About resolve Backup stages for data files Direct backup process flowXCopy + Resolve There are two restore options when using direct backup RestoreRequirements and support Three hosts CM, application, Resolve Supported configurations Two Hosts Cell Manager/Resolve Agent and application Basic configuration single hostConcepts guide 251 252 Disk backup benefits on Data Protector disk-based devices on Disk backup Disk backup benefits File library device Data Protector disk-based devicesStandalone file device File jukebox device Backing up to a disk device Recommended disk-backup deviceConfiguration Data format Concepts guide 257 Synthetic backup How Data Protector synthetic backup works Synthetic backup benefitsSynthetic backup brings the following benefits Synthetic backup Synthetic backup and media space consumption Restore and synthetic backup Full and incremental backups Regular synthetic backup Page 264 Split mirror concepts Split mirror backup concept Instant recovery Replica set rotation Backup clients and clustersZDB to tape and ZDB to disk+tape ZDB to disk Concepts guide 269 Local mirror dual host Remote mirror Local mirror single host Concepts guide 271 Split mirror remote mirror LAN-free remote backup data HA Local/remote mirror combination Other configurations 274 Split mirror concepts Storage virtualization Snapshot concepts RAID Snapshot concepts Snapshot backup Snapshot backup types Snapshots with the preallocation of disk space Instant recoveryReplica set and replica set rotation Types of snapshots Snapclones Snapshots without the preallocation of disk space Basic configuration single disk array dual host Multiple disk arrays dual host Other supported configurations Multiple application hosts single backup host Disk arrays single host LVM mirroring HP StorageWorks Virtual Array only 286 Page 288 Microsoft Volume Shadow Copy service What is a writer? What is a shadow copy?What is a shadow copy provider? Data Protector and VSS Actors of the traditional backup model Benefits of using VSS Data Protector Volume Shadow Copy integrationVSS benefits VSS restore VSS backup VSS filesystem backup and restore Backup and restore This appendix Backup scenariosConsiderations 298 Environment Company XYZHardware and software environment of XYZ Current XYZ backup topology Problems with the current solution Requirements Backup strategy requirements Department Current Data Projected Data Devices 5 Years Proposed solutionSolution overview Proposed environment Proposed solution in detail Estimating the size of the IDB Proposed XYZ backup topology Input parameters Page Staggering approach ENG1BS Remote full backups to the HP DLT 4115 libraryDepartment Current Data/Backup Time Time Dbbs ENG2BSOthbs Admbs Restore options 312 Backup scenarios Company ABC Size of backup environment#UX Current ABC Cape Town backup topology Concepts guide 315 Problems with current solutionMaximum acceptable downtime for recovery Type of data Maximum downtime Location How long data should be keptType of data Max data storage time Amount of data to be backed up Amount of data to be backed up in five years ABC enterprise environment #UNIX Why configure into seven cells?Why use the CMMDB? ABC cell configuration Why choose the Windows system? ABC Cape Town enterprise backup environment 322 Why use the HP StorageWorks DLT 4228w Library? Why use the HP StorageWorks DAT24 Autoloader? Why use the HP StorageWorks DLT 4115w Library?How long does a full backup last? Media pool name Location Description ABC’s Media Pool UsageConcepts guide 325 Staggering Approach for ABC Cape Town Why use differential incr1 backups? USERSD...G ABC’s backup specification configurationName Cell Description Backup day Time SERVERSA...G Backup options Page 330 What is a backup generation? Backup generationsFurther information Examples of automated media copying Backup generations Incr1 backup Example 1 automated media copying of filesystem backupsConfiguring backups Configuring automated media copying Concepts guide 335 Full backup 336 Full backup and automated media copying Example 2 automated media copying of Oracle database backups Full database backup and automated media copying Localization Internationalization Background File name handling Unix incompatibility example File name handling during backupFile name handling during restore Browsing file namesPage 344 Acsls GlossaryAML Lotus Domino Server specific term Lotus Domino Server See also online redo logSee library See also Virtual Library System VLS and virtual tape See restore chainBackint Backup See also backup specification, incremental backup, and full By Group according to the group to which backup Backup typesBackup view Backups/templates. Default view SAP R/3 specific term An SAP R/3 backup tool that allows Or development. When used for backup purposes, the originalOr BCV devices, are dedicated SLDs that are pre-configured Manual and disaster and recovery You can specify files, tablespaces, complete backups, log Restore files of the following typeSaved with Brbackup Non-database files saved with Brbackup See also MoM CAPCDB See also Mmdb Microsoft Exchange Server and Lotus Domino Server specific See also backup to IAP Informix Server specific term a Windows CMD script that is See also Exchange Replication Service and local continuousMicrosoft Exchange Server specific term Cluster continuous Replication Oracle and SAP R/3 specific term An Oracle data file that HP StorageWorks EVA specific term The user interface thatCV EVA VLS Oracle and SAP R/3 specific term a physical file created by CSMHP StorageWorks EVA specific term a logical grouping Dcbf See also backup typesSee also copy set Informix Server specific term An Informix Server physical Microsoft SQL Server specific term a database backup that See also incremental backupSee also XCopy engine Veritas Volume Manager specific term The basic unit of data DMZ See also virtual full backupDR OS See Symmetrix Agent Syma See client backup with disk discoveryEMC Symmetrix Specific term See also CA+BC EVA Microsoft Exchange Server specific term The MicrosoftSee also library See also importing media Allows any server to perform replication activity Backup mediaVolume and each of these copies can have additional two Bi-directional transmission of large data files and can be Backup Full ZDB Flash recoveryRun out of media. The media pools must be configured to use Full backup HSM GUI SMI-S EVA LdevReplica EVA provider IDB Microsoft Exchange Server specific term a backupIcda EMC Symmetrix specific term EMCs Symmetrix Integrated Devices are updated with only the data that was written to Incremental restoreBCV control operations, an incremental restore reassigns a Pair. However, the standard devices are updated with See formatting See also replica, zero downtime backup ZDB, ZDB to diskZDB to disk+tape LBO See also Information Store and Site Replication ServiceIsql KMS Microsoft Exchange Server specific term Local continuous LISTENER.ORA Service See Wake Onlan Oracle and SAP R/3 specific term The format of the loginMicrosoft SQL Server specific term The name a user uses to LVM See MoM Microsoft Exchange Server specific term a partMCU CA HP StorageWorks Disk Array XP specific term, and HP Or off-site storage During a restore session, a Media Agent locates data onRobotics control of a library Media allocation Symmetrix and HP StorageWorks Disk Array XP specific Term See also overwriteStorageWorks Disk Array XP specific Term HP StorageWorks Disk Array XP specific term Mirror Unit MmdbSee also CMMDB, CDB MSM See backup object Informix Server specific term An environment variable that See also zero downtime backup ZDB and online backupOnconfig See archived redo log See also archived redo log See also zero downtime backup ZDB, and offline backupOraclesid See also merging See also pre-exec HP StorageWorks Disk Array XP specific term The RAID See also post-execHP StorageWorks Disk Array XP specific term Standard HP Microsoft Exchange Server specific term The part EMC Symmetrix specific term a type of Srdf device group RCURdbms RDF1/RDF2 HP StorageWorks Disk Array XP specific term The Remote Rman Rman Oracle HP StorageWorks Disk Array XP VSS provider specific termRSM HP StorageWorks Disk Array XP specific term secondary See backup session,media management session, and restoreSession Microsoft VSS specific term a collection of shadow copies Microsoft VSS specific term a volume that represents aSibf Smbf SMBHP StorageWorks VA and HP StorageWorks EVA Specific term HP StorageWorks Disk Array XP Specific term See also snapshot Srdf See also ZDB to tape, ZDB to disk+tape, and replicaEMC Symmetrix specific term The EMC Symmetrix Remote EMC Symmetrix specific term The Data Protector software See failoverSyma Synthetic full Any number of incremental backupsCheckpoints and the quorum resource recovery log, which Putting stress on the production servers or the network. a See also source R1 device Disaster recovery specific term a system after a computerSee ZDB to disk ZDB specific term Data Protector specific term Keep track of IDB changes. Oracle and SAP R/3 specific term a network configurationSee also Microsoft Volume Shadow Copy Service VSS TNSNAMES.ORA See lights-out operation See also source volume and target volume See also Command View CV EVAMicrosoft SQL Server specific term This is a SQL Server See Microsoft Volume Shadow Copy Service Adic and STK specific term a VOLume SERial number is aVSS Configuration Replica, secondary volume S-VOL, and replica set rotation ZDB Informix Server specific term ON-Bar and Data Protector Recovery Arrays, split mirror restore can also be usedSee also zero downtime backup ZDB, ZDB to disk, instant Recovery, ZDB to disk+tape, and replica 402Glossary Index 404 Page Hardware, 68, 70 software Concepts Snapshot backup, 276 split mirror backup CRS 408 324 Selecting for restoreDirect Backup Supported configurations 410 Failover, 81, 82 FC-AL 412 See also libraries See IDB Internationalization, 340 IT managementSize 414 Good Media pools, 135, 309, 325 default, 136 propertiesLoose, 147 strict Media condition, 150 calculating, 150 fair 416 RDS SAN Restores, 125Data, 194 location Sharing libraries, 47, 162, 163, 164 Sibf data Backup, 43 RAID Snmp HP, 33 technical support 422