Priority calculation

The resource allocation queue holds resource requests that are sorted and processed by their job priority. The priorities of all jobs in the queue will be recalculated each time a job changes its status or resources are released or newly added to the FSE implementation. These job priorities are dynamically increasing according to their age and phase of the job. A new job enters the queue with its initial priority; in case this priority is not high enough to be processed immediately, it is recalculated and increased over time thus enabling each job to be processed in a reasonable time.

Depending on a job type, the priority formula differs for administrative and backup jobs that have a system-wide priority, and jobs that are associated with a particular FSE partition (migration, recall, recovery, and maintenance). The priority calculation is based on the parameters set in the related partition or system policy, and on several additional factors:

•Phase

The phase of a job increases if it requires additional resources. This is relevant for migration jobs when the following is true:

•The phase is increased by 1 if a copy was made and other copies are still waiting for resources.

•The medium volume is full, therefore a new split for the file is needed.

It is also relevant for recall jobs when the following is true:

•The phase is increased by 1 when a split of a file is recalled which spans over multiple media volumes.

Other jobs do not have a phase.

•TimeStep

The value by which the priority is increased for each elapsed second of ElapsedTime.

•JobTypePriority

Depending on the job type, the value of one of the following variables is used for this parameter:

•SystemAdminPriority, SystemBackupPriority (defined in the FSE system configuration file)

•MigrationPriority, RecallPriority, RecoveryPriority, MaintPriority (defined in the FSE partition configuration file)

•ElapsedTime

The time in seconds since the job was started.

•PhaseFactor

The value by which the priority of a job is increased after each phase.

Administrative and backup job priority calculation

For administrative and backup jobs, the priority is calculated by the following formula:

Priority = JobTypePriority

+(ElapsedTime * TimeStep * JobTypePriority/10000)

+(Phase * PhaseFactor)

Migration, recall, recovery, and maintenance job priority calculation

For migration, recall, recovery, and maintenance jobs, the priority is calculated by the following formula:

Priority = PartitionPriority * JobTypePriority

+(ElapsedTime * TimeStep * JobTypePriority/100)

+(Phase * PhaseFactor)

NOTE: You can manually increase or decrease a job priority using the fsejob --prioritycommand.

146 Migration, release, recall, and deletion

Page 145 Page 147
Page 146
Image 146
HP File System Extender (FSE) manual Priority calculation, Administrative and backup job priority calculation
Page 145 Page 147

File System Extender (FSE) specifications

HP File System Extender (FSE) is a sophisticated solution designed to optimize data storage management for enterprises that deal with large volumes of unstructured data. This technology addresses the challenges of data growth and the need for effective data retention strategies, enabling organizations to store and manage their information more efficiently.

One of the main features of HP FSE is its ability to intelligently migrate data between primary and secondary storage. By utilizing policies that determine when to move infrequently accessed files to lower-cost storage environments, FSE helps reduce the strain on primary storage systems and saves on costs associated with high-performance storage solutions. This tiered approach to data management ensures that organizations can access the data they need quickly while still maintaining an efficient overall storage architecture.

Another notable characteristic of HP FSE is its seamless integration with existing storage infrastructures. The solution works with a variety of storage systems, allowing organizations to utilize their current investments without the need for significant changes to their infrastructure. This interoperability is powered by advanced technologies that facilitate data migration and retrieval, ensuring a smooth transition for organizations looking to optimize their storage strategies.

Additionally, HP FSE is equipped with robust reporting and analytics capabilities. This functionality provides organizations with insights into their storage usage, helping them understand data patterns and optimize their storage environments accordingly. By having visibility into which files are accessed most frequently and which are rarely used, organizations can make informed decisions on data retention policies and storage management.

Security is paramount in data management, and HP FSE addresses this concern by implementing advanced data protection features. This includes data encryption, secure access controls, and compliance with industry regulations, ensuring that sensitive information is safeguarded throughout its lifecycle.

Overall, HP File System Extender is a comprehensive data storage solution that combines intelligent data management, seamless integration, insightful analytics, and robust security features. By leveraging these capabilities, organizations can efficiently manage their unstructured data, lower costs, and enhance operational efficiency, making it an invaluable tool in today’s data-driven landscape.
Top Page Image Contents