Library Technical Services

Bulk Loading: Scheduling

Scope: This procedure provides instructions for running automated import, export, cleanup, reporting and various related jobs using shell scripts and other tools created by the Library Systems Office. The list of jobs includes the frequency of the work, the list of people responsible for performing this work, as well as the function of each job. In addition, this procedure includes guidelines for scheduling batch routines.

Contact: Jena Bakula

Unit: Database Management Services

Date last updated: 04/02/07

Date of next review: July 2008

Scheduling

Run individual jobs according to the prescribed schedules listed on the List of Jobs. However, be aware that because large jobs -- defined as BIB loads of 3000 records or more -- will place significantly more stress on the Voyager keyword index and may affect system performance, the Voyager keyword index will be turned off for all loads larger than 3000 records. Please observe the following guidelines:

• The maximum number of records in a file loaded with the LSTOOLS shouldn't exceed 15000 records. Split the files containing more than 15000 records appropriately.
• Public announcements about large loads should be postponed to a day after the next keyword index regeneration has occurred.