Quality Control Operations: Backup of DFO and QC machines
	home dfos WISQ administration documentation procedures concepts external: QC

This is the internal QC home page. An external page is also available.

Which machines

• DFO Blade nodes: i.e. dfo21 to dfo33
• QC cluster: i.e. qc01 to qc20

Home directories

Home directories for the operational instrument accounts (as well as other important home directories such as quality, flowmgr etc) are served to the DFO Blade nodes and the QC cluster nodes via NFS from hrs01. The relevant shared directories are /ots/dfo/home and /ots/qc/home.

Since 2008-10-07, the entire /ots directory structure (i.e. including these two vital home directory systems) is backed up to the Backup Server bu2 using the ONANU.backup script. A SNAPSHOT of the /ots directory structure is made once per night at 04:00am, followed by a WEEDOUT. The configuration is set such that the weedout keeps the most recent 30days of backups, then one backup per month for the past year and then one backup per year for the last ten years...

The following files are excluded fron the backup:

• EXCLUDE: ALL *.fits.* files
• EXCLUDE: ALL *~, .*~, #*#, .#*, *.o files

DFO Blade Data directories

Currently the entire /diska/data<NN> directory structure is backed up once per night, but this can NOT be maintained, it uses too much disk space, and this will only get worse when we all have 1Tb...

Thus, we (RH+JDP) propose the following:

• SNAPSHOT of /diska once per day
• Maintain a depth of TBD:
  1. 1 backup per day for one week???
  2. 1 backup per week for one month???
  3. 1 backup per month for one year???
• EXCLUDE: ALL *.fits.* files
• EXCLUDE: ALL *~, .*~, #*#, .#*, *.o files
• EXCLUDE: DFS_PRODUCT directory
• EXCLUDE: DFS_LOG directory

This would be achieved via the ONANU.backup script and we would need a DFOS script to generate each night a config file for the backup script specifying either the directories to be backed up, or conversely the directories NOT to be backed up. The first option would be better I (JDP) think, in which case we would backup:

• DFO_CAL_DIR
• DFO_HDR_DIR
• DFO_LST_DIR
• DFO_LOG_DIR
• DFO_PLT_DIR
• DFO_SCI_DIR
• DFO_SRV_DIR

QC Cluster Data directories

TBD...

Directories NOT backed up

The following disks/partitions/dirctories are NOT backed up:

• /diskb: i.e. if you have a 1Tb disk already the 200Gb disk, otherwise this does not apply to you.

Appendices

ONANU.backup script

The ONANU.backup script in use is derived from the backup script of John Pritchard who developed a little (adding config file and command line option functionality) the script of Ole Neilsen, ANU, see here.

• SYNC: TBD
• SNAPSHOT: TBD
• WEEDOUT: TBD