make printable	new:	see also:
	v1.1: - new option -t <hr> - terminate list_hdr_<date>.txt - config file obsolete	dfosCron (supports background header downloads with HdrDownloader)

HdrDownloader

Description

This tool is designed to download header files from the keyword repository (SAFIQ). It is directly called by dfosCron, and indirectly (via dfosCron) by calChecker. Downloaded headers come with the primary extension only (because the DFOS system uses them for association purpose and for the data lists, both do not require information from the extensions).

Data are up-to-date, including modifications applied since acquisition. HdrDownloader respects $DFO_OFFSET and applies shifting of the last template, if otherwise broken.

On the command line, it is called with the parameter -d[ate] which is the operational date in DFO format (e.g. 2015-07-30). For operational use within dfosCron, it is called with the option -t <hr> with hr being the time range in hours (hr=24), counted backwards from NOW. In that option, the tool works incrementally, it adds only new headers. This mode is the fastest mode.

Output

The tool downloads the header files for the specified date into $DFO_HDR_DIR/<date>, as text files with extension .hdr.

In mode -t, headers from the last template are only downloaded if the last one is older than one hour, to avoid a broken template. All downloaded headers in this mode are distributed correctly among the date directories.

In mode -d, the last template is always downloaded and distributed such that it is not broken: if all of its header files formally belong to the specified date, they go there; if at least one header formally belongs to the next date, all files go to the next date.

How to use

Type HdrDownloader -h for on-line help.

The command-line call is:

HdrDownloader -d 2013-07-30

With this call the tool is wrapped within dataLoader (for any date).

For operational use, the call is

HdrDownloader -t 24

With this call, the tool is wrapped within dfosCron.

Configuration file

None needed. The old one is obsolete.

Setup

You need to enter the following lines into your .dbrc file:

HDR_DOWNLOAD_METADATA 

acdb.hq.eso.org:2025 

<user>

<passwd>

HDR_DOWNLOAD_HEADERS   

safiqr1.hq.eso.org:16401

<user>

<passwd>

QC_PRODUCT_HANDLER_KWD_REP

safiqr1.hq.eso.org:16401

<user>

<passwd>

with <user> and <passwd> sent to you by email.

Installation

The tool comes with the standard DFS installation.

Logging and status

The tool logs onto the command line.

If called within dfosCron, HdrDownloader writes the status flag 'hdr_Exist' (or 'hdr_Notexist') into $DFO_MON_DIR/DFO_STATUS.

Operational aspects

• Headers downloaded by HdrDownloader are corrected by HotFly.

• The tool uses the following DOFS environment variables:
  $DFO_HDR_DIR
  $DFO_MON_DIR
  $DFO_FILE_NAME
  $DFO_OFFSET