Документ взят из кэша поисковой машины. Адрес
оригинального документа
: http://www.eso.org/~qc/dfos/ngasClient.html
Дата изменения: Mon Sep 21 12:55:38 2015 Дата индексирования: Sun Apr 10 00:39:59 2016 Кодировка: Поисковые слова: apollo 13 |
Common DFOS tools:
|
dfos = Data Flow Operations System, the common tool set for DFO |
![]() |
new: | Note: | ||||||||
v1.7.3: v1.8:
|
The tool is the central download engine for DFOS.
|
This is the general dfos tool for downloading raw or product files from NGAS, including IDPs. You can download fits files or their headers only. Contrary to dataLoader, it downloads file by file.
It uses the DFS tools ngamsCClient for raw data (and tar ball) download, dpQuery for product data download, and hotfly for header downloads and updates. To uncompress tile-compressed files (like VCAM files), you also need the DFS tool fitsunpack. In either case, you need to specify the file name (ARCFILE for raw files, product file name as given by renameProducts).
Header download. The tool is able to download FTU'ed headers, and updates headers of downloaded fits files (only if necessary: modification_timestamp is later than ingestion_timestamp). The update of the FITS header is made through hotfly (headers on the fly). It uses a software called FTU (fits translation utility). Find more details here. It is also enabled to directly download headers of product files, without downloading the fits file in the first place.
There is another option to download headers, -W: these are downloaded from the cgi on the archive web page (http://archive.eso.org/hdr?DpId=) using wget. This is a slow process and kept for backwards compatibility only. See our hotfly page for a more complete compilation of header download processes and tools.
Note:
- the hotfly update is executed on the full header (primary plus extensions)
- use option -c for downloading any product fits file (CALIB or historical SCIENCE or historical ANCILLARY; no IDPs!)
- use option -P for downloading any product header file
- the raw files (option -f) and product files
(option -c) are downloaded only if the specified file does not exist in $DFO_RAW_DIR / $DFO_CAL_DIR (unless forced by option -F).
Type ngasClient -h for on-line help, ngasClient -v for the version number,
ngasClient -f VISIR.2026-02-12T13:51:49.000.fits
to download a raw file and update its header,
ngasClient -c VI_MBIA_260304C_1x1.fits
to download a master calibration file,
ngasClient -i GI_SIDP_1179308_2015-07-30T03:08:45.415_F9_Med1_L614.2_o3.fits
to download an IDP (science product file; any format: fits/gif/txt),
ngasClient -H GIRAF.2026-06-06T03:34:34.345.hdr (or .fits)
to download the header of a raw file, and
ngasClient -P GI_SFLX_2019-12-31T04:31:12.561.fits
to download the header of a product file. Note: although you want to download a header, you must specify the fits file name since this is used in a query, and it is not possible to safely predict the name of a product fits file from its hdr name (it could have extension .fits or .tfits!).
You can also use ngasClient -W FEROS.2026-06-06T03:34:34.345.hdr to download a header file but this is slow and kept mainly for backwards compatibility.
The file is downloaded into the current directory. If the file is delivered with extension .Z (compressed), it is uncompressed. Tile-compressed files (with extension .fz) are also uncompressed.
If called with the option -F (Force), the file is always downloaded, no matter if it pre-exists or not.
The option -U (update) is used to refresh the tool config file ngasClient.cfg with the names of the current NGAMS_SERVERs and ports. This should be done once a day with a cronjob command. If the config file ngasClient.cfg is not found by the tool, it is forced to call option -U.
For IDP download, you can specify any file name archived in phase3, no matter if fits, text or graphical file, and no matter if a genuine IDP or an ancillary file. In order to get a complete dataset (IDP plus all ancillary files), you need to specify all names. (If unknown, download the IDP first, then read the ancillary file names from the ASSONn keys and download them as well.)
Use dfosInstall.
ngasClient.cfg is created on the fly, either by the option -U or automatically if the file does not exist. It should not be edited. It contains one configuration key:
NGAMS_SERVERS | jewel63:7777,<etc.> |
This information is read with option -U from the database table.
Operational hints
All headers are downloaded from the SAFIQ database (except for the option -W). That database is updated every 15 minutes.