plSelectFiles

Every pipeline requires a list of files for processing. The plSelectFiles accepts command line arguments and produces a list containing:

Source Path File

This program can also be used without a pipeline simply to query the files within the database. Example usage:

>plSelectFiles -mjd "54000,54100" -source "J0437-4715,J1909-3744" -bkend "PDFB2, PDFB3"

Arguments:

-mjd "mjd1,mjd2" - only list files with MJDs between MJD1 and MJD2
-source "name1,name2,..." - select files with given source names (note MySQL wildcard characters may be used)
-output "param1,param2, ..." - define the output format (see below)
-order "param" - order the output (see below)
-distinct - only display unique output (i.e. no repeated lines)

The following commands all take the following form:

-param "p1,p2,..." - select files with given parameters: p1 or p2 or p3 etc. (wildcard characters may be used)
The parameters are anything in the "Files" table in the table. These currently include:

-file_id
-file_type_id
-filename
-path
-institution
-backend
-beconfig
-bw
-freq
-nchan
-nbin
-nsub
-npol
-site
-projid
-hdrver
-tsub
-date
-source_id
It is also possible to query the Projects table:
plSelectFiles -Projects.Name "PPTA" -output "Source" -distinct -Source "\!%_R" -order Source
displays all the PPTA pulsars (which are not calibration sources) and ordered by pulsar name.

It is also possible to provide an entire mySQL query:

>plSelectfiles -mySQL "query"

Examples:

Selecting files with 1024 channels of PSRs J0437-4715 or J1022+1001:

>plSelectFiles -source "J0437-4715,J1022+1001" -nchan "1024"

Selecting PDFB2 and PDFB1 data of J0437-4715 from MJD range 54400 and 54540:

>plSelectFiles -source "J0437-4715" -backend "PDFB2,PDFB1" -mjd "54400,54540"

Changing the output format

By default plSelectfiles returns a table containing the source name, path and filename. It is possible to obtain a different output using the -output option.

>plSelectFiles -source "J0437-4715" -backend "PDFB2" -output "Filename,BW,Freq,site,mjd"

output a table containing the filename, bandwidth, observing frequency, observing site and MJD. Any parameter within the "Files" table in the database may be used. The output can be ordered using -order:

>plSelectFiles -source "J0437-4715,J1022+1001" -backend "PDFB2" -output "Filename,BW,Freq,site,mjd" -order "source"

will order by source name.