Документ взят из кэша поисковой машины. Адрес
оригинального документа
: http://www.naic.edu/~phil/psrfdoc.html
Дата изменения: Wed Feb 3 00:47:18 2016 Дата индексирования: Sat Apr 9 23:35:21 2016 Кодировка: Поисковые слова: п п п п п п п р п р п р п р п |
NAME: apsrfexample - Using ao psrfit idl routines. The pdev/mock spectrometers can generate psrfits fits files. The psrfxxxx idl routines let you input and look at the data in idl. USING the routines. 0. If not at AO, install phil's idl routines at your site http://www.naic.edu/~phil/download/download.html --> idlroutines to analyz ao data. 1. start idl - at ao idl or idl70 @phil .. to include path to phil's routine in the search path @psrfinit .. include the psrf and mas routines. 2. Open a single file and look at it: filename='dir/x107.20090607.b0531+21.b0s1g0.03500.fits' istat=psrfopen(filename,desc,fnmI=fnmi) ; look at contents of descriptor structure: help, desc,/st ** Structure, 14 tags, length=3129776, data length=3129721, refs=1: LUN LONG 101 FILENAME STRING '/share/pdata1/pdev/x107.20090607.b0531+21.b0s'... NEEDSWAP BYTE 1 BYTESROW LONG 1052268 TOTROWS LONG 60 CURROW LONG 32 BYTEOFFREC1 LONG 28800 BYTEOFFNAXIS2 LONG 20400 HPRI STRUCT -> Array[1] .. primary fits header HAOGEN STRUCT -> Array[1] .. ao generic header HPDEV STRUCT -> Array[1] .. pdev header HSUBINT STRUCT -> Array[1] .. subint header ROWSTR STRUCT -> Array[1] ROWSTRF STRUCT -> Array[1] 3. input 1 row of file: istat=psrfget(desc,b) ; look at contents of b help,b,/st IDL> help,b,/st TSUBINT DOUBLE 1.0000000 OFFS_SUB DOUBLE 0.50000000 LST_SUB DOUBLE 18175.386 RA_SUB DOUBLE 83.632679 DEC_SUB DOUBLE 22.014512 GLON_SUB DOUBLE 184.55724 GLAT_SUB DOUBLE -5.7846698 FD_ANG FLOAT 0.00000 POS_ANG FLOAT 0.00000 PAR_ANG FLOAT -65.5061 TEL_AZ FLOAT 242.726 TEL_ZEN FLOAT 8.38640 DAT_FREQ FLOAT Array[512] DAT_WTS FLOAT Array[512] DAT_OFFS FLOAT Array[512] DAT_SCL FLOAT Array[512] DATA INT Array[512, 1000] STAT STRUCT -> PDEV_HDRDUMP Array[1000] ; Notes: ; - each row has multiple spectra (in this case 1000). ; - the freq is stored in data_freq (these are the centers of each bin) ; - stat structure has info on each spectra. In particular the number of ; integrations that went into the accummulated spectra (stat.fftaccum) ; ; 4. plot 1 spectra plot,b.dat_freq,b.data[*,0] 5. monitor set of files with dynamic spectra - Use psrfmonimg() .. the routine can automatically cycle through a set of files for one project in 1 day.. - specifying where the files are at.. .. At AO the data files are stored by default in /share/pdataN/pdev where N is 1..7 for beams 0..6 The routine can find these files by default, all you specify is the date and projid. .. If files are somewhere else (or another institution) then: - files for different beams need the following directory structure: /xx/yyyN/ where N is beamnumber +1 - then use the dirI[2] keyword dirI[0] is the prefix, dirI[1] is the suffix of the directory path with N 1..7 stuck in between: suppose data in /data/ao/psrf/beam[1..7] dirI[0]='/data/ao/psrf/beam' dirI[1]='/' This will generate searches in /data/ao/psrf/beam[1-7]/ for the datafiles - calling the routine: date=20090607 projid='x107' ; If at ao psrfmonimg,projid=projid,date=date ; If not at ao.. dirI[0]='/data/ao/psrf/beam' dirI[1]='/' psrfmonimg,projid=projid,date=date,dirI=dirI - In the routine. - hitting a key brings up a menu to choose from - It starts with the last file of a day. Using the l keyword in the menu list the files for this beam Using the fnum keyword moves to another file for the day Using the date keyword changes date Using the band keyword switches between the 2 bands Using the beam keword swithces between the 2 beams. - Misc notes. - by default the routine maps the number of spectra in a row to the image using congrid which resamples the data set (interpolation, not averaging). - You can stretch the image (by grabbing an edge) to get more pixels in the image - Using the zx=-n,zy=-m keyword on the call ti psrfmonimg() will shrink the image by factors m,n using averaging so you get an increased signal to noise. - check out some of the other keyword calls and menu items in psrfmonimg() 6. Closing a file psrfclose,desc,/all .. using the /all keyword closes all open files
(See /pkg/rsi/local/libao/phil/psrfits/apsrfexample.pro)
NAME: psrfavgfile - avg spectra in a file SYNTAX: n=psrfavgfile(fname,bavg,brms=brms,desc=desc,fnmI=fnmI,$ maxrows=maxrows,minrows=minrows) ARGS: fname: string name of file KEYWORDS: maxrows: long max number of rows to input minrows: long if file has less then minrows, then donot process it (use to skip cals) fnmI: {} structure from masfilelist for file to use In this case ignore fname RETURNS: bavg: struct standard struct from psrfget() with data replaced by the averaged data. the other elements come from the first record of the file brms: struct if present then return rms for the file. this is computed on the avg of each row. The rms is normalized by the number of rows (it is not divided by the avgspectra). desc : struct from psrfopen(). This contains the various headers. the will have been aleady closed. n: >=0 number of spectra avged < 0 error DESCRIPTION: average the spectra in a file. Return the averaged spectra in b. It will be the standard structure returned from psrfget on the first reccord except that the .data element will contain the averaged data. Note: currenly blanking is ignored.. - the rms on u,v is a factor of 2 low.. this is from the mock scaling of the u,v differently then pola,B
(See /pkg/rsi/local/libao/phil/psrfits/psrfavgfile.pro)
NAME: psrfclose - close a psrfits file for i/o SYNTAX: psrfclose,desc,all=all ARGS: desc: {psrfdescr} - descriptor to close (returned by psrfopen) KEYWORDS: all: if set then close all open descriptors. DESCRIPTION: Files opened with psrfopen() need to be closed with psrfclose() so that the resources are freed up. EXAMPLE: filename='/share/pdata/pdev/phil/071106//testfits.20071107.b0s0.00000.fits' istat=psrfopen(filename,desc) .. process the data in the file psrfclose,desc .. this closes the file when done with the processing.
(See /pkg/rsi/local/libao/phil/psrfits/psrfclose.pro)
NAME: psrffilesum - get summary info for psrfits files SYNTAX: nsum=psrffilesum(flist,sumI,desc=desc,fnmI=fnmI,list=list) ARGS: flist[n]:strarr filenames for summary. Includes directory. KEYWORDS: desc :{} descriptor returned from psrfopen. If supplied then ignore flist and use desc as the file to look at. fnmI[n]:{} structure returned by masfilelist. If this keyword is present then ignore flist and use fnmI for the files to use. list : if set then output oneline summary to stdout of file RETURNS: nsum: long number of summaries we return. Don't count files that had trouble being read sumI[n]: {} summary info for mas files. DESCRIPTION: Return summary info for a list of files. You can specify the files with the argument flist or the keyword fnmI. The returned summary info contiains: help,sumI,/st OK INT 1 FILENAME STRING '/share/pdata1/pdev/a2675.20120311.J0651+28.b0s1g0.00000.fits' NEEDSWAP BYTE 1 BYTESROW LONG 4136556 TOTROWS LONG 85 CURROW LONG 0 BYTEOFFREC1 LONG 28800 BYTEOFFNAXIS2 LONG 20400 HPRI STRUCT psrfits primary header HAOGEN STRUCT ao generic header HPDEV STRUCT pdev header HSUBINT STRUCT psrfits subint header hrow struct header from first row excludes the array info (freq,wts,off,scl,data,stat) EXAMPLE: 1. get 1 file fname='/share/pdata1/pdev/a2675.20120311.B0611+22.b0s1g0.00000.fits' nsum=psrffilesum(fname,sumI) 2. Get all the a2675 files under /share/pdata1 (online files) for 11mar2012 list a 1 line summary of each file as they are read n=masfilelist(junk,fnmI,projid="a2675",yymmdd=20120311,/appbm,/psrfits) nsum=psrffilesum(junk,sumI,fnmI=fnmI,/list) NOTE: nsum will always equal the number of elements in flist or fnmI. You need to check sumI.ok eq 1 to see if the data is ok. This lets you keep track of bad files (say with 0 rows).
(See /pkg/rsi/local/libao/phil/psrfits/psrffilesum.pro)
NAME: psrfget - input next psrfits row from disc SYNTAX: istat=psrfget(des,b,row=row,hdronly=hdronly,blankcor=blankcor,avg=avg,$ tp=tp) ARGS: desc:{descpsrf} from psrfopen(); RETURNS: b: structure holding the hdr and data input tp[ndump,npol]: float if tp provided (and averge set) then also return the total power for each time sample istat: 1 ok : 0 hiteof :-1 i/o error..bad hdr, etc.. KEYWORDS: row : if set then position to row before reading (count from 1) if row=0 then ignore row keyword hdronly : if set then just return the row header. no status or data. blankcor : if set then correct for any blanking.. the forces the returned dataset to be floats avg : if set then average the spectra in 1 row before returning. This forces the returned datatype to be float. this will automatically do the blankcor (since it normalizes the sum to the total number of ffts accumulated * the integration period std value. DESCRIPTION: Read the next row from a psrf fits datafile pointed to by desc. If keyword row is present, position to row before reading.
(See /pkg/rsi/local/libao/phil/psrfits/psrfget.pro)
NAME: psrfimgdisp - display a set of psrfits records as an image SYNTAX: img=psrfimgdisp(desc,b,nsigclip=nsigclip,clip=clip,pollist=pollist,col=col,$ toavg=toavg,median=median,bpc=bpc,ravg=ravg,nobpc=nobpc,$ win=win,wxlen=wxlen,wylen=wylen,wxpos=wxpos,wypos=wypos,$ samewin=samewin,zx=zx,zy=zy,$ rddesc=rddesc,maxrecs=maxrecs,mytitle=mytitle,$ hlind=hlind,hlval=hlval,hldash=hldash,hlvlines=hlvlines,$ useind=useind,ln=ln,chn=chn,cs=cs) ARGS: desc : {} from psrfopen open b[nrecs]: {corget} correlator data to make image of RETURNS: img[nchns,nrecs]: float image of last sbc displayed (before clipping). KEYWORDS: nsigClip:float if suppled then clip data to [-sig,sig]*nsigClip This is done after any averaging for -zx,-zy. If this is supplied, then clip= is ignored. clip[]: float value to clip the normalized data to. Default is .02 (of Tsys). If clip has 1 value then normalize to (img > (-clip)) < clip. If two value are provided, then they will the [min,max]. pollist: long A single number whose decimal digits specify the pols to display. eg 1,12,1234 .. pols,3,4 are stokes u,v The default is pola,polb. win: int window number to plot in. default is 1. wxlen: int xlen of window. default 700 wylen: int ylen of window. default 870 wxpos: int xpos of lower left edge of window.default 445 wypos: int ypos of lower left edge of window.default:35 samewin: if set then use the current dimension for the image win. If you are calling psrfimgdisp in a loop then setting this (after the first call) lets the user dynamically adjust the window size,position. zx: int ..-3,-2,2,3,4 zoom factor x dimension. Negative numbers shrink the image positive numbers expand. Negative number must divide evenly into the number of channels. zy: int ..-3,-2,2,3,4 zoom factor y dimension (same format as zx) rddesc: if true then read data using descrtipor. returns data read in in b. col[2]: int .. x columns to use to flatten the image in the time direction. count 0..numberoflags-1. If multiple sbc plotted then the same cols are used for all sbc. The default is no flattening in the time direction. chn: if set then plot vs channel number rather than freq bpc:{masget} if supplied then this data will be used to do the bandpass correction. The default is to average over all of the nrecs. nobpc: if set then no bandpass correction is done. median: if set and bpc not provided, then bandpass correct using the median of the nrecs rather than the average. ravg: long bandpass correct with a running average of ravg spectra for polB). You can change this with the numspc keyword numspc: int number of spectra to display from b (or to read from the file. The default if b is provided is the entire array. If reading from the file then we will use about 600 spc. This will be the count prior to any averaging (see toavg) toavg: long average this many spectra together before making image. (zy will to the averaged array). mytitle:string user supplied tittle instead of scan,srcname,az,za az,za at top of the plot. hlind[]: ind index into img array (2nd dimension) to draw horizontal lines. hlval : float value to use for horizontal lines (in img units) default is clip value. hldash : int The dash lengths to used for the horizontal lines. 2*ldash must divide into x dimension.default is 4 hlvlines:int Number of engths to used for the horizontal lines. default=1 useind[2]:int if provided then use these indices from data array 0 .. lengthsbc -1 default=1 ln :int linenumber for title..0..33 def:3 extra_=e this allows you to input keywords that will be passed to the plotting routine. eg title=title.. DESCRIPTION: psrfimgdisp will display a set of psrf spectra as an image. By default it will make a separate image for each polA and polB. The polList keyword lets you specify polA or polB (and someday maybe stokes U,V. You can input the data outside of this routine (eg with psrfget) by setting the keyword rddesc=1 (by default the user passes the data in in b. By default, the image is bandpass normalized by the average of all the records (sbc/avg(pol) - 1). If the median keyword is used then avg(sbc) is replaced by median(pol). The bpc keyword allows you to input a separate mas record to use as the normalization. The col keyword lets you also flatten the image in the time dimension by specifying the first/last columns to average and then divide into all of the other columns (the columns are counted from 0). By default this is not done. After bandpass correction and flattening in the time dimension, the image is clipped (by default) to +/- .02 (tsys) and then scaled from 0 to 256 for the image display. The clip keyword lets you change the clipping value. The zx,zy keywords let you scale the image in the x and y dimensions by integral amounts. Negative numbers will shrink it by that amount (Note: the negative numbers must divide evenly into the number of channels in each sbc). -1,0,1 do no scaling. This scaling is only applied for the single pol displays. The multiple pol displays are always scaled to fit inside the window (700 by 870 pixels). The desc and numspc keywords can be used to input the data directly from a file. In this case the desc comes from the psrfopen() routine and numspc is the number of spectra to put in the image. After displaying the image, use xloadct to manipulate the color table. The routine returns the last image displayed (before clipping). EXAMPLES: input data and make an image istat=masgetm(desc,30,b,/han0 .. input 30 rows with hanning smoothing .. assume there are 10 spec/row 1. display the image of pola and polB img=psrfimgdisp(b) 2. display only polB, scale y by 2, and x by -2 img=psrfimgdisp(b,pol=0,zx=-2,zy=2) 3. display pola,polB, clip to .015 Tsys , median filter the bandpass correction: img=psrfimgdisp(b,/median,clip=[.015]) This routine calls imgflat, and imgdisp for the image scaling and display. NOTE: SEE ALSO: imgdisp,imgflat
(See /pkg/rsi/local/libao/phil/psrfits/psrfimgdisp.pro)
NAME: psrfmonimg - monitor psrfits files via dynamic spectra. SYNTAX: psrfmonimg,bsg=bsg,num=num,projid=projid,date=date,dirI=dirI,$ nspc=nspc,pollist=pollist,desc=desc,zx=zx,zy=zy,$ blankcor=blankcor,pixwin=pixwin ARGS: none KEYWORDS: bsg: string beam,band,group to monitor. Format is bBsSgG where: B =0..6 is the beam S =0..1 is the band (0=1450 band, 1=1300 band) G =0..1 is the group. default:'b0s0g0' num: int the file number to start with. (The default is the most recent) projid: string project id (first part of filename) to monitor. The default is the most recent one written. date : long The date (in the filename) to start monitoring. The default is the most current (and still matches the other criteria.) The format is yyyymmdd. dirI : strarr(2): directory info. If the files are in a non standard place then pass in location in dirI dirI[0]=prefix for dir: /share/pdata Num 1..n goes here dirI[1]=postfix for dir: /pdev IMAGE: nspc: int the number of spectra for each image. The default is 500 (or the max number in the file). It will try and round the number to a multiple of spectra per row. pollist: int pols for image. 1,2,12, -1 --> all pols available if stokes, it does not plot u,v zx : int if single pol then zoom (=n) or contract (-n) x axis by this amount. zy : int if single pol then zoom (=n) or contract (-n) y axis by this amount. blankcor: if set then correct for adc blanking. pixwin : if set then use a pixwin to switch between images ( stops the flashing. RETURNS: desc : {} You can return from masmon with the current file still open (using the x command from the menu). The file descriptor will be returned here (this is actually a structure used by the masxx routines). It is then your responsibility to close the file via masclose,desc or masclose,/all. ----------------------------------------------------------------------------- DESCRIPTION: Monitor online and offline psrfitst files by making a dynamic spectra of the data. The files to monitor can be selected by: 1. if no arguments are supplied, use the most recent files from beam0,band0,group0. 2. Specify the projid,date using the startup keywords. 3. Use the menu inside masmon to select a different set of files to monitor. - Enter the menu once masmon is started by hitting any key. ----------------------------------------------------------------------------- EXAMPLES: psrfmonimg - start monitoring most recent file for b0s0g0 psrfmonimg,bsg=b0s1g0 .. start with beam0, band1 , group0 psrfmonimg,projid='a2130' .. use a2130 files psrfmonimg,pollist=1 .. images of only polA ----------------------------------------------------------------------------- USING THE INTERNAL MENU: Enter the internal memory by hitting any key. The menu is: Cmd CurVal function --> IMAGES: p 12 pols for images (1,2,12) h low high set horizontal range for images (freq low,hihg), blank --> all nspc 500 number of spectra per image. blank--> auto c .02 clip value for data delay secs secs to delay between images.. --> FILE POSITIONING: bsg b0s0g0 beam,band,grp to use (change all at once) bm 0 beam to plot band 0 band to display (0 = 1450, 1=1300) d 20081011 date to use. First number of data displayed num 00801 number.. file number to display r 1 position to row. maxRows: 99 l (all) list files this date (all --> all dates) --> MISC: hdr display last header read s 0 step mode. 1-on,0-off z stop in procedure (for debugging) q to quit x quit leaving the current file open. return description in desc keyword otherKeys continue plotting Enter the cmd and a possible value. The program will then continue. The menu options are: p 12 .. pols for image. By default both pols are used (but in stokes mode u,v are note used. .. The pols are numbered: 1-polA,2-polB. Any combination .. of the pols can be displayed (entered as a one number eg 12..) Example: p 12 .. use pols a and polB. h .. change the frequency range of the image. Units are Mhz. The default is the entire frequency range. Example: h 1400 1450 display frequencies 1400 thru 1450 (if they are in the band) delay .. secs to delay between plots. Use if the plotting is going too fast. Example: delay .1 Delay .1 seconds between plots bsg b0s0g0 .. Select the beam,band,group to display. .. By default beam0,band0,grp0 is displayed. Example: bsg b0s1g0 .. will display the band centered at 1300 Mhz. d 20080826 .. Move to first file on this date using the current project id. n 100 .. Move to this filenumber for the current date and project id. If the number does not exist, you remain on the current file. l (all) .. list files for this projid, data. If all is included then list files for this projid for all dates. r 1 .. position to a row in the current file (count from 1) hdr .. print last header read s 0/1 .. step mode will stop and display the menu after each spectra is plotted. s 1 turns on step mode. s 0 turns it off. z .. stop in masmon routine (for debugging) q .. exit masmon.
(See /pkg/rsi/local/libao/phil/psrfits/psrfmonimg.pro)
NAME: psrfopen - open psrfits file for reading SYNTAX: istat=psrfopen(filename,desc,fnmI=fnmI) ARGS: filename: string filename to open (unless fnmI is specified) KEYWORDS: fnmI : {] returned from psrffilelist. if provided, then ignore filename and use this as the file to open. RETURNS: istat: 0 ok -1 could not open file. desc : {} file descriptor to pass to the i/o routines. DESCRIPTION: open an ao psrfits file.
(See /pkg/rsi/local/libao/phil/psrfits/psrfopen.pro)
NAME: psrftpfile - compute total power for file SYNTAX: n=psrftpfile(fname,tp,fnmI=fnmI,hdr=hdr,maxrows=maxrows,blankcor=blankcor) ARGS: fname: string name of file fname: string name of file KEYWORDS: maxrows: long max number of rows to input fnmI: {} structure from masfilelist for file to use In this case ignore fname blankcor: If set the correct for adc blanking RETURNS: tp[n,npols]: float total power hdr : struct primary and extension headers n: >=0 number of sample points returned < 0 error DESCRIPTION: Read in a file and compute the total power
(See /pkg/rsi/local/libao/phil/psrfits/psrftpfile.pro)