Документ взят из кэша поисковой машины. Адрес оригинального документа : http://xmm.vilspa.esa.es/calibration/documentation/epic_cal_meetings/201504/Freyberg_Cal_2015.pdf Дата изменения: Fri Jul 17 15:11:35 2015 Дата индексирования: Wed Apr 13 13:35:57 2016 Кодировка: Поисковые слова: x-ray background

Standard pro cessing b eyond standards: SAS-SCR-7284
· Pro cessing of "non-standard" data files with standard software ? · NCR-138: 25-Feb-2013 (2420 0690580101) and 11-Apr-2013 (2443) "PN CCD currents OoL Low Low, p ossible EPCE s/w corruption" required manual editing of ODF to p erform pro cessing up-to incident
fselect 2420_0690580101_PNU00501IME.FIT tmp.fit "FRAME.le.4951579" clobber=Y mv tmp.fit 2420_0690580101_PNU00501IME.FIT fselect 2420_0690580101_PNU00504IME.FIT tmp.fit "FRAME.le.4957044" clobber=Y fselect 2420_0690580101_PNU00500AUX.FIT tmp.fit "FRAME.le.4951579" clobber=Y

useful (and justified) for diagnostic purp oses, NCR has b een closed recently · epframes/epchain offer several switches for additional output witheventmap=Y withphotonmap=Y these images cannot b e made from final eventfile anymore, standard SAS tasks also retrieve HK information · Pro cessing of "standard" data files (SDFs) with standard software ?
Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

1


EPIC-pn offset maps and their use in SAS (I)
· offset maps ("bias") are computed b efore start of observation · (usually) with filter and mo de of following science exp osure · optical light (source, background) and X-rays (source, background) enter during computation (and are only partly rejected) residual optical and X-ray loading · high-energy particles (MIPs) can also b e recorded, and shift offset in pixels · new: TI and BU mo de offset maps computed with CLOSED filter to prevent X-ray loading from bright source · old: use effect imprinted in offset map and correct for this in SAS · problems: download of offset maps: only few observation in early mission, and only for few CCDs; first sent after observation (i.e., not after unplanned stop) · now: sent after computation b efore exp osure start, so available (for most cases) · but: slew exp osures use offset map of previous observation, no sp ecific slew offset map in SDF ­ though it exists (in different ODF)
Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

2


EPIC-pn offset maps and their use in SAS (I I)
· IMAGING mo des (FF, eFF, LW, SW): use in epreject for removal of MIP effects ("snow storm"): blo cks of pixels with changed offset (energy scale) and thus changed (lo cal) lower threshold: fixed feature on CCD and if p ointing: fixed on sky soft source and if slew: spurious soft counts along scan direction · IMAGING mo des (FF, eFF, LW, SW): used in epreject for removal of optical loading and X-ray loading · FAST mo des (TI, BU): use in epreject for removal of X-ray loading (if not CLOSED), compare double-median filtered offset variation with "background" in columns away from source · all need some kind of smo othed master offset map in CCF to remove MIPs (available for IMAGING mo des)

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

3


EPIC-pn offset maps and their use in SAS (I I I)
· if no offset map available: compute image in 20 adu and use calibration parameters from CCF (available for FF mo de only) · what to do for cases if offset maps are only available for inner CCDs: warning by epexposure if mixture of offset map handling detected · other task: epxrlcorr, avoid double corrections (call individual task twice or several similar tasks)

· in the following assume: ­ if offset maps in ODF/SDF: OAL *must* b e able to recognize them ­ offset maps are (partly) available but in different ObsID

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

4


2462 0723780401 PNS003: eFF mo de, 0.5 - 2.0 keV singles
PLCK G45.3-38.5 2462 0723780401 PNS003 Singles, 0.50 - 2.00 keV
Mo de = PrimeFullWindowExtended Filter = Thin1 2000 = 21 29 20.6 2000 = -07 40 23.7 PA = 70.721 l = 4 5 .3 5 2 b = - 3 8 .4 3 6 NH,gal = 5.26 в 1020 cm-2

2013-05-19T20:48:02 2013-05-20T01:43:47 17745 s

12
0.0

11

10
35.49

07

08
MIN = 0.0

09
MAX = 17301.0

Michael Freyb erg MPE Garching

XMM-SAS mjf

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015
Thu Apr 9 07:06:21 CEST 2015

06
5

05

04

01

02

03


2462 0723780401 PNS003: eFF mo de, 20 - 30 adu singles
PLCK G45.3-38.5 2462 0723780401 PNS003 Singles, no MIPs, 20 - 30 adu
Mo de = PrimeFullWindowExtended Filter = Thin1 2000 = 21 29 20.6 2000 = -07 40 23.7 PA = 70.721 l = 4 5 .3 5 2 b = - 3 8 .4 3 6 NH,gal = 5.26 в 1020 cm-2

2013-05-19T20:48:02 2013-05-20T01:43:47 17745 s

12
0.0

11

10
53.235

07

08
MIN = 0.0

09
MAX = 12146.0

Michael Freyb erg MPE Garching

XMM-SAS mjf

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015
Thu Apr 9 07:05:59 CEST 2015

06
6

05

04

01

02

03


2462 0723780401 PNS003: eFF mo de, 0.0 - 0.2 keV singles
PLCK G45.3-38.5 2462 0723780401 PNS003 Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Thin1 2000 = 21 29 20.6 2000 = -07 40 23.7 PA = 70.721 l = 4 5 .3 5 2 b = - 3 8 .4 3 6 NH,gal = 5.26 в 1020 cm-2

2013-05-19T20:48:02 PLCK G45.3-38.5 2013-05-20T01:43:47 2462 0723780401 PNS003 17745 s Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Thin1 2000 = 21 29 20.6 2000 = -07 40 23.7 PA = 70.721 l = 4 5 .3 5 2 b = - 3 8 .4 3 6 NH,gal = 5.26 в 1020 cm-2

2013-05-19T20:48:02 2013-05-20T01:43:47 17745 s

12
0.0

11

10
53.235

07

08
MIN = 0.0

09
MAX = 18119.0

12
0.0

11

10
53.235

07

08
MIN = 0.0

09
MAX = 17301.0

XMM-SAS mjf

uncleaned
Michael Freyb erg MPE Garching

Tue Jun 3 00:21:44 CEST 2014 XMM-SAS mjf

clean image: epchain ... runepreject=Y
7

Thu Apr 9 07:06:10 CEST 2015

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

06

05

04

01

02

03

06

05

04

01

02

03


2462 9246200004 PNS003: eFF mo de, 20 - 30 adu singles
S le w 2462 9246200004 PNS003 Singles, no MIPs, 20 - 30 adu
Mo de = PrimeFullWindowExtended Filter = Medium 2000 = 21 49 59.7 2000 = -35 40 55.0 PA = 56.794 l = 8 .8 0 5 b = - 5 0 .7 0 7 NH,gal = 1.86 в 1020 cm-2

2013-05-20T01:56:21 2013-05-20T02:41:18 2697 s

12
0.0

11

10
8.091

07

08
MIN = 0.0

09
MAX = 4451.0

Michael Freyb erg MPE Garching

XMM-SAS mjf

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015
Thu Apr 9 06:36:18 CEST 2015

06
8

05

04

01

02

03


2462 9246200004 PNS003: eFF mo de, 0.0 - 0.2 keV singles
S le w 2462 9246200004 PNS003 Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Medium 2000 = 21 49 59.7 2000 = -35 40 55.0 PA = 56.794 l = 8 .8 0 5 b = - 5 0 .7 0 7 NH,gal = 1.86 в 1020 cm-2

2013-05-20T01:56:21Slew 2013-05-20T02:41:18 2462 9246200004 PNS003 2697 s Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Medium 2000 = 21 49 59.7 2000 = -35 40 55.0 PA = 56.794 l = 8 .8 0 5 b = - 5 0 .7 0 7 NH,gal = 1.86 в 1020 cm-2

2013-05-20T01:56:21 2013-05-20T02:41:18 2697 s

12
0.0

11

10
8.091

07

08
MIN = 0.0

09
MAX = 5497.0

12
0.0

11

10
8.091

07

08
MIN = 0.0

09
MAX = 5497.0

XMM-SAS mjf

clean image: epchain ... runepreject=Y : not effective for SDF in SAS-14 !!
Mon Jun 17 17:30:42 CEST 2013 XMM-SAS mjf

Mon Jun 17 17:30:42 CEST 2013

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

9

06

05

04

01

02

03

06

05

04

01

02

03


SAS-SCR-7284
====================================================================== Project: SAS Change Requests Issue ID: 7284 Category: oal Reproducibility: always Severity: minor Priority: low Status: submitted Version: 3.125 as of version: originator: Michael Freyberg old originator email: action: old ID: ====================================================================== Date Submitted: 01-04-2015 14:11 CEST Last Modified: 01-04-2015 14:11 CEST ======================================================================

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

10


SAS-SCR-7284
Summary: EPIC-pn offset maps for slew data not (yet) accessible via OAL/SDF Description: Offset maps are a very useful dataset for corrections of the energy scale. Sometimes in the first years offset maps have been dumped in subsequent slews or observations, or via a different interface, and therefore are not included in the current public ODF. However, they should be included, and completed ODFs should be made available. A special (but the most frequent) case of "incomplete" datasets are SDFs. In slew observations no new offset map is computed but the one of the previous science observation is been used (with filter set to Medium in the slew for FF, eFF, LW mode, or to Closed for SW, TI, BU modes). These offset maps can currently not be accessed when processing a slew exposure as they are not part of the SDF (but of the ODF of the previous science exposure).

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

11


SAS-SCR-7284
The slew data in FF, eFF, and LW modes are used for catalogue production, while data obtained in SW, TI, and BU modes were taken with CLOSED filter - while only "recent" offset maps for TI and BU modes were computed with CLOSED filter, the others were sensitive to X-ray loading, and thus the subsequent slew exposure cannot simply be used for background studies. One should investigate whether these offset maps (and related information about the set-up) could be added to the slew observation to increase the scientific value, or other ways to enable the OAL/ odfingest/(etc.) to propagate the relevant data/information. This could mean to extend the SDF (and OAL) to accept the relevant offset map in a SAS consistent way, e.g. making OAL_selectAssociatedSet(OFFSET_DATA) OAL_selectAssociatedSet(HBR_OFFSET_DATA) to return meaningful information. Of course, there are always ways to by-pass the designed paths ...

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

12


ChangeLog for epreject (not really SAS-SCR-7284)
Version 5.16 - 2015-03-24 (MJF) ------------------------------- (src/epreject_mod.f90): allow input list of offset maps (instead of the ones identified by the OAL, or sometimes not identified ;-) This is useful in the case when the offset maps were dumped before or after the observation with different ObsID (e.g., early mission data, slews, ...) Moreover, this new feature enables calibration work without changing contents of ODF/SDF data or CCF files. This is controlled via new boolean parameter "withoffsetlist" (default "N") that takes precedence over "withoffsetmap" if set to "Y": it opens the file specified in new parameter "odilist" and reads the ODI name to be used from there. The input list is an ASCII with 2-digit CCD number followed by a blank and then the path to the offset map for that CCD (there can be more than one offset map in that file so that the input file can be used for the whole observation processing; only the first entry for a particular CCD is used; the order does not matter) - (config/epreject.*): as above - (doc/epreject_description.tex): as above
Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

13


Input file: 2462 9246200004 PNS00300ODI.ASC
Pro cessing of SDF 9246200004: epreject ... withoffsetlist=Y odilist=2462 9246200004 PNS00300ODI.ASC 01 02 03 04 05 06 07 08 09 10 11 12 00 /xmm/public/data/2462/0723780401/2462_0723780401_PNU40101ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40102ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40103ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40104ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40105ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40106ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40107ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40108ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40109ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40110ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40111ODI.FIT /xmm/public/data/2462/0723780401/2462_0723780401_PNU40112ODI.FIT /xmm/public/data/2462/9246200004/2462_9246200004_PNS00300ODI.ASC

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

14


ChangeLog for ep chain (not really SAS-SCR-7284)
Pro cessing of SDF 9246200004: epchain ... withoffsetlist=Y odilist=2462 9246200004 PNS00300ODI.ASC Version 8.75 - 2015-04-01 (MJF) ------------------------------- (src/epchain): allow input list of offset maps - (config/epchain.*): as above - (doc/epchain_description.tex): as above - (DEPEND): needs `epreject-5.16'

[...]

If enabled via new parameter switch withoffsetlist: epchain (+ epreject) tries to read from the maps indicated there ­ instead of the ones indicated by the OAL ­ which are NULL for SDFs ;-)

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

15


2462 9246200004 PNS003: eFF mo de, 0.0 - 0.2 keV singles
S le w 2462 9246200004 PNS003 Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Medium 2000 = 21 49 59.7 2000 = -35 40 55.0 PA = 56.794 l = 8 .8 0 5 b = - 5 0 .7 0 7 NH,gal = 1.86 в 1020 cm-2

2013-05-20T01:56:21Slew 2013-05-20T02:41:18 2462 9246200004 PNS003 2697 s Singles, 0.00 - 0.20 keV
Mo de = PrimeFullWindowExtended Filter = Medium 2000 = 21 49 59.7 2000 = -35 40 55.0 PA = 56.794 l = 8 .8 0 5 b = - 5 0 .7 0 7 NH,gal = 1.86 в 1020 cm-2

2013-05-20T01:56:21 2013-05-20T02:41:18 2697 s

12
0.0

11

10
8.091

07

08
MIN = 0.0

09
MAX = 5497.0

12
0.0

11

10
8.091

07

08
MIN = 0.0

09
MAX = 5408.0

epchain ... runepreject=Y withoffsetlist=Y odilist=2462 9246200004 PNS00300ODI.ASC
XMM-SAS mjf Mon Jun 17 17:30:42 CEST 2013 XMM-SAS mjf Thu Apr 9 06:36:35 CEST 2015

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

16

06

05

04

01

02

03

06

05

04

01

02

03


Discussion (I)
Advantage: 1. this do es not require any further task except epchain (done) and epproc to b e mo dified, if restricted to that particular usage (shift of energies due to particle or X-ray loading imprint) 2. one can now obtain information whether there is an evident effect by offset shifts on various parameters Disadvantages: 1. no other task can use the new functionality - except when fully co ding it the same way (which seems to b e an overhead). 2. it is in the users' resp onsibility to identify the corresp onding offset maps - and to get access to them 3. there is still no information on how these offset maps were computed (i.e. set-up or temp erature environment) as the prop er housekeeping information is in a different ODF 4. it do es not lo ok an "official" way to solve this SCR ;-)
Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

17


Discussion (I I)
Comments: 1. There is knowledge at SOC in which ODF the prop er offset maps of an SDF are stored, so SOC could easily create the prop er files like RRRR 9RRRR0000N PNS00300ODI.ASC 2. This feature could also b e applied to any other ODF where the prop er offset maps are stored in a different ObsID (i.e. sometimes in the following slew !), which happ ened in early mission phases. 3. This principle could then b e moved from epreject to the OAL, i.e. that it lo oks for a file like RRRR 9RRRR0000N PNS00300ODI.ASC (this might b e controlled via e.g. SAS EPN OFFSETMAP=ODF or SAS EPN OFFSETMAP=FILE), etc. 4. there could b e a public rep ository of public ODI files, if useful. 5. In epframes there are still many work-arounds for odffix-data, so I am afraid that the epreject work-around might have a long life time ;-)

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

18


Can we do b etter ?

Michael Freyb erg MPE Garching

EPIC Calibration and Op erations Meeting, ESAC, 9-10 April 2015

19