HISTORY createAB

VERSION	DATE		DESCRIPTION

0.9 	2002-10		born as findAssoc
1.0     2003-06-03	AB restructured, fixed property rule added (not backwards compatible)
1.1	2004-07-15	moved to createAB; PACK_DIR added, SOF_CONTENT, DRS_TYPE etc.
1.1.1 	2004-07-16	uses fitsreport to create raw_list; reads fitsreport_assoclists.cfg
1.2	2004-07-21	supports trigger/waitfor mechanism for REI; offers config option 
1.3	2004-08-11	uses dfosLog for standard logging (backwards compatible)
1.4	2004-09-07	minimum number of input raw files (backwards compatible)
1.5	2004-09-17	add option to associate header files (backwards compatible)
1.5.1	2004-10-12	corrects for worting bug of fitsreport (b.c.)
1.5.2	2004-11-04	corrects a bug related to PARAM section
1.5.3	2004-11-10	removes !*-@~ messages from fitsreport about log4plus
1.5.4	2004-12-06	help simplified 
1.5.5	2004-12-16	MAINTENANCE_YN introduced
1.6	2005-01-27	DELTA_T monitoring introduced; action_abname_TPL_D added
1.6.1	2005-01-28	PROD_ROOT removed, COMB_P revised
1.6.2	2005-01-28	TPL_A revised,  to deal properly with varying DO_CLASS in a template
1.6.3	2005-02-01	improved handling of DO_CLASS containing 'Y' 
1.6.4	2005-02-03	TPL_D revised,  to deal properly with varying DO_CLASS in a template
1.6.5 	2005-02-21	TPL_D revised, to disregard initial TEST data
1.7 	2005-03-15	TPL_B, TPL_M added; TPL_A switched back to v1.6.1
1.7.1	2005-03-30	PREVIOUS match rule added
1.7.2	2005-03-31	AB_EXT replaced with 'ab'
1.7.3	2005-04-05	bug fixed for case MASSOC without MCALIBs
1.8	2005-04-11	NIGHT time match rule implemented 
1.8.1	2005-04-14	consolidate AB_list and exec_list for multiple entries
1.8.2	2005-04-15	bug fixed with NIGHT
1.8.3	2005-04-20	bug fixed with consolidation
1.8.4	2005-04-27	TOOL_MODE=ERROR introduced
1.8.5	2005-05-09	dummy entry for TEXEC
1.8.6	2005-05-17	time match rules modified: suspended adding EXPTIME/2
1.8.7	2005-06-08	micro changes to prepare for CONDOR
1.8.8	2005-06-15	bug fixed with MASSOC/DFS_PRODUCT
1.8.9	2005-06-20	bug removed with grep for $RAW_TYPE (line 1234)
1.8.10	2005-08-04	TPL_M enabled for multi-detector case
1.8.11	2005-11-22	TPL_I now as plugin, to be more flexible
1.8.12	2005-11-30	bug removed with DO_CLASS_STRING
1.8.13	2005-12-07	another bug removed with DO_CLASS
1.9	2006-01-04	creating AB logs under $DFO_AB_DIR; option -a to enforce automatic mode
1.9.1	2006-01-10	little bug fixed with SEQ_RAW_TYPE
1.9.2 	2006-01-18	pro.catg match improved by get_value_par; DELTA_T bug fix; action_matchtime improved
1.9.3	2006-02-13	RB_NAME switched off
1.9.4	2006-02-21	dummy version to have preOCA and transOCA included
----------------------------------------------------------------------------------------------------------
2.0	2006-03-03	rew-ritten to integrate ABbuilder
2.0.1	2006-03-30	some minor bugs fixed
2.0.2	2006-03-31	default scan-date: latest available date in $DFO_CAL_DIR
2.0.3	2006-04-04	introducing SCI_VIRT_WARN
2.0.4	2006-04-06	introducing PROD_STEP2, plus GEN_CALDIR bug fix
2.0.5	2006-04-10	bug fixed for case "No ABs created"; VCAL cleaned after first iteration for step2
2.0.6	2006-04-18	cleaned for case that no mcalibs exist 
2.0.7	2006-05-16	support for dfosLog suspended
2.0.8	2006-06-01	minor bug fix
2.1	2006-06-16	adding OBS_MODE and BATCH_ID
2.1.1	2006-09-19	modified handling of fitsort (qfits)
2.1.2	2006-10-06	bug fixed in PROD_STEP2
2.2	2006-11-21	treatment of RAW_MINNUM enabled; filterRaw integrated; config.createAB simplified; translateOCA removed; enabled for calChecker
2.2.1	2007-02-01	RAW_MINNUM disabled again, to be done in filterRaw
2.2.2	2007-02-08	bug fixed with improper sorting of SET
2.2.3	2007-02-26	removed "associated QC1 parameters" section
2.2.4	2007-03-08	SCI_VIRT_WARN --> SCI_VIRT_MCAL/SCI_VIRT_MASS; interactive filterRaw only for TOOL_MODE=INTER 
2.2.5	2007-03-19	list_ab_rt properly sorted
2.2.6	2007-04-26	introducing optional $PGI_POSTPROC
2.3	2007-11-15	Implemented handling of HDRs for MCALIBs in DFO_CAL_DIR/$DATE and -z/-Z command line options [JDP]
2.4	2008-03-13	move hidden headers back to $DFO_HDR_DIR, after ABs have been created
2.4.1	2008-04-10	create only SM science ABs if CREATE_SM_ONLY = YES
2.4.2	2008-05-27	bug fixed with VCAL1 creation [BWo]
2.4.3	2008-07-29	RBS support stopped
2.5	2008-09-17	Introduce incremental mode; OBS_MODE improved (no 60., 060. runs accepted for SCIENCE)
2.5.1	2008-10-07	bug fixed for increm. mode (case no hdr)
2.5.2	2008-10-09	bug fixed with 60., 060. runs
2.5.3	2008-10-10	bug fixed for increm. mode (cal_AB flag)
2.5.4	2008-10-24	control handling of 60., 060. runs; improved handling of tfits extension for mcalib hdr
2.5.5	2008-11-03	flags cal_AB/sci_AB set if N=0 and INCREMENT=NO
2.5.6	2008-11-06	STEP2 only offered for MODE=CALIB
2.5.7	2008-11-19	introducing PGI_PREPROC
2.5.8	2008-12-15	improved handling of headers in STEP2 ABs [BWo]
2.5.9	2009-02-02	improved handling of UNDEFINED header keys [BWo]
2.5.10	2009-02-18	introducing N_MCAL_LIST_CAL (optional value for CALIB mode only) [JPr]
2.5.11	2010-01-05	VCAL management for large number of files improved [JPr]
2.5.12	2010-03-11	bug fixed in line 770 (broken template handling)
2.5.13	2010-04-14	opc70..sched_rep 
-------------------------------------------------------------
3.0	2010-06-02	supporting RECREATE; new config keys RECREATE_EDITOR and XTERM_GEOM
3.0.1	2010-07-01	RECREATE: add COMPLETE/INCOMPLETE information in $TMP_DIR/ca_list_recreate
3.0.2	2010-08-02	line :888 minor change in find call
3.0.3	2010-08-04	use standard DFS version of ABbuilder (drop $AB_BIN_DIR)
3.0.4	2010-10-20	introducing PGI_FINAL
3.1	2011-05-02	new option -N to skip VCAL association for SCIENCE; DFO_EDITOR used, RECREATE_EDITOR obsolete
3.1.1	2011-10-21	use dfosRLSmassage.py to edit the gcc-precompiled RLS file into format compatible with createCalibMap 
3.2	2012-01-09	ALOGs have the DELTA_T column
3.3	2012-01-20	check for completeness of science associations 
3.3.1	2012-04-12	improved warning in line 1717ff
3.3.2	2012-08-24	replace observations by obs_metadata database
3.4	2012-09-13	LAST_AB, upload to WEB_SERVER
3.4.1	2012-09-18	bug fixed with AB creation for calChecker CAL4CAL in :1349
3.4.2	2012-10-09	ACCEPT_060 was too weak (assuming that 60.A progs have neither s nor v flag but they had); now improved
3.4.3	2012-11-29	SETUP=NONE if not found in the AB
3.5	2013-01-07	FILE_MODE always HDR, -Z obsolete; JOB_FILE_NAME="JOBS_NIGHT" hard-coded; create .tab files
3.5.1	2013-01-28	$PRODDIR_CREATION removed, readlink handling in massageAB
3.5.2	2013-04-09	bug fixed with ATAB creation for RECREATE=YES
3.6	2013-10-30	replace stargate1 by $DFO_WEB_SERVER
3.6.1	2013-11-26	improved warning for pseudo-science data
3.6.2	2014-01-30	bug fix for pseudo-science data (line :1750, DDo)
3.6.3	2014-07-07	bug fix for incomplete marking in TAB file (line :1442), plus minor improvement for RECREATE workflow
3.6.4	2014-07-22	new DRS_TYPE=INT
3.6.5	2014-08-28	some improvements for STEP2 processing
3.6.6	2014-12-01	bug fix for completeness check
3.6.7	2015-05-04	small bug fix for TOOL_MODE=AUTO
3.6.8	2016-01-11	SETUP handling of TPL.START generalized to OBS.START
3.6.9	2016-02-29	line 1246 stabilized against multiple SM/VM