Home | Trees | Indices | Help |
|
---|
|
Updates the Provenance table. Retrieves a list of non-deprecated combiframe IDs that are new or have incomplete or indeterminable (if the -q/--quick option is not selected) provenance records to be updated. The header of the FITS file for each combiframe is read to determine the list of provenance files, which are converted to multiframe IDs (to insert into the Provenance table) via a look-up table. This table lists all frames that are not deprecated due to reprocessing, referrenced by file name (which is combined with the night to distinguish between common file names across nights for confidence images etc.) and so should provide a unique list of the latest versions of each of the component files. If this list is not unique an error is thrown, as this suggests a database inconsistency. Since only non-deprecated combiframes have their provenance updated, we only need to consider the latest reprocessed version.
The final statistics report the number of broken combiframe files that list no provenance, as well as the number of combiframe files where a component file is missing from our database. A re-run in -q/-quick mode will recheck these files as well as files that are broken due to providing incomplete provenance lists, due to e.g. an interrupted observation run (these will normally become deprecated by quality control later on, so will not be rechecked on subsequent runs).
|
|||
Nested Errors and Exceptions | |||
---|---|---|---|
Inherited from |
|
|||
|
|||
|
|||
list(tuple(str, int)) |
|
||
|
|||
str |
|
||
Inherited from Inherited from Inherited from Inherited from Inherited from |
|
|||
Inherited from |
|
|||
cuNum = 23 Curation task number. |
|||
combiFrameTypes =
A list of frameTypes that are combiframes (i.e. |
|||
isQuickRun = False Don't re-check for missing provenance of frames that are already in the Provenance table, where we don't know how many components they should have (i.e. |
|||
recheckDate = None Only re-check stackconf and deep frames observed after this date. |
|||
_guessDict = None Dictionary of multiframeIDs referenced just by file name. |
|||
_mfidDict = None Dictionary of multiframeIDs referenced by file name and night. |
|||
Inherited from Inherited from Inherited from |
|
|||
Inherited from |
|
Update db: Prepare file list, and read the FITS files.
|
Retrieve list of records to be updated and prepare the mfid<->filename look-up table.
|
Retrieve a list of records that need updating in the database. As DbUpdater but with self._recordSet modified to just select frames with provenance information that is not already in the Provenance table.
|
Inserts provenance info for given combiframe into table Provenance if its FITS file contains the PROV000x keywords.
|
|
|
combiFrameTypesA list of frameTypes that are combiframes (i.e. have provenance info) and the parameter that defines the number of component frames.
|
isQuickRunDon't re-check for missing provenance of frames that are already in the Provenance table, where we don't know how many components they should have (i.e. just stackconf, %deep%, dark, sky).
|
recheckDateOnly re-check stackconf and deep frames observed after this date. Expects string, e.g. '2005-05-05' or '20050505' or '05A'. For semesters it takes the first night of the semester.
|
Home | Trees | Indices | Help |
|
---|
Generated by Epydoc 3.0.1 on Mon Sep 8 15:46:54 2014 | http://epydoc.sourceforge.net |