Ingests products of parallel CU runs by DataBuilder.
|
__init__(self,
curator=' rsc ' ,
database=' WSA ' ,
isTrialRun=False,
logFileName=False,
ingestOneLog=False,
cuNums=False,
forceIngest=False,
autoCommit=False,
excludedTables=False,
omitObjIDUpdate=False,
isParallelRun=False,
comment=' A useful comment ' )
Initialises data members for all database state flags and details for
this curation session. |
source code
|
|
|
|
|
|
File.File
|
|
|
ingestCU2(self,
ingLogFile,
histInfo,
_ingestOrder,
_fileInfo)
Ingest CU2 data. |
source code
|
|
|
ingestCU3(self,
ingLogFile,
histInfo,
ingestOrder,
fileInfo)
Ingest CU3 data. |
source code
|
|
|
ingestCU4(self,
ingLogFile,
histInfo,
ingestOrder,
fileInfo)
Ingest CU4 data. |
source code
|
|
|
checkCUEDFile(self,
ingLogFile,
histInfo)
Check flag file to say that the data are already ingested. |
source code
|
|
|
tryIngest(self,
ingestCU,
ingLogFile,
histInfo,
ingestOrder=None,
fileInfo=None,
enableRollback=True)
General ingest function for any CU. |
source code
|
|
|
updateCUEDFile(self,
ingLogFile,
histInfo)
Update CUed file. |
source code
|
|
|
ingestData(self,
ingLogFile,
ingestOrder,
fileInfo,
histInfo)
Ingest all files described in given log file. |
source code
|
|
|
parseIngest(self,
logFile=None)
Do the appropriate ingest for the different CUs. |
source code
|
|
|
|
int, int
|
|
|
ingest(self,
ingestOrder,
ingestHost,
fileInfo,
ingestDate,
isCu3=True,
cuEventID=0)
Ingest the data file. |
source code
|
|
|
dropVVVConstraints(self,
tableName)
Drop the constraints on monthly VVV tables. |
source code
|
|
|
checkVVVIndices(self)
Checks if the SQL for all objID indices exist for monthly tables. |
source code
|
|
list(str)
|
|
|
readIngLog(self,
logFile)
Read the given ingest log file and print its content to the screen. |
source code
|
|
|
reAllocateDXSSVFrames(self)
Re-allocate DXS_SV frames to the main programme. |
source code
|
|
|
removeProductProcessingLines(self)
Use newlyIngested flag to select newly ingested filenames Delete
entry in ProductProcessing and GroutingLinks |
source code
|
|
set(str)
|
selectFiles(self,
subDir,
beginDate,
endDate)
Selects all FITS files in given sub-directory of all disks where the
date is within the given range. |
source code
|
|
|
setNewlyIngested(self,
cuEventID)
Reset all the 'newlyIngested' flags to zero. |
source code
|
|
|
|
|
updateHistory(self,
historyUpdate,
status,
rolledBack,
comment='
' )
Update Archive and Programme Curation History with data from the
logfile. |
source code
|
|
|
updateObjIDs(self,
tableName,
cuEventID)
Since the objectIDs couldn't be calculated beforehand they have to be
updated separately based on their value and the maximal value found
in the database. |
source code
|
|
Inherited from IngCuSession.IngCuSession :
attributesFromArguments ,
createFileList ,
createLogFileName ,
createMonthlyDetSchema ,
createWorkingDir ,
getDetTable ,
getErrorFileName ,
getMultiframeIDs ,
getProcessOrder ,
getProgramIDs ,
makeSysCmd ,
removeWorkingDir ,
run ,
runSysCmd ,
setupDetectionTable ,
testForProgs ,
translateProgID ,
writeErrorFiles ,
writeIngestList
Inherited from IngCuSession.IngCuSession (private):
_connectToDb ,
_createProgrammeTranslation ,
_disconnectFromDb ,
_getNextCuEventID ,
_getNextID ,
_historyCommentPrefix ,
_onException ,
_prepareDbLock ,
_updateACHComment ,
_updateArchiveCurationHistory ,
_updateProgrammeCurationHistory
Inherited from object :
__delattr__ ,
__format__ ,
__getattribute__ ,
__hash__ ,
__new__ ,
__reduce__ ,
__reduce_ex__ ,
__repr__ ,
__setattr__ ,
__sizeof__ ,
__str__ ,
__subclasshook__
|