Package invocations :: Package cu6 :: Module cu6 :: Class Cu6
[hide private]

Class Cu6

source code


Create/update synoptic source catalogues for a given database release.

Nested Classes [hide private]
  ChunkInfo
ChunkInfo(frameSetID, filterID, firstSID, part, chunkSizeSID, shtName)
  Range
Range(min, max)
    Nested Errors and Exceptions

Inherited from wsatools.DbConnect.CuSession.CuSession: CuError

Instance Methods [hide private]
 
_onRun(self)
Run CU6.
source code
 
_setProgDetails(self)
Sets class member variables for the current programme details.
source code
 
_prepareTables(self, tableSchema)
Checks ingest db tables exist and creates new ones if necessary.
source code
 
_calcBestAperTable(self, frameSetChunks, outputFile)
Calculates noise model for the given frame sets and saves the data to the given CSV file for bulk ingest into the progBestAper table, as well as updating the progVarFrameSetInfo table.
source code
 
_calcHalfSpaces(self)
Calculates half-spaces and updates database with new values.
source code
 
_updateVarFrameSetInfo(self, varFSRowData)
Ingests given data into the VarFrameSetInfo table.
source code
 
_calcVariabilityTable(self, frameSetChunks, outputFile)
Calculates variability statistics for the given frame sets and saves the data to the given CSV file for bulk ingest into the progVariability table.
source code
 
_writeToVariability(self, outFile, frameSetID, uniqueSources, astroOfSource, correlOfSource)
Writes CSV file to ingest into the Variability table.
source code
 
_bestObjCalculator(self, ingester, bmTable, frameSetsForTable)
Method to calculate the most likely object in each frame to correspond to the source.
source code
 
_calcAstrometry(self, frameSetID, chunkSQL)
?
source code
 
_calcFullStats(self, chunkInfo)
This calculates all the photometric stats after the noise model has already been calculated.
source code
 
_calcInitialStats(self, chunkInfo)
Calculate which is best aperture and statistics that are necessary for noise model.
source code
 
_calcNoiseModel(self, frameSetID, filterID)
?
source code
 
_calcVariableClass(self, uniqueSources)
?
source code
 
_createOrphanTable(self)
Creates an orphan table for the programme.
source code
 
_updateHalfSpaces(self, fTypeSel)
Calculates half-spaces for each detector of the correct frame type.
source code
 
_calcCorrelatedStats(self, chunkSQL)
?
source code
 
_doDifficultMatches(self, checkPosList, checkPosDict, nonDetectMatchList)
?
source code
 
_expRmsModel(self, filterID, params, mag, magMx)
?
source code
 
_fillInDefaultNoise(self, frameSets)
?
source code
 
_findBestMatches(self, frameSetID, sourceData, allFrames, bmatchCsvFile, isCorrel)
?
source code
 
_findMissingDetections(self, pos, allFrames, alreadyMatchedMFID)
?
source code
 
_findNPartsVar(self, frameSetID, isInitStats)
Calculate number of parts (check the best value for all filters).
source code
 
_findTurningPoint(self, model, filterID, fit)
Find when d/dm =0.
source code
 
_setGoodQualityBitflags(self)
Sets the default list of good quality bit flags,
source code
 
_calcAstromFit(self, xList, yList, zList, errorList)
?
source code
 
_queryBadEpochSet(self)
Finds any extensions that have no data in DetectionRaw, DetectionPhotometry and DetectionAstrometry.
source code
 
_queryBestAperTable(self, frameSetID)
?
source code
 
_getCurrentFits(self)
?
source code
 
_getFrameSetDict(self)
Get dictionary of frame sets needed in each part
source code
 
_getFinalFrameSets(self, newFrameSets)
?
source code
 
_queryUniqueSources(self, sqlSelection)
?
source code
 
_nearestGoodFilter(self, filterID, goodFilters)
?
source code
 
_prepareFrameSets(self, frameSets, bmAttr)
Prepares frame sets for BestMatch table calculation.
source code
 
_queryAstromDataByMonth(self, tempTable)
Builds up the queries of astromData by iterating over monthly tables.
source code
 
_queryAstromData(self, chunkSQL)
?
source code
 
_queryCorrelData(self, chunkSQL)
?
source code
 
_queryMaxImageExtent(self, frameSetID, isCorrel)
Get max image extent from all deep stacks in frameSet.
source code
 
_queryNumParts(self, selectStr, fromStr, whereStr, memFrac=0.05)
Estimate memory required.
source code
 
_queryCorrelObjData(self, chunkInfo)
Queries database for correlated object data.
source code
 
_createTempObjTable(self, tempTable, chunkInfo)
Put core data for _queryObjData() into temporary table using SELECT INTO with filter selection here using Multiframe.
source code
 
_createTempAstromTable(self, tempTable, sourceIDs)
Put core data for _queryAstromData() into temporary table using SELECT INTO.
source code
 
_queryObjDataByMonth(self, tempTable)
Builds up the queries of objData by iterating over monthly tables.
source code
 
_queryObjData(self, chunkInfo, isInitStats=False)
Selects data to be used calculating stats.
source code
 
_queryMissingDetections(self, chunkInfo)
Returns a dictionary of missing detections per source.
source code
 
_sourceIDSel(self, chunkInfo, alias=None)
Selection based on sourceID
source code
 
_queryPossFrames(self, frameSetID, bmAttr)
?
source code
 
_querySourceIdRange(self, frameSetID)
Retrieve range of source IDs for given frame set.
source code
 
_querySources(self, selectStr, fromStr, sourceSel, orderBy='')
?
source code
 
_queryUniqueCorrelSources(self, chunkSQL)
?
source code
namedtuple, Photo, list, list
_splitVarSchema(self, varInfoSchema, varSchema)
Separates out columns associated with astrometric, photometric and correlated parts of schema.
source code
 
_updateDefaults(self, defFitDict, missingFilts) source code
 
_writeResults(self, outFile, nonDetectMatchList, isCorrel)
?
source code
 
_writeToBestAperFile(self, outputCsvFile, frameSetID)
Writes to best output file
source code

Inherited from wsatools.DbConnect.CuSession.CuSession: __del__, __init__, logBrokenFile, run

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __new__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __str__, __subclasshook__

Static Methods [hide private]

Inherited from wsatools.DbConnect.CuSession.CuSession: logException

Class Variables [hide private]
  intRmsLimit = 3.0
?
  maxDisp = 9.696e-07
?
  maxDist = 0.008
Maximum distance in arcmin.
  memFactAstrom = 0.07
?
  memFactBestMatch = 0.05
Proportion of total memory to be taken up by sourceData for max efficiency.
  memFracNoise = 0.07
Proportion of total memory to be taken up by objData for max efficiency
  memFracVariability = 0.06
Proportion of total memory to be taken up by objData for max efficiency
  minCount = 3
Minimum number of matches to be used in statistical analysis
  minNGoodObsVar = 5
?
  numObjsBin = 100
?
  probVarLimit = 0.9
?
  frameSetChunkSize = 5
number of framesets in a chunk to be processed
  cuNum = 6
Curation task number.
  _autoCommit = True
Should this curation task auto-commit database transactions?
  _reqCuEventID = True
In trial run mode is a cuEventID required?
  bestAperRange = Range(min=1, max=6)
?
  calcVarOnly = False
?
  createNewTable = False
Recreate all variability tables from scratch.
  dateRange = DateRange(begin=<mx.DateTime.DateTime object for '...
?
  frameSetList = None
?
  keepHalfSpaces = False
Keep half-spaces when recreating tables.
  maxProdID = None
Maximum product ID.
  minProdID = None
Minimum product ID.
  motionModel = 'wgtstatic'
?
  oneFrameSet = False
?
  _dict1sML = None
Dictionary of one-second magnitude limits referenced by filter ID.
  _goodBitflags = None
List of good quality bit-flags for variability calculation.
  _initSFID = None
Initial synoptic frameSetID.
  _passbands = None
List of filter passbands for the current programme as a tuple of filter ID and short name.
  _srcTableIdx = ''
Hint for index on the source table if it exists.
  _synColours = None
List of synoptic colours for the current programme as a tuple of filterID1, filterID2, shortname1, shortname2.
  _synPassbands = None
List of filter passbands that are synoptic for the current programme as a tuple of filter ID and short name.
  _synSetup = None
Cu6SynopticSetup details for current programme.
  _tableIndices = None
A dictionary of schema.Index object lists referenced by table name.
  _initialPhtParam = [0.005, 1e-08, 1e-15]
A list of initial parameters for the photometric fitting function
  _initialAstParam = [0.005, 1e-08, 1e-15]
A list of initial parameters for the astrometric fitting function

Inherited from wsatools.DbConnect.CuSession.CuSession: archive, comment, cuEventID, curator, eTypes, isDayStampedLog, onlyNonSurveys, onlySurveys, programme, programmeID, resultsFilePathName, shareFileID, sysc

Properties [hide private]

Inherited from object: __class__

Method Details [hide private]

_onRun(self)

source code 

Run CU6.

Overrides: wsatools.DbConnect.CuSession.CuSession._onRun

_bestObjCalculator(self, ingester, bmTable, frameSetsForTable)

source code 

Method to calculate the most likely object in each frame to correspond to the source.

To Do: Sort out definitions of member variables.

_createTempObjTable(self, tempTable, chunkInfo)

source code 

Put core data for _queryObjData() into temporary table using SELECT INTO with filter selection here using Multiframe.

Returns number of rows inserted into the new temporary table.

_createTempAstromTable(self, tempTable, sourceIDs)

source code 

Put core data for _queryAstromData() into temporary table using SELECT INTO.

Returns number of rows inserted into the new temporary table.

_queryObjData(self, chunkInfo, isInitStats=False)

source code 

Selects data to be used calculating stats.

Speed ups for VVV 4) Improve queries - remove unnecessary tables, use indexed queries

_splitVarSchema(self, varInfoSchema, varSchema)

source code 

Separates out columns associated with astrometric, photometric and correlated parts of schema.

Returns: namedtuple, Photo, list, list
A namedtuple type for photometric columns, a namedtuple of default values for photometric columns, a list of default values for astrometric columns and for info columns.

Class Variable Details [hide private]

dateRange

?

Value:
DateRange(begin=<mx.DateTime.DateTime object for '1753-01-01 00:00:00.\
00' at 317c468>, end=<mx.DateTime.DateTime object for '9999-12-31 00:0\
0:00.00' at 317cf60>)