Package wsatools :: Module SystemConstants :: Class WsaConstants
[hide private]

Class WsaConstants

source code


Constants with specific values for the WSA.

Instance Methods [hide private]

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __init__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __subclasshook__

    CASU data transfer constants

Inherited from SystemConstants: scpMainDir, scpMethod, sshMethod

    Pixel server common directories

Inherited from SystemConstants: downloadPathList

    FITS file naming conventions

Inherited from SystemConstants: extListOfType, productTypeOfFrame, wfauFitsKeys

    Convenience methods

Inherited from SystemConstants: __str__, isGES, isOSA, isSSA, isVSA, isWSA

    Getter methods

Inherited from SystemConstants: calibrationSchema, curationSchema, dbMntPath, ingestListsPath, ingestedFilesPath, ingestedLogsPath, metadataSchema, wcsErrorFilesPath

    Software directory structure

Inherited from SystemConstants: calibrationDir, cambInfoPath, corruptFilesPath, filterDataDirPath, filterRefDataDirPath, illuminationDir, logFilePath, missingFilesFilePath, monitorPath, nonSurveyRegPath, tempWorkPath, xferLogPath

    Pixel server directory structure

Inherited from SystemConstants: availableRaidFileSystem, excludedRaidFileSystem, leaveSpaceOnMSRFS, massStorageRaidFileSystem

    Permanent curation log file paths

Inherited from SystemConstants: filesBrokenPath, filesDuplicatedPath, filesMissingPath, filesNotIngestedPath

    Web site constants

Inherited from SystemConstants: surveyBaseUrl, surveyJspBaseUrl

Static Methods [hide private]
    CASU data transfer constants
str
scpServer(light=True)
Returns: The CASU scp server for processed data.
source code
list(str)
surveyFileGroups(_surveys='')
Returns list of file groups for a database of the given surveys.
source code
    FITS file naming conventions

Inherited from SystemConstants: fileNameSuffices, frameTypeToSuffix

    Initialiser

Inherited from SystemConstants: __new__

    Getter methods

Inherited from SystemConstants: catServerVolumes, dbSharePath, getAll, getServerName

    Software directory structure

Inherited from SystemConstants: casuCodePerlPath, curationCodePath, emptyFitsCataloguePathName, helpersPath, privNetCmd, sExtractorInputsPath, sourcePosTablesPath, sqlFragmentPath, sqlMonthlyDetPath, sqlNonSurveyPath, sqlQualityControlPath, sqlTemplatePath, testOutputPath

Class Variables [hide private]
    Catalogue server constants
  loadDatabase = 'WSA'
Name of load database.
  loadServer = 'ramses1'
Name of load server.
  ingestDbForServer = {'ramses1': 'WSA'}
Dictionary of ingest database names on each server for split ingest dbs.
  metadataFileGroups = ['Curation', 'Indices']
Additional database file groups beyond primary and logs for metadata.
  metadataTables = ['Multiframe', 'MultiframeDetector', 'Current...
Database tables containing metadata to be populated by CU3.
  nonSurveyDir = 'WSA-NonSurvey'
Default directory for non-survey db.
  pixelServerHostName = 'djoser:'
(Deprecated) This is appended to fileNames in the database.
  publicServers = ['ramses5', 'ramses6']
List of public catalogue servers.

Inherited from SystemConstants: adminDatabase, catServerFileSep, catServerSharePath, clusterName, loadServerVolumes

    Pixel server file system
  casuPrefix = 'w'
Prefix for CASU produced FITS files.
  genOpsDisk = '/disk01/wsa'
Disk for general operations output (logs, info, ...).
  serverRaidArray = {'djedefre': ['/disk10/wsa', '/disk11/wsa', ...
A dictionary giving the file systems of each server.
  versFormat = '%d'
Format of versioning numbers.
  versStep = 1
Increments of versioning numbers.

Inherited from SystemConstants: criticalDisks, curationServers, deprecatedDataStorage, developDisks, infinibandServers, sysPath, userInterfaceTempStorage

    Software file system
  autoTemplateIndexSchema = '/neferefre/rsc/VDFS_branches/trunk/...
Template schema for automated index scripts.
  autoTemplateNeighboursSchema = '/neferefre/rsc/VDFS_branches/t...
Template schema for automated neighbour scripts.
  autoTemplateSchema = '/neferefre/rsc/VDFS_branches/trunk/sql/T...
Template schema for automated scripts.
  indexScript = 'WSA_Indices.sql'
File name for the SQL script defining WSA table indices.
  nsIndexScript = 'NonSurvey/WSA_NonSurveyIndices.sql'
File name for the SQL script defining non-survey specific table indices.
  nsQcScript = '/neferefre/rsc/VDFS_branches/trunk/sql/QualityCo...
Location to the script of quality control SQL statements for parsing.
  surveyProcScript = 'WSA_UKIDSS_StoredProcsAndFuncs.sql'
Script for survey specific procedures and functions.
  surveyViewScript = 'WSA_UkidssViews.sql'
File name for the SQL script defining survey views.
    Survey data constants
  amStart = 'AMSTART'
Airmass start value keyword in FITS HDU.
  amEnd = 'AMEND'
Airmass end value keyword in FITS HDU.
  casuCatType = 2
CASU catalogue type.
  casuDetThresh = {1: 1.5, 4: 1.25, 9: 1.25}
CASU detection threshold dict(nustep,sigma)
  expTimeKeyWord = 'EXP_TIME'
EXPTIME header keyword
  fieldOfView = (0.6713, 0.6713)
Size of the field of view x and y (tuple)
  hduNumKey = 'CAMNUM'
Name of HDU number fits key
  instrumentName = 'WFCAM'
Name of the instrument
  instrumentPixScale = 0.4
Standard pixel scale of instrument
  manualProgs = [1, 101, 102, 103]
List of programmeIDs of programmes which are manually set up.
  monthlyDetSurveys = []
List of programmes that need monthly detection tables
  maxHDUs = 5
Maximum number of extensions
  maxRaDecExtentStackDeg = 0.068
Maximum ra or dec separation for stacks in a group for deep stacking
  minRaDecExtentStackDeg = 0.017
Minimum ra or dec separation for stacks in a group for deep stacking
  obsCal = WfcamCal()
Observation dates for the survey.
  pawPrintArea = 0.207
Pawprint area in degrees
  phtErrLimit = 0.02
Photometric zero-point error limit that necessitates recalibration.
  pointingKeys = ['RABASE', 'DECBASE', 'FILTER']
Pointing keys to check
  productTypes = ['stack', 'mosaic']
Product types
  projectKeys = ['PROJECT']
FITS header keys that identify the project.
  rCoreBasic = 2.5
Core radius ~ 1/instrument pixScale
  scienceProgs = {'DXS': 104, 'GCS': 103, 'GPS': 102, 'LAS': 101...
Programmes
  scrunch = 2
Pixel super bin size in JPEG rebinning process.
  surveyTranslations = {}
Known survey name translations of WFCAM frames.
  telescopeName = 'UKIRT'
Name of the telescope
    CASU data transfer constants
  casuFileSystem = ['/data/apm22_a/wfcam/processed', '/data/apm2...
List of disks where data is stored at CASU.
  casuFileSystemVariables = AlphaNum(name='wfcam', alpha='abcdef...
Letters and numbers that can appear in the CASU file system.
  casuIllumDir = '/data/apm7_a/mike/photomtests'
The directory where illumination tables are stored at CASU.
  scpPort = 22
The CASU scp server port number for processed data.
  hasMicroStep = True
has microstepping?

Inherited from SystemConstants: ftp_method, rem_camlist_dir, rem_lock_name, rem_ready2copy_name, rem_success_name, scpThreads, scpUser

    Numerical constants

Inherited from SystemConstants: minNumCPUs, one_gigabyte, one_kilobyte, one_megabyte, sqlDataTypeSize

    Pixel server common directories

Inherited from SystemConstants: casu2massDir, compressImDir, deprecatedComprImDir, deprecatedDir, diffDir, downloadDir, esoExtDir, extProdDir, fitsDir, headerDir, listDrivDir, mosaicDir, productLogDir, productsDir, stackDir, swarpDir, tempProductsDir, tileDir

    FITS file naming conventions

Inherited from SystemConstants: biasPrefix, catSuffix, catType, confSuffix, cpmSuffix, darkPrefix, deepSuffix, diffSuffix, filtPrefix, filtSuffix, fixcatSuffix, flatSuffix, frameTypes, fringeSuffix, jpgType, leavSuffix, listSuffix, mefType, mjdSuffix, mosaicSuffix, pregrtSuffix, simpleSuffix, skyPrefix, stackSuffix, tileSuffix, uncType, wfauPrefix

    Software file structure

Inherited from SystemConstants: cirdrShellScript, emptyFitsCatalogueFileName, procScript, sqlScriptPath, srcPath, webDocsPath

    SExtractor

Inherited from SystemConstants: defaultSexInparFile

    Synoptic syntax constants

Inherited from SystemConstants: bthSubStr, corSubStr, uncSubStr, varSubStr

    Common instrument properties

Inherited from SystemConstants: channelWidth, hasEsoRelease, hasOffsetPos, hasVarOrient, instrumentXnPix, instrumentYnPix

Properties [hide private]

Inherited from object: __class__

Method Details [hide private]

scpServer(light=True)
Static Method

source code 
Returns: str
The CASU scp server for processed data.

surveyFileGroups(_surveys='')
Static Method

source code 

Returns list of file groups for a database of the given surveys.

Parameters:
  • _surveys (str) - Survey acronyms as a space-separated string.
Returns: list(str)

Class Variable Details [hide private]

metadataTables

Database tables containing metadata to be populated by CU3.

Value:
['Multiframe',
 'MultiframeDetector',
 'CurrentAstrometry',
 'ProgrammeFrame']

serverRaidArray

A dictionary giving the file systems of each server.

Value:
{'djedefre': ['/disk10/wsa',
              '/disk11/wsa',
              '/disk12/wsa',
              '/disk13/wsa'],
 'djoser': [],
 'khafre': ['/disk14/wsa', '/disk15/wsa'],
 'khufu': ['/disk06/wsa', '/disk07/wsa', '/disk08/wsa', '/disk09/wsa']\
,
...

autoTemplateIndexSchema

Template schema for automated index scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/WSANS_templateIndice\
s.sql'

autoTemplateNeighboursSchema

Template schema for automated neighbour scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/WSA_autoTemplateNeig\
hboursSchema.sql'

autoTemplateSchema

Template schema for automated scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/WSA_autoTemplateSche\
ma.sql'

nsQcScript

Location to the script of quality control SQL statements for parsing.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/QualityControl/WSA_NonSurveyQC\
statements.sql'

scienceProgs

Programmes

Value:
{'DXS': 104, 'GCS': 103, 'GPS': 102, 'LAS': 101, 'UDS': 105}

casuFileSystem

List of disks where data is stored at CASU. Sorted in order of their

Value:
['/data/apm22_a/wfcam/processed',
 '/data/apm22_b/wfcam/processed',
 '/data/apm23_d/wfcam/processed',
 '/data/apm24_b/wfcam/processed',
 '/data/apm24_c/wfcam/processed',
 '/data/apm22_c/wfcam/processed',
 '/data/apm22_d/wfcam/processed',
 '/data/apm23_e/wfcam/processed',
...

casuFileSystemVariables

Letters and numbers that can appear in the CASU file system.

Value:
AlphaNum(name='wfcam', alpha='abcdef', num=[22, 23, 24, 44, 47])