Package wsatools :: Module SystemConstants :: Class VsaConstants
[hide private]

Class VsaConstants

source code


Constants with specific values for the VSA.

Instance Methods [hide private]

Inherited from object: __delattr__, __format__, __getattribute__, __hash__, __init__, __reduce__, __reduce_ex__, __repr__, __setattr__, __sizeof__, __subclasshook__

    CASU data transfer constants

Inherited from SystemConstants: scpMainDir, scpMethod, sshMethod

    Pixel server common directories

Inherited from SystemConstants: downloadPathList

    FITS file naming conventions

Inherited from SystemConstants: extListOfType, productTypeOfFrame, wfauFitsKeys

    Convenience methods

Inherited from SystemConstants: __str__, isGES, isOSA, isSSA, isVSA, isWSA

    Getter methods

Inherited from SystemConstants: calibrationSchema, curationSchema, dbMntPath, ingestListsPath, ingestedFilesPath, ingestedLogsPath, metadataSchema, wcsErrorFilesPath

    Software directory structure

Inherited from SystemConstants: calibrationDir, cambInfoPath, corruptFilesPath, filterDataDirPath, filterRefDataDirPath, illuminationDir, logFilePath, missingFilesFilePath, monitorPath, nonSurveyRegPath, tempWorkPath, xferLogPath

    Pixel server directory structure

Inherited from SystemConstants: availableRaidFileSystem, excludedRaidFileSystem, leaveSpaceOnMSRFS, massStorageRaidFileSystem

    Permanent curation log file paths

Inherited from SystemConstants: filesBrokenPath, filesDuplicatedPath, filesMissingPath, filesNotIngestedPath

    Web site constants

Inherited from SystemConstants: surveyBaseUrl, surveyJspBaseUrl

Static Methods [hide private]
    CASU data transfer constants
str
scpServer(light=True)
Returns: The CASU scp server for processed data.
source code
list(str)
surveyFileGroups(_surveys='')
Returns list of file groups for a database of the given surveys.
source code
    FITS file naming conventions

Inherited from SystemConstants: fileNameSuffices, frameTypeToSuffix

    Initialiser

Inherited from SystemConstants: __new__

    Getter methods

Inherited from SystemConstants: catServerVolumes, dbSharePath, getAll, getServerName

    Software directory structure

Inherited from SystemConstants: casuCodePerlPath, curationCodePath, emptyFitsCataloguePathName, helpersPath, privNetCmd, sExtractorInputsPath, sourcePosTablesPath, sqlFragmentPath, sqlMonthlyDetPath, sqlNonSurveyPath, sqlQualityControlPath, sqlTemplatePath, testOutputPath

Class Variables [hide private]
    Catalogue server constants
  loadDatabase = 'VSA'
Name of load database.
  loadServer = 'ramses9'
Name of load server.
  ingestDbForServer = {'ramses14': 'VSAVVV', 'ramses9': 'VSA'}
Dictionary of ingest database names on each server for split ingest dbs.
  metadataFileGroups = []
Additional database file groups beyond primary and logs for metadata.
  metadataTables = ['Multiframe', 'MultiframeDetector', 'Current...
Database tables containing metadata to be populated by CU3.
  nonSurveyDir = 'VSA-NonSurvey'
Default directory for non-survey db.
  obFiltDict = {'VVV': [('Z', 'Y'), ('J', 'H', 'Ks')]}
Dictionary of OB filter setup
  pixelServerHostName = ''
(Deprecated) This is appended to fileNames in the database.
  publicServers = ['ramses3', 'ramses4']
List of public catalogue servers.

Inherited from SystemConstants: adminDatabase, catServerFileSep, catServerSharePath, clusterName, loadServerVolumes

    Pixel server file system
  casuPrefix = 'v'
Prefix for CASU produced FITS files.
  genOpsDisk = '/disk47/vsa'
Disk for general operations output (logs, info, ...).
  serverRaidArray = {'djedefre': [], 'djoser': [], 'khafre': [],...
A dictionary giving the file systems of each server.
  versFormat = '%.1f'
Format of versioning numbers.
  versStep = 0.1
Increments of versioning numbers.

Inherited from SystemConstants: criticalDisks, curationServers, deprecatedDataStorage, developDisks, infinibandServers, sysPath, userInterfaceTempStorage

    Software file system
  autoTemplateIndexSchema = '/neferefre/rsc/VDFS_branches/trunk/...
Template schema for automated index scripts.
  autoTemplateNeighboursSchema = '/neferefre/rsc/VDFS_branches/t...
Template schema for automated neighbour scripts.
  autoTemplateSchema = '/neferefre/rsc/VDFS_branches/trunk/sql/T...
Template schema for automated scripts.
  autoTemplateViewSchema = '/neferefre/rsc/VDFS_branches/trunk/s...
Template schema for automated view scripts.
  indexScript = 'VSA_Indices.sql'
File name for the SQL script defining table indices.
  nsIndexScript = 'NonSurvey/VSANS_Indices.sql'
File name for the SQL script defining non-survey table indices.
  nsQcScript = '/neferefre/rsc/VDFS_branches/trunk/sql/QualityCo...
Location to the script of quality control SQL statements for parsing.
  surveyProcScript = 'VSA_PS_StoredProcsAndFuncs.sql'
Script for survey procedures and functions for all databases.
  surveyViewScript = 'VSA_PS_Views.sql'
File name for the SQL script defining survey views.
    Survey data constants
  amStart = 'HIERARCH ESO TEL AIRM START'
Airmass start value keyword in FITS HDU.
  amEnd = 'HIERARCH ESO TEL AIRM END'
Airmass end value keyword in FITS HDU.
  casuCatType = 6
CASU catalogue type.
  casuDetThresh = {1: 1.25}
CASU detection threshold dict(nustep,sigma)
  expTimeKeyWord = 'EXPTIME'
EXPTIME header keyword
  fieldOfView = (1.2921, 1.0173)
Size of the field of view x and y (tuple)
  fieldOfViewTile = (1.4753, 1.0173)
Size of the field of view x and y (tuple) TILE >= 2x exposure
  hduNumKey = 'HIERARCH ESO DET CHIP NO'
Name of HDU number fits key
  instrumentName = 'VIRCAM'
Name of the instrument
  instrumentPixScale = 0.339
Standard pixel scale of instrument
  manualProgs = []
List of programmeIDs of programmes which are manually set up.
  monthlyDetSurveys = [120]
List of programmes that need monthly detection tables
  maxHDUs = 17
Maximum number of extensions
  maxRaDecExtentStackDeg = 0.068
Maximum ra or dec separation for stacks in a group for deep stacking
  minRaDecExtentStackDeg = 0.017
Minimum ra or dec separation for stacks in a group for deep stacking
  obsCal = VistaCal()
Observation dates for the survey.
  pawPrintArea = 0.598
Pawprint area in degrees
  phtErrLimit = 0.02
Photometric zero-point error limit that necessitates recalibration.
  pointingKeys = ['RA', 'DEC', 'HIERARCH ESO INS FILT1 NAME']
Pointing keys to check
  productTypes = ['stack', 'tile', 'mosaic']
Product types
  projectKeys = ['HIERARCH ESO OBS PROG ID', 'HIERARCH ESO OBS N...
FITS header keys that identify the project.
  rCoreBasic = 3.0
Core radius ~ 1/instrument pixScale
  scienceProgs = {'ULTRAVISTA': 160, 'VHS': 110, 'VIDEO': 150, '...
Programmes
  scrunch = 4
Pixel super bin size in JPEG rebinning process.
  surveyTranslations = {'179.A-2004': 'VIKING', '179.A-2005': 'U...
Known survey name translations of VISTA frames.
  telescopeName = 'VISTA'
Name of the telescope
  tileArea = 1.5008
Tile area / square degrees
  defaultPosAngleTolerance = 15.0
Default position angle tolerance / degrees
  xWidthTileDith = 12707
Width of undithered tile in x-dir: smallest nJitter=1 tile
  yWidthTileDith = 15593
Width of undithered tile in y-dir: could go smaller
  xWidthTileEar = 11776
Width of uneared tile in x-dir: detRows * (5.275 + 0.475)
    SExtractor
  defaultSexInparFile = 'defaultDetCatVsa.inpar'
Default sex inpar file.
    CASU data transfer constants
  casuFileSystem = ['/data/apm29_b/vista/processed', '/data/apm2...
List of disks where data is stored at CASU.
  casuFileSystemVariables = AlphaNum(name='vista', alpha='abe', ...
Letters and numbers that can appear in the CASU file system.
  casuIllumDir = '/data/apm35_a/vista/mike/photomtests/'
The directory where illumination tables are stored at CASU.
  scpPort = 22
The CASU scp server port number for processed data.
  hasMicroStep = True
has microstepping?
  hasVarOrient = True
has variable orientation
  hasOffsetPos = True
has offset positions
  hasEsoRelease = True
Has an ESO release?

Inherited from SystemConstants: ftp_method, rem_camlist_dir, rem_lock_name, rem_ready2copy_name, rem_success_name, scpThreads, scpUser

    Numerical constants

Inherited from SystemConstants: minNumCPUs, one_gigabyte, one_kilobyte, one_megabyte, sqlDataTypeSize

    Pixel server common directories

Inherited from SystemConstants: casu2massDir, compressImDir, deprecatedComprImDir, deprecatedDir, diffDir, downloadDir, esoExtDir, extProdDir, fitsDir, headerDir, listDrivDir, mosaicDir, productLogDir, productsDir, stackDir, swarpDir, tempProductsDir, tileDir

    FITS file naming conventions

Inherited from SystemConstants: biasPrefix, catSuffix, catType, confSuffix, cpmSuffix, darkPrefix, deepSuffix, diffSuffix, filtPrefix, filtSuffix, fixcatSuffix, flatSuffix, frameTypes, fringeSuffix, jpgType, leavSuffix, listSuffix, mefType, mjdSuffix, mosaicSuffix, pregrtSuffix, simpleSuffix, skyPrefix, stackSuffix, tileSuffix, uncType, wfauPrefix

    Software file structure

Inherited from SystemConstants: cirdrShellScript, emptyFitsCatalogueFileName, procScript, sqlScriptPath, srcPath, webDocsPath

    Synoptic syntax constants

Inherited from SystemConstants: bthSubStr, corSubStr, uncSubStr, varSubStr

    Common instrument properties

Inherited from SystemConstants: channelWidth, instrumentXnPix, instrumentYnPix

Properties [hide private]

Inherited from object: __class__

Method Details [hide private]

scpServer(light=True)
Static Method

source code 
Returns: str
The CASU scp server for processed data.

surveyFileGroups(_surveys='')
Static Method

source code 

Returns list of file groups for a database of the given surveys.

Parameters:
  • _surveys (str) - Survey acronyms as a space-separated string.
Returns: list(str)

Class Variable Details [hide private]

metadataTables

Database tables containing metadata to be populated by CU3.

Value:
['Multiframe',
 'MultiframeDetector',
 'CurrentAstrometry',
 'ProgrammeFrame',
 'MultiframeEsoKeys',
 'MultiframeDetectorEsoKeys']

serverRaidArray

A dictionary giving the file systems of each server.

Value:
{'djedefre': [],
 'djoser': [],
 'khafre': [],
 'khufu': [],
 'osorkon': [],
 'pami': ['/disk32/vsa'],
 'pami2': ['/disk33/vsa'],
 'pedubaste1': ['/disk37/vsa'],
...

autoTemplateIndexSchema

Template schema for automated index scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/VSA_autoTemplateIndi\
ces.sql'

autoTemplateNeighboursSchema

Template schema for automated neighbour scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/VSA_autoTemplateNeig\
hboursSchema.sql'

autoTemplateSchema

Template schema for automated scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/VSA_autoTemplateSche\
ma.sql'

autoTemplateViewSchema

Template schema for automated view scripts.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/Templates/VSA_autoTemplateView\
s.sql'

nsQcScript

Location to the script of quality control SQL statements for parsing.

Value:
'/neferefre/rsc/VDFS_branches/trunk/sql/QualityControl/VSA_NonSurveyQC\
statements.sql'

projectKeys

FITS header keys that identify the project.

Value:
['HIERARCH ESO OBS PROG ID',
 'HIERARCH ESO OBS NAME',
 'HIERARCH ESO DPR CATG']

scienceProgs

Programmes

Value:
{'ULTRAVISTA': 160,
 'VHS': 110,
 'VIDEO': 150,
 'VIKING': 140,
 'VMC': 130,
 'VVV': 120}

surveyTranslations

Known survey name translations of VISTA frames.

Value:
{'179.A-2004': 'VIKING',
 '179.A-2005': 'UltraVISTA',
 '179.A-2006': 'VIDEO',
 '179.A-2010': 'VHS',
 '179.B-2002': 'VVV',
 '179.B-2003': 'VMC',
 '60.A-9253(N)': 'COMM',
 '60.A-9285(A)': 'SV-NGC253',
...

defaultSexInparFile

Default sex inpar file. Modelled on Victoria's VIDEO inpar file.

Value:
'defaultDetCatVsa.inpar'

casuFileSystem

List of disks where data is stored at CASU. Sorted in order of their

Value:
['/data/apm29_b/vista/processed',
 '/data/apm29_a/vista/processed',
 '/data/apm44_b/vista/processed']

casuFileSystemVariables

Letters and numbers that can appear in the CASU file system.

Value:
AlphaNum(name='vista', alpha='abe', num=[29, 44, 49, 50])