![Page 1: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/1.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 1
EVLA Overall Software Design
Final Internal Review
Subsystems II
by Tom Morgan
![Page 2: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/2.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 2
Outline
• Monitor and Control
• AMCS, CMCS
• Online Analysis
• TelCal
• Quick-Look Pipeline
• Data Capture and Format
• Offline Data Reduction
![Page 3: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/3.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 3
Major EVLASoftware
Subsystem
Permanent DataStore (Database
or Archive)
SubsystemComponent orIndependent
Function
Information Flow
Bulk Data Flow
Data Entity
Color Code Key
Color Code Key
![Page 4: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/4.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 4
Monitor and Control
• Large Number of External Connections
• Connections with Many other Subsystems
• Wide Range of Data Volumes
• Wide Range of Data Types
• Wide Range of Communication Patterns and Frequencies
![Page 5: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/5.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 5
Monitor and Control
Monitor and Control
ExecutorUser
InterfaceScheduler
Monitor DataArchive
Science DataArchive
TelCal
QLP
DCAF
TelescopeSystem
ConfigurationDatabase
Alarm andAlert Facility
![Page 6: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/6.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 6
Online Monitor and Control
• Focus on Connections with other Online Components
• Manual Control from the User Interface
• Automatic Control via Scheduler and Executor
• Feedback to Executor and Scheduler
![Page 7: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/7.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 7
Online Monitor and Control
Monitor and Control
ExecutorUser Interface
SchedulerDCAF
Requests:Monitor Data,
SystemsParameters,
System Status,State Change
ControlMessages
EquipmentState
EquipmentState
RequestsMetadata
MonitorData,
SystemParameters,
SystemStatus
ControlMessages
Manual Automatic
EquipmentState
Requests
EquipmentState
Alarm andAlert Facility
Errors andWarnings
![Page 8: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/8.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 8
M&C Permanent Store
• Continuous Output of Monitor Data to the Monitor Data Archive
• Updates of Data Essential to Real-Time Operations
• Retrieval of Data Essential to Real-Time Operations
![Page 9: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/9.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 9
M&C Permanent Store
Monitor and Control
Monitor DataArchive
TelescopeSystem
ConfigurationDatabase
MonitorData
Properties
![Page 10: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/10.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 10
M&C High Volume Data
• Direct Feed of Raw Output from the Correlator Backend
• Primary Route is to Science Data Archive
• Copy Forked to TelCal when needed
• Copy Forked to QLP when needed
![Page 11: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/11.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 11
M&C High Volume Data
Science DataArchive
TelCal QLP
Raw CBEOutput
Monitor and Control
CMCS
CBE WIDAR
VCI
ControlMessages
![Page 12: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/12.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 12
Antenna Control
• Antenna Objects for a Single Sub-array
• Antenna Objects Receive Control Messages from the Executor
• Antenna Objects form and transmit individualized Control Messages to the MIBs
![Page 13: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/13.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 13
Antenna Control
M&C
AMCS
AntennaObject
ControlMessages
MIB MIB MIB
AntennaObject
AntennaObject
MIB SpecificControl Messages
. . .
. . .
![Page 14: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/14.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 14
Online Data Analysis
• Flagging
• RFI Detection and Excision
• Atmospheric Modeling
• Complex Gain
• Pointing Offsets
• Focusing Offsets
• CBE Processes
![Page 15: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/15.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 15
Flagging
• Needed by TelCal, QLP, Offline Data Reduction, and Operations
• Needs monitor data and desired Antenna state
• Generated once every Correlator Dump (for VLA)
• Sent to DCAF
• Located in Executor (?)
![Page 16: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/16.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 16
Flags Array
Cause
Antenna
IF
Severity Level(e.g., 0 - 15)
![Page 17: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/17.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 17
QLP
• Just enough DR to Display Spectra and Produce “Dirty” Images
• Triggered from DCAF when Sufficient Data is available
• Visibility Data comes directly from CBE
• Visibility Data could come from Science Archive if timely delivery is possible
![Page 18: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/18.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 18
QLP
QLP
Raw CBEOutput
Monitor and Control
CMCS
CBE WIDAR
VCI
ControlMessages
DCAF
Images andSpectra
ScienceModel in
EDFTrigger
![Page 19: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/19.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 19
DCAF
• Capture and combine Metadata from a number of sources
• Organized data into hierarchy of Integrations, Sub-scans and Scans for each Execution Block
• Associate data from different Integrations, Sub-scans, Scans and Execution Blocks based on time tags
• Reformat for external use
![Page 20: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/20.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 20
DCAF
DCAF
ExecutorScheduler
CMCS
Monitor and Control
AMCS
“Pointers” to Raw CBEOutput, CBE OutputHeaders, Correlator
Command Information
Project andSchedulingInformation
ExecutionInformation
Antenna ControlInformation, Weather
Data, EquipmentState
ScienceData
Archive
ScienceModel in
EDF
QLP
Trigger,ScienceModel in
EDF
TelCal
Metadata
![Page 21: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/21.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 21
DCAF
ArchiveCBE
M&C
CMCS
Sub-Scan 1
Sub-Scan 2
Scan N
. . .
Integration 1Integration 2
Integration m
Integration 1
Integration 1
Integration 2
Integration 2
Integration m
Integration m
. . .. . .
. . .. . .Metadata
Metadata
Metadata
FromExecutor
FromScheduler
. . .
Integration 1Integration 2
Integration m
. . .
Sub-Scan 3
Scan 1
. . .
Sub-Scan M
Metadata
ExecBlock 1
DCAFTime
CorrelationResults
Pointers to Correlation Results
![Page 22: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/22.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 22
DCAF
Baseline Number
Polarization ProductNumber
Integration Number
First (earliest) Time Stamp(Double precision - occupies two slots)
Last (latest) Time Stamp(Double precision - occupies two slots)
Sub-band Number
Unused
FFT Flag (0 = Lags, 1= Spectra)
0
1
2
3
4
5
6
7
8
9
10
11
12
13
15
14
Data Valid Flags16
17
Unused
Unused
18
Adjusted Time Stamp(Double precision - occupies two slots)
19
Baseband Number
Number of Lags or Spectral Channels
Unused
Unused
Unused
CBE MetadataWord
![Page 23: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/23.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 23
TelCal
• Homeless Function
• High volume data input from CBE
• Complex Gains
• Stored Complex Gains used for Pointing and/or Focus determinations
• Pointing Offsets
• Focus Offsets
![Page 24: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/24.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 24
TelCal(Integration Level)
TelCal(Complex Gains - May be stored internally as well)
DCAF
CMCS / CBE
Monitor and Control
AMCS
Raw CBE Output
Calibrator andFlagging Information,
Frequency BandsComplex Gains
Executor
Complex Gains
![Page 25: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/25.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 25
TelCal(Scan Level)
TelCal(Pointing / Focus Offsets)
DCAF
Pointing /Sub-reflector
Positions
Stored ComplexGains
Executor
Pointing Offsets/ Sub-reflector
Corrections
![Page 26: 14 June, 2004 EVLA Overall Design Subsystems II Tom Morgan 1 EVLA Overall Software Design Final Internal Review Subsystems II by Tom Morgan](https://reader036.vdocuments.site/reader036/viewer/2022062320/56649f595503460f94c7ebf7/html5/thumbnails/26.jpg)
14 June, 2004
EVLA Overall DesignSubsystems II
Tom Morgan 26
Offline Data Reduction
• Offline Data Reduction Requirements provided in SSR
• DCAF will send output to Science Archive in Export Data Format required by the Archive
• Data Reduction packages will access the Archive