Universidade de São Paulo Ins:tuto de Astronomia, Geofisica e Ciencias Atmosferica From the ASTRI/CTA ACTL prototype to CTA: a roadmap Gino Tos: University Perugia/INAF for the ASTRI Collabora:on & the CTA Consor:um 1
ASTRI/CTA Prototype Control System The ASTRI/CTA SST- 2M Control system is used for control and supervision ac)vi)es of all the Telescope subsystems. Mechanical Assembly Optical Assemblies User/Operator ASTRI/CTA Control System Camera Assembly Aux Assemblies Integrated Approach: Science+hardware+soOware About 50 people involved 2
The Approach ASTRI MASS SW Design Top Down: q The ASTRI SST- 2M Prototype: Reference Guide to the Opera)onal Procedures ; q ASTRI Opera)on Modes and High- level User Requirements ; q ASTRI MASS Use Cases; BoQom Up: ü SoOware prototype to monitor and control hardware components; ü ALMA sooware components refactoring and reuse ; ü ACS component prototypes; ü High level component interfaces; ü Data challenges See Vito s Poster 3
ASTRI/CTA Prototype and Pre- produc)on Array Control System The Industrial Control System Pyramid (SCADA/DCS/PLC) Alma Common sotware for the higher level systems OPC- UA for the control of the Hardware Devices 4
Alma Common SoTware (ACS) Infrastructure ACS uses CORBA as middleware and provides: Applica)on communica)on handling: Event Handling: Command: Logging: Persistent Store: Error/Alert Handling: ACS uses the Container/component paradigm Component Component Container 5
SW Architecture: Packages view In the last two decades there was a convergence in the design of the top level architecture of the sooware systems to be used in modern Op)cal/IR observatories (ESO, Gemini, etc). ASTRI CTA/prototype is following the same philosophy with some variants derived from Radio observatory control systems like that used in ALMA. OCS, TCS and ICS control: User Access, Opera)on Modes, Observa)on Modes, etc. DHS (or Data Management System): record, access, display science data and metadata, manage on- site pipelines and produce data quality indicators 6
The ASTRI/CTA Prototype SW Building blocks Off- site Archive Off- site Data Analysis Proposal managment Data/proposal Access Tools DATA/OBS On- site Data Analysis Data Handling System (DHS) OCS Operator/Scien:st GUI ACTL On- Site Repository Obs Access TMCDB Access Scheduler Configurator Coordinator Sequencer Resource manager Observing Modes Obs DB Data Capturer Monitoring Alarm Logger TMCDB SciTech0 Control Devices Science data DAQ Instrument Control System (ICS) Telescope Control System (TCS) Calibra:on/ Auxiliary Control System ICT/Power Control ACTL/DATA/OBS LOCAL Control Camera Server OPC- UA Camera TELESCOPE AMC MCS PMC Safety/Interlocks/Power/Networking Calibra:on Metrology Weather Aux Telescope/COM/ INFRA ICT/ Power 7
The ASTRI/CTA Prototype Logical view D A T A C O M M A N D S 8
The main observing flow of opera)ons 1. The operator user, through a GUI, asks the next NSO iden)fier to the scheduler; 2. The Scheduler uses the DHS to retrieve the NSO iden)fier from the DB; 3. The Scheduler through the Resource Manager (which is supported by the DHS) checks that all needed components are ready for data taking tasks; 4. The Scheduler aoer the compa)bility check of the NSO id and the system status, returns to the operator GUI the id of NOS which is being started; 5. The Scheduler calls the Sequencer to start the iden)fied NOS; 6. The Sequencer takes needed informa)on from the DHS through the NSO iden)fier received by the scheduler (telescopes requested, telescopes available, system status etc.). The sequencer also uses the Command Library to retrieve all tasks which shall be executed to run the required NSO; 7. The Sequencer interacts with the Telescope Controller and the Camera Controller in order to execute the data taking. 8. The acquired data and metadata are sent to the DHS; 9. The DHS no)fies the end of the observa)on to the on site DB ; 10. Data are available to the remote user through a web server; 9
Sub- packages func)ons: Use Cases See Vito s Poster 10
ALMA SoOware Reuse: What is Ongoing ALMA- ASTRI- DESY Agreement Exploit similari)es with ALMA, beyond ACS Agreement for sharing code: Download & build all ALMA sooware Mimic ALMA high- level control sooware design (CONTROL) Controller / Hardware device hierarchy Code generate device drivers, configura)ons Python- based Command Control Language TMCDB etc ALMA monitoring system Scalable ingest of sensor data (~1000 points/telescope) ALMA electronic logbook (ShiO Log Tool) etc 11
ALMA SW Por)ng (GUI, other tools) 12
ALMA Control por)ng MASTER Component Observing Modes Script Executor Telescope Weather Controller Camera Slow Control MOUNT Device Driver Hardware Device Weather Sta:on Gino Tos) - MASS Mee)ng - Bologna, 2-4 Feb 2015 13
ALMA Control por)ng MASTER Component Array Weather Controller Observing Modes Script Executor Telescope Camera Slow Control MOUNT Device Driver Hardware Device Weather Sta:on Gino Tos) - MASS Mee)ng - Bologna, 2-4 Feb 2015 14
Dual- Consumers Hyerarchical model Hardware Science Array level telescope level 15
CONTROL Overview 16
Devices Integra)on: Telscope- control Interfaces (ICDs) Instrument Control System Telescope Control System Calibra)on/Auxiliary Control System DAQ OPC- UA Client OPC- UA Client OPC- UA Client OPC- UA Client OPC- UA Client OPC- UA Client ICD ICD ICD ICD ICD ICD ICD OPC- UA Server OPC- UA Server OPC- UA Server OPC- UA Server OPC- UA Server OPC- UA Server Camera AMC Mount Weather Aux ICT/Power For any other ASTRI subsystem, an Interface Control Document (ICD) was product. From each ICD an Excel spreadsheet that summarizes all commands and configura)on of the server OPC- UA has been extracted. 17 CTA Collabora)on Mee)ng, Catania 2014 ACTL Parallel Session 22/09/2014
Hardware Device Sw: Code Generator implenta)on ICD Ready Debug / next slide Under Development The same concept as in ALMA is under development with different template engines both in python and Java 18
ASTRI Auxiliary OPC- UA Control SoTware Weather Sta:on (WS) - Davis Vantage Pro2 wireless. PLUDIX (PDX) is a small radar able to detect dust par)cles falling. Rain Sensor (RNS) to detect quickly the presence of rain All Sky Camera (ASC) to measure the percentage of cloud cover Environmental Detec:on Devices Electric Fiel Meter (EFM) to detect the presence of lightning Sky Quality Meter (SQM) to measure the night sky brightness. Poin:ng Model Camera (PMC) to recognize the field pointed to by ASTRI Poin:ng tool UVscope (UVM) to measure the Night Sky Background (NSB) Calibra:on Devices UVSiPM (UVS) is a light detector in the 320-900 nm range. - List of auxiliary instruments of ASTRI E. Antolini University of Perugia 9th ASTRI Collabora)on Mee)ng Bologna, 23-25 February 2015 (P. Bruno) 19
ASTRI Auxiliary OPC- UA Control SoTware Excel Table Python macro ServerTable P. Bruno ASTRI_TEST_Server O P C - U A I n t e r f a c e An OPC- UA server, named "ASTRI_TEST_Server" for tes)ng and simula)on purposes has also been realized. This server accepts as line argument an ASCII "ServerTable", extracted from the Excel spreadsheet by a python macro, to generate a standard OPC- UA interface. In this way, you may obtain an OPC- UA server simulator for each device ASTRI. Run: Java jar ASTRI_TEST_Server c ServerTable.txt Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015 20
Scrip)ng Langauge: ALMA CCL Por)ng started The Control Command Language (CCL)CCL is a language for accessing the Control sooware using a very simple Python wrapper, so it is considered a high- level scrip)ng language. Each device control component (wriren in C++) has an associated Python wrapper, being a part of the CCL libraries. CCL has two main func)ons: Serve as the language observing scripts are wriren in. Serve as a suite of interac)ve commands to be used by hardware engineers, tes)ng or debugging equipment, or staff astronomers, developing new observa)on procedures. 21
Telescope- Science interface: Data Capturer por)ng is star)ng 22
Where we are: Cantrol main pachages adapted
ASTRI Camera DAQ The logical model of the Camera DAQ software for the AIV/ AIT and operation phases of the ASTRI Camera on the ASTRI SST-2M Prototype at SLN Observatory V.Confor) INAF IASF Bologna 9 ASTRI Collabora)on Mee)ng Bologna, 23 25 Feb 2015 24
ASTRI Camera DAQ The logical model for the AIV/AIT and operation phases of the ASTRI Camera on the ASTRI/CTA Pre-Production at the CTA site to be deployed on the Camera Server interfaces to external components still to be assessed V.Confor) INAF IASF Bologna 9 ASTRI Collabora)on Mee)ng Bologna, 23 25 Feb 2015 25
ALMA TMCDB Por)ng: Almost done TMCDB modules: the Star)ng point for the current update ACS/CommonSoOware/codegen Grammar for defining DB, genera)ng SQL for HSQLDB & Oracle, Hibernate mapping strategy ACS/CommonSoOware/cdb_rdb «interface» DAL «ACSComponent» ControlDev ice Generic/soOware part of TMCDB defined, DAL classes implemented ARCHIVE/TMCDB/Database (& others) «ACSComponent» TMCDBComponent «ACSService» HibernateWDAL «ACSComponent» MonitorCollector Hardware part of TMCDB defined, POJOs generated w/annota)ons ICD/SharedCode/TMCDB/Persistence TMCDBExplorer «ACSComponent» Controller «ACSComponent» Blobber Hand- wriren POJOs subs)tuted for generated ones; cloning and history maintenance func)onality added PopulationTools ICD/SharedCode/TMCDB/U)ls Database U)li)es for popula)ng TMCDB from XML, ASCII ICD/SharedCode/TMCDB/Access IDL- defined remote access I/F and implementa)on ICD/SharedCode/TMCDB/tmcdb- explorer Eclipse RCP- based GUI for working with database 26
TMCDB: Code genera)on ported and running Maintain a global configura)on Maintain HW calibra)on model (not Science) Synchronize HW configura)on (Assembly XML documents) with data from HW team Report current configura)on (M. Cefalà) The TMCDB table DDL are captured in a genera)on framework This file is used to generate a SQL file for Oracle or HSQLDB The SQL file creates the table An OO API to access the TMCD is constructed using the Hibernate framework CORBA IDL interface and an ACS Component allow CORBA clients to access the TMCDB Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015
TMCDB: Monitoring (Angelo s talk) CONTAINER 1 Component 1 - - - - - Component 2 - - - - -. Component n - - - - - Monitor Collector CONTAINER 2 Component 1 - - - - - Component 2 - - - - -. Component n - - - - - Monitor Collector CONTAINER n BLOBBER n Monitor Controller MySQL DB One simple table ()mestamp, value) per monitor value Blobber releases monitoring data once per minute 1 Monitor Controller for the whole system Blobbers are not dynamical but sta)cally configured Separate mechanisms to provide TECH data to science pipelines (V. Testa- A. di Paola) Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015
ALMA Operator Tool:ShiO ShiO Log Tool The Shift Log tool (SLT) has been designed for recording and maintaining the history of all the observing activities at the ALMA Observatory. Record logging problems during the observations. Record the summary of the engineering activities of the day. Produce different kind of reports for communication and coordination between ALMA astronomers and array operators. Entries search and Command-line query for the shiftlog database. (F. Russo) Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015 29
ALMA Operator Tool:ShiO Log Tool Snap shot of the tool: Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015 30
The ASTRI SST- 2M ICT Infrastructure Monitoring To ensure the necessary level of availability and reliability of ICT infrastructure a good monitoring, control and alarm system is needed. This system must be well designed, easy to use and always updated. This is why we are trying to integrate the various tools provided by the technology adopted it SLN Server Room in a single web interface With this interface, we are able to monitor all most important parameters like: CPU Load Used Memory Disk space Temperatures Ac)ve Job and Users Network traffic etc In addi)on we are developing a control interface that allows us to act remotely to solve problems that are cause for alarm. Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015 31
The ASTRI MASS SoTware Test Bed The ASTRI/CTA Mini- Array SoOware System (MASS) to operate the ASTRI- SST- 2M Prototype has been designed in view of the ASTRI/CTA Mini- Array. This led to a scalable and distributed architecture where the sooware has to be deployed and run on more that 10 computers located on- site at the INAF Serra La Nave (SLN) Observatory. The ASTRI SoOware Test Bed is conceived as the tool which allows to test the MASS sooware both in the early stages of the development before deployment on the target hardware, and in the opera)onal phase where any changes to the sooware can not be easily tested on the telescope. HW Schema SW Schema IASFBO OVM system AUTH. LDAP astriacs01.giano.iaszo astri01.iaszo.inaf.it HOME OVMMAN astriacs0n.giano.iaszo DATA san01.giano.iaszo Public LAN iaszo.inaf.it OVMS1 Management LAN OVMS3 NEW! Public LAN SAN HA ISCSI Storage NEW! Gino Tos) - ASTRI Collabora)on Mee)ng - Bologna, 23-25 Feb 2015 Priv. LAN giano.iaszo We are going to create this infrastructure at INAF IASF Bologna by means of a virtualiza)on system which provides a virtual machine for each physical server installed at SLN and reproduces as much as possible the actual environment where the MASS sooware will be operated. The hardware configura)on is based on 3 server nodes, a storage unit and a control PC. The virtualiza)on sooware is the Oracle VM Na)ve or Bare Metal. It is a professional product which is provided for free for such a small systems, and is capable of running more than 20 Virtual Machines, ensuring excellent performance and reliability. 32
Summary Based on accurate reuse of exis)ng sooware and tools we have a preliminary architecture for the management of the hardware part of the Prototype and possibly for the pre- produc)on mini- array. This approach will be discussed at the next ACTL OPS and SLOW mee)ng in Berlin. 33
Thank you 34