CDS DS3 Cycle 5 report

Size: px

Start display at page:

Download "CDS DS3 Cycle 5 report"

Annabella Williamson
8 years ago
Views:

1 VOTECH meeting Edinburgh, 8-11 October 2007 CDS DS3 Cycle 5 report Workflow a sequence of tasks executed within a controlled context by an architecture taking into account VO standards A. Schaaff Journée VOTECH Calculs meeting, et Données Edinburgh distribués

context by an architecture taking into account VO standards A.

2 Schedule 2 2 Report VO France Workflow WG work, A. Schaaff Development of a workflow plugin for Aladin based on JLOW, Demo, C. Pestel Packaging of AÏDA/JLOW, Quick view of a use case in action, C. Pestel JLOW AÏDA Java Libraries for Workflow Astronomical Image processing Distribution Architecture

Pestel Packaging of AÏDA/JLOW, Quick view of a use case in action, C.

3 Reminder 3 3 Goals of the VO France Workflow working group Definition of use cases in different domains (image, spectrum, data mining, ) Test and improvement of these use cases with tools Suggestion of solutions for designing and exploiting easily such workflows Workflow structures Identification of the simplest workflow structures allowing portability Definition of elementary bricks CDS role Lead of the WG Helping to reach these goals and to take into account IVOA standards Relation with IT people (Grid5k, EGEE, etc.)

workflows Workflow structures Identification of the simplest workflow structures allowing portability Definition of elementary

4 AÏDA as a workflow test bed 4 4 AÏDA architecture F. Bonnarel, M. Louys, A. Schaaff CDS & LSIIT AÏDA developments J. Beugnot, packaging J.-J. Claudon, core development G. Mantelet, characterization C. Pestel, JLOW - design capabilities CDS Hyper spectral image Other clients Genetic algorithm reduction Reduced Aladin, image Web Services (SOAP), Segmentation Segmentation map AÏDA workflow engine AÏDA Access methods Image processing tasks Genetic Colored algorithm Segmentation representation Module N+1 Module N+2 reduction tool AÏDA client Colored representation tool Colored image Computing resources Local or remote execution

Pestel, JLOW - design capabilities CDS Hyper spectral image Other clients Genetic algorithm reduction Reduced Aladin, image Web Services (SOAP), Segmentation

5 5 5 Some use cases to illustrate the work

6 Image processing 6 6 operation detection and evaluation of related objects in 1 band image subjacent model diffuse disjoined tasks in emission on a bottom slowly variable without defects method cartography of the background thresholding by segmentation adjustment of an ellipse of form evaluation of the azimuth profile of brightness calculation of measurements of form and flow Use case E. Slezak Observatoire de la Côte d Azur

7 and its implementation in AÏDA 7 7 Use case E. Slezak Observatoire de la Côte d Azur See Cyril s demo

8 Simulation PDR code modelisation of diffuse clouds gives theoretical absorption spectra 2 - Stellar spectra databases provides synthetic stellar spectra F. Le Petit et al. Observatoire de Paris-Meudon 3 - FUSE database provides observations & PSF 4 - Compare directly models to observations (C. Martin-Zaïdi et al. 2006)

9 Data Mining 9 9 J. Berthier et al., IMCCE

10 Workflow builder plugin in Aladin 10 Based on JLOW C. Pestel T. Boch CDS See Cyril s demo

11 IVOA standards 11 Study how to involve the Characterization in the workflow process Not in the cycle 5 proposals but started in this cycle and proposed for the cycle 6 Cross work with DS6, see F. Bonnarel presentation

12 Workflow activities resume 12 07/ /2006, Masses de Données en Astronomie project in the frame of the French ministry : core development of the AÏDA architecture Since 2005, VO France Workflow Working Group : use case definition, tools (workflow engines, languages, ) study, collaboration with IT people, Since 2005, VOTECH DS3 : JLOW workflow design libraries development, report VO France Workflow WG work Related papers : Image Processing and Scientific Workflows in the Virtual Observatory Context, E. Slezak et al., IAU 2006 Implementing Astronomical Image analysis pipelines using VO Standards, M. Louys et al., IAU 2006 Workflow in Astronomy, the VO France Workflow Working Group experience, A. Schaaff et al., ADASS 2007 Participants and contributors to the VO France WG meetings Christophe Barache Obs. Paris-Meudon, Jérôme Berthier - IMCCE, Thomas Boch - CDS, Frédéric Boone - LERMA, François Bonnarel - CDS, Loïc Chevallier Obs. Paris-Meudon, Jean-Julien Claudon - CDS, André Csillaghy HES Switzerland, Bernard Debray - LAOB, Jean-Michel Desert - IAP, Pierre Didelon - CEA, Marie-Lise Dubernet Obs. Paris-Meudon, Anabela C. Goncalves - LUTH, Jesus Iglesias - IMCCE, Gaëlle Labourot - UVSQ, Martin France - CRAL, Franck Le Petit Obs. Paris, Pierre Le Sidaner Obs. Paris- Meudon, Mireille Louys - CDS-LSIIT, Guillaume Mella - LAOG, Areg Mickaelian BAO Armenia, Johan Montagnat - ESSI Sophia Antipolis, Nicolas Moreau - LERMA, Steven Morin - UVSQ, Jonathan Normand Obs. Paris-Meudon Cyril Pestel-CDS, Phlippe Prugniel Obs. Lyon, Fabrice Roy - LUTH, Lena Sargsyan - Yerevan State University, Alain Sarkissian - Service d'aéronomie, Renaud Savalle - Obs. Paris-Meudon, Eric Slezak, Obs. Nice, Christian Surace LAM, Françoise Tran Minh - LERMA Obs. Paris- Meudon, Frédéric Vachier IMCCE, Bruno Voisin - NUI Galway,

Workflow WG work Related papers : Image Processing and Scientific Workflows in the Virtual Observatory Context, E. Slezak et al.

Workflow in Astronomy, the VO France Workflow Working Group experience

Astronomical Data Analysis Software and Systems 2007 Workflow in Astronomy, the VO France Workflow Working Group experience André Schaaff, Observatoire de Strasbourg Franck Le Petit, Observatoire de Paris