Australian Virtual Observatory
|
|
- Bathsheba Warner
- 8 years ago
- Views:
Transcription
1 Australian Virtual Observatory International Astronomical Union GA 2003 Joint Discussion 08 17th-18th July 2003 Sydney David Barnes The University of Melbourne
2 Our take on virtual observatories bring legacy astronomy archives on-line and ensure future project compliance provide access to archived realisations of simulations and to resources for computing against new parameter sets describe data fully, and support a small and wellchosen set of interoperability protocols develop tools and interfaces to find, acquire, process and visualise data build national and international grids to host the data, tools and interfaces
3 Why we re involved Australian data archives are under-utilised, internationally and nationally. Common format data enables common tools: learn once, use many. Tools can be cross-wavelength, cross-paradigm (observed, simulated, ) It is a fair bet that VOs of some sort will be with us for some time, so we need to start learning about VO techniques in Australia. It is simply a Good Thing to do things The Same Way, where possible. We have expertise to offer in niche areas, eg. WCS, visualisation, spectral line surveys,
4 Aus-VO structure 2003 Phase A funded AUD 260K by a 2003 Australian Research Council grant: The University of Melbourne The University of Sydney CSIRO Australia Telescope National Facility Anglo-Australian Observatory Additional institutes participating w/o direct funding from the ARC grant: ANU, Mount Stromlo Observatory & APAC CSIRO Mathematical and Information Sciences University of Queensland VPAC & GridBus (Melb) Lead investigator Rachel Webster (Melb) Project scientist David Barnes (Melb)
5 Aus-VO projects 2003 Common format on-line archive projects: HIPASS catalog: HI Parkes All Sky Survey: neutral Hydrogen spectral line survey, 4,300 sources with ~30 parameters and 1024-channel spectra SUMSS catalog: Sydney University Molonglo Sky Survey: radio continuum survey at 843 MHz, 107,000 sources with ~15 parameters 2dFGRS QSO catalog: 2-degree Field Galaxy Redshift Survey: optical spectra of >20,000 southern quasi-stellar objects ATCA archive: Australia Telescope Compact Array archive: all observations since 1988, circa 1.5 TB of more than 1,000 separate observing projects! Substantial exercise in describing data with metadata. MACHO archive: Massive Compact Halo Objects archive: 8yr lightcurves for >18M stars
6 Aus-VO projects 2003 Server-based visualisation tools: client canvas for legacy software package AIPS++ to display to from a remote server (ATNF) grid-service implementation of distributed volume rendering - remote data transferred to remote cluster, with display and control applet supplied by coordinating portal Pipelines to enable on-line reprocessing of archived raw or pre-processed telescope data: Molonglo Observatory Synthesis Telescope ATCA archive thumbnail generator
7 Niche role: visualisation ATNF will build a webbased PixelCanvas so that AIPS++ visualisation apps can be deployed as Web- Service and Grid- Service Java Applets AIPS++ is modern, OpenSource software for reducing (radio) astronomy data, 1.6M lines of code.
8 Collaborative role: grid-based volume rendering With AstroGrid we have developed our existing distributed-data volume rendering code into a fully-fledged Grid-Service. [see the interactive demo at the IVOA stand of the Expo] render lines of sight through the entire volume - this is volume rendering and may offer new insights to complex data collections, images and catalogs.
9 Team effort! Collaborating groups now include Melbourne (Physics & CSSE Gridbus) AstroGrid(Cambridge, Leicester) VPAC, APAC, CSIRO CMIS, Jodrell Bank Observatory, Univ QLD, as data centres and rendering clusters Why? Saves you from fetching large data files Enables use of distributed computing resources Demonstrator of grid technologies for VOs
10 General future challenges & opportunities Data grid: replica catalogs done properly, bandwidth (esp. regional), certificate authority, virtual data grids?, Services for uploading user codes: is a sandbox needed?, compiler and library versions, is a cluster needed? Grid management - synchronising Globus, Tomcat, versions, legacy software, account names, geographical location, firewalls, - use MDS?
11 10 partners! 2004 ARC LIEF grant more data archives on-line theory realisations and codes on-line more tools developed with special focus on server-based visualisation construction of the Australian Astronomy Grid
12 The Australian Astronomy Grid 2004
13
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS)
ASKAP Science Data Archive: Users and Requirements CSIRO ASTRONOMY AND SPACE SCIENCE (CASS) Jessica Chapman, Data Workshop March 2013 ASKAP Science Data Archive Talk outline Data flow in brief Some radio
More informationLSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist
LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist DERCAP Sydney, Australia, 2009 Overview of Presentation LSST - a large-scale Southern hemisphere optical survey
More informationUsing the Parkes Pulsar Data Archive
JART http://www.jart.ac.cn Using the Parkes Pulsar Data Archive J. Khoo 1, G. Hobbs 1, R. N. Manchester 1, D. Miller 2, J. Dempsey 2 1 CSIRO Astronomy and Space Science, Australia Telescope National Facility,
More informationArchival Science with the ESAC Science Archives and Virtual Observatory
Archival Science with the ESAC Science Archives and Virtual Observatory Deborah Baines Science Archives and VO Team Scientist European Space Agency (ESA) European Space Astronomy Centre (ESAC) Science
More informationSoftware challenges in the implementation of large surveys: the case of J-PAS
Software challenges in the implementation of large surveys: the case of J-PAS 1/21 Paulo Penteado - IAG/USP pp.penteado@gmail.com http://www.ppenteado.net/ast/pp_lsst_201204.pdf (K. Taylor) (A. Fernández-Soto)
More informationVirtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010
Virtual Observatories Virtual Observatories 1%%&'&$#-&6!&9:#,*3),!#,6!6#$C!&,&$D2 *:#%&+-3;& D&);&-$2!!"! "!" &,&$D2 %),-&,-!"#$%&'&#()*! $#%&!(!!! $ '!%&$ $! (% %)'6!6#$C!;#--&$G $! '!!! $#63#-3),G $!
More informationMAST: The Mikulski Archive for Space Telescopes
MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives
More informationEuro-VO DCA. Board Meeting #1 Oct 2-3, 2006. Nic Walton for Mike Watson. CDS Strasbourg
Euro-VO DCA Board Meeting #1 Oct 2-3, 2006 Nic Walton for Mike Watson CDS Strasbourg AstroGrid AstroGrid: UK's Virtual Observatory Empowerment of scientists Improve the quality, ease, speed and cost effectiveness
More informationConstructing the Subaru Advanced Data and Analysis Service on VO
Constructing the Subaru Advanced Data and Analysis Service on VO Yuji Shirasaki on behalf of ADC National Astronomical Observatory of Japan Astronomy Data Center Contents Subaru Telescope and Instruments
More informationA New Data Visualization and Analysis Tool
Title: A New Data Visualization and Analysis Tool Author: Kern Date: 22 February 2013 NRAO Doc. #: Version: 1.0 A New Data Visualization and Analysis Tool PREPARED BY ORGANIZATION DATE Jeff Kern NRAO 22
More informationConcepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen
Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systems
More informationData Centre Alliance - Science
Data Centre Alliance - Science Mark ALLEN, Jonathan TEDDS & DCA IST Nov 2008 IST Internal Science Team Activities of the IST are being rounded off for end of project Coordinated by IST telecon IST: T2-DCA-IST
More informationThe Murchison Widefield Array Data Archive System. Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia
The Murchison Widefield Array Data Archive System Chen Wu Int l Centre for Radio Astronomy Research The University of Western Australia Agenda Dataflow Requirements Solutions & Lessons learnt Open solution
More informationOrganization of VizieR's Catalogs Archival
Organization of VizieR's Catalogs Archival Organization of VizieR's Catalogs Archival Table of Contents Foreword...2 Environment applied to VizieR archives...3 The archive... 3 The producer...3 The user...3
More informationNational eresearch Collaboration Tools and Resources nectar.org.au
National eresearch Collaboration Tools and Resources nectar.org.au NeCTAR is an Australian Government project conducted as part of the Super Science initiative and financed by the Education Investment
More informationBringing Big Data to the Solar System. Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling)
Bringing Big Data to the Solar System Paulo Penteado Northern Arizona University, Flagstaff (visiting David Trilling) pp.penteado@gmail.com http://www.ppenteado.net What is Big Data and why do we care?
More informationHow To Understand And Understand The Science Of Astronomy
Introduction to the VO Christophe.Arviset@esa.int ESAVO ESA/ESAC Madrid, Spain The way Astronomy works Telescopes (ground- and space-based, covering the full electromagnetic spectrum) Observatories Instruments
More informationObserver Access to the Cherenkov Telescope Array
Observer Access to the Cherenkov Telescope Array IRAP, Toulouse, France E-mail: jknodlseder@irap.omp.eu V. Beckmann APC, Paris, France E-mail: beckmann@apc.in2p3.fr C. Boisson LUTh, Paris, France E-mail:
More informationData Mining Challenges and Opportunities in Astronomy
Data Mining Challenges and Opportunities in Astronomy S. G. Djorgovski (Caltech) With special thanks to R. Brunner, A. Szalay, A. Mahabal, et al. The Punchline: Astronomy has become an immensely datarich
More informationData centres in the. Virtual Observatory. F. Genova, IVOA Small Project meeting, September 2006 1
Data centres in the Virtual Observatory F. Genova, IVOA Small Project meeting, September 2006 1 VO status (1) Many national projects Very different contexts/financing agencies A really world-wide, global
More informationSoftware Development for Virtual Observatories
Software Development for Virtual Observatories BRAVO Workshop February 2007 Rafael Santos 1 Warning! This presentation is biased. I'll talk about VO software development, including some under the hood
More informationAstrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research
Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,
More informationAn IDL for Web Services
An IDL for Web Services Interface definitions are needed to allow clients to communicate with web services Interface definitions need to be provided as part of a more general web service description Web
More informationThe Virtual Observatory in Action
The Virtual Observatory in Action VO drivers VO vision VO progress World AstroGrid VO Desktop demo Oxford erc Andy Lawrence Jan 2008 VO drivers : science science services several trends lead to science
More informationThe Future Astronomical Software Environment progress
Mem. S.A.It. Suppl. Vol. 13, 111 c SAIt 2009 Memorie della Supplementi The Future Astronomical Software Environment progress L. Paioro 1, B. Garilli 1, P. Grosbøl 2, D. Tody 3,4, C. Surace 5, T. Fenouillet
More informationMultidimensional Data in the Virtual Observatory
IX Reunión Científica de la SEA Madrid- 15/09/2010 Red Temática SVO Multidimensional Data in the Virtual Observatory José Enrique Ruiz Grupo AMIGA Instituto de Astrofísica de Andalucía CSIC Contextual
More informationData Management Plan Extended Baryon Oscillation Spectroscopic Survey
Data Management Plan Extended Baryon Oscillation Spectroscopic Survey Experiment description: eboss is the cosmological component of the fourth generation of the Sloan Digital Sky Survey (SDSS-IV) located
More informationExample application (1) Telecommunication. Lecture 1: Data Mining Overview and Process. Example application (2) Health
Lecture 1: Data Mining Overview and Process What is data mining? Example applications Definitions Multi disciplinary Techniques Major challenges The data mining process History of data mining Data mining
More informationLibraries and Large Data
Libraries and Large Data Super Computing 2012 Elisabeth Long University of Chicago Library What is the Library s Interest in Big Data? Large Data and Libraries We ve Always Collected Data Intellectual
More informationDAME Astrophysical DAta Mining Mining & & Exploration Exploration GRID
DAME Astrophysical DAta Mining & Exploration on GRID M. Brescia S. G. Djorgovski G. Longo & DAME Working Group Istituto Nazionale di Astrofisica Astronomical Observatory of Capodimonte, Napoli Department
More informationTHE US NATIONAL VIRTUAL OBSERVATORY. IVOA WebServices. William O Mullane The Johns Hopkins University
THE US NATIONAL VIRTUAL OBSERVATORY IVOA WebServices William O Mullane The Johns Hopkins University 1 What exactly is a WS? FROM http://dev.w3.org/cvsweb/~checkout~/2002/ws/arch/wsa/wd-wsaarch.html#whatisws
More informationDouglas Bock Assistant Director Operations ATUC, Oct 2011
ATNF Operations Douglas Bock Assistant Director Operations ATUC, Oct 2011 Today s program Operations focus! ATNF Operations Strategy Science Ops; Engineering Ops! Mopra observing statistics; impact; time
More informationA remote diagnostics system for the MERLIN array. D. Kettle, N.Roddis Jodrell Bank Observatory University of Manchester Macclesfield SK11 9DL
A remote diagnostics system for the MERLIN array D. Kettle, N.Roddis Jodrell Bank Observatory University of Manchester Macclesfield SK11 9DL 1. Introduction Jodrell Bank Observatory operates an array of
More informationHow To Understand The Architecture Of An Ulteo Virtual Desktop Server Farm
ULTEO OPEN VIRTUAL DESKTOP V4.0.2 ARCHITECTURE OVERVIEW Contents 1 Introduction 2 2 Servers Roles 3 2.1 Session Manager................................. 3 2.2 Application Server................................
More informationFor large geographically dispersed companies, data grids offer an ingenious new model to economically share computing power and storage resources
Data grids for storage http://storagemagazine.techtarget.com/magitem/0,291266,sid35_gci1132545,00.html by: Ray Lucchesi Storage Magazine Issue: Oct 2005 For large geographically dispersed companies, data
More informationThe Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory
The Virtual Observatory: What is it and how can it help me? Enrique Solano LAEFF / INTA Spanish Virtual Observatory Astronomy in the XXI century The Internet revolution (the dot com boom ) has transformed
More informationAustralian Research Collaboration Service (ARCS) & Grid Activities in Australia
Australian Research Collaboration Service (ARCS) & Grid Activities in Australia Prof Anthony Williams Executive Director Supported by: ARCS Mission The ARCS Mission is to enable and enhance research through
More informationA User s Guide to ALMA Scheduling Blocks (Cycle 3)
Doc 3.19, ver. 1 September, 2015 A User s Guide to ALMA Scheduling Blocks (Cycle 3) ALMA, an international astronomy facility, is a partnership of ESO (representing its member states), NSF (USA) and NINS
More informationEA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK
EA-ARC ALMA ARCHIVE DATA USER GUIDEBOOK Prepared by James O. Chibueze NAOJ Chile Observatory Purpose of this handbook: This handbook is aimed at providing fundamental information on how and where to access
More informationPRIME MINISTER S SCIENCE, ENGINEERING AND INNOVATION COUNCIL
PRIME MINISTER S SCIENCE, ENGINEERING AND INNOVATION COUNCIL TWELFTH MEETING 17 June 2004 AGENDA ITEM 4 EXECUTIVE SUMMARY Increasingly, Australian astronomy is generating an industry, whose world-class
More informationALMA Technical Support. George J. Bendo UK ALMA Regional Centre Node University of Manchester
ALMA Technical Support George J. Bendo UK ALMA Regional Centre Node University of Manchester Overview ALMA organisation and services Websites o Web portal o Helpdesk Documentation Software o CASA o Observing
More informationThe Astronomical Data Warehouse
The Astronomical Data Warehouse Clive G. Page Department of Physics & Astronomy, University of Leicester, Leicester, LE1 7RH, UK Abstract. The idea of the astronomical data warehouse has arisen as the
More informationCommentary on Techniques for Massive- Data Machine Learning in Astronomy
1 of 24 Commentary on Techniques for Massive- Data Machine Learning in Astronomy Nick Ball Herzberg Institute of Astrophysics Victoria, Canada The Problem 2 of 24 Astronomy faces enormous datasets Their
More informationDatamanagement at the European Southern Observatory: Strategies and Challenges. Michael Sterzik, ESO Datamanagement and Operations Division
Datamanagement at the European Southern Observatory: Strategies and Challenges Michael Sterzik, ESO Datamanagement and Operations Division European Southern Observatory - builds and operates state-of-the-art
More informationLecture 5b: Data Mining. Peter Wheatley
Lecture 5b: Data Mining Peter Wheatley Data archives Most astronomical data now available via archives Raw data and high-level products usually available Data reduction software often specific to individual
More informationThe Status of Astronomical Control Systems. Steve Scott OVRO
The Status of Astronomical Control Systems Steve Scott OVRO Astronomical Control System Status 10 years ago radio control systems were much more sophisticated than optical. Why? Single pixel detectors
More informationSoftware services competence in research and development activities at PSNC. Cezary Mazurek PSNC, Poland
Software services competence in research and development activities at PSNC Cezary Mazurek PSNC, Poland Workshop on Actions for Better Participation of New Member States to FP7-ICT Timişoara, 18/19-03-2010
More informationCluster, Grid, Cloud Concepts
Cluster, Grid, Cloud Concepts Kalaiselvan.K Contents Section 1: Cluster Section 2: Grid Section 3: Cloud Cluster An Overview Need for a Cluster Cluster categorizations A computer cluster is a group of
More informationAstronomical Data Analysis Software & Systems XVI
Astronomical Data Analysis Software & Systems XVI 15-18 October 2006 Tucson, Arizona, USA Events ADASS XVI Today Calendar Conference Schedule Meeting Program Recent News Birds of a Feather Banquet Conference
More informationand the VO-Science Francisco Jiménez Esteban Suffolk University
The Spanish-VO and the VO-Science Francisco Jiménez Esteban CAB / SVO (INTA-CSIC) Suffolk University The Spanish-VO (SVO) IVOA was created in June 2002 with the mission to facilitate the international
More informationAn Introduction to Globus Toolkit 3
An Introduction to Globus Toolkit 3 -Developing Interoperable Grid services 1 Outline Cornerstones New Concepts Software Stack Core Higher Level Services Developing and Using Grid Services Development
More informationGEOCOMPUTATIONS AND RELATED WEB SERVICES
GEOCOMPUTATIONS AND RELATED WEB SERVICES J. A. Rod Blais Dept. of Geomatics Engineering Pacific Institute for the Mathematical Sciences University of Calgary, Calgary, Alberta T2N 1N4 blais@ucalgary.ca
More informationHow To Migrate To A Network (Wan) From A Server To A Server (Wlan)
The Role of WAN Optimization in Infrastructures Josh Tseng, Riverbed SNIA Legal Notice The material contained in this tutorial is copyrighted by the SNIA. Member companies and individual members may use
More informationon the establishment of a Brazilian Science Data Center (BSDC) General Guidelines
on the establishment of a Brazilian Science Data Center (BSDC) General Guidelines 1 Introduction Since the entrance of Brazil in ICRANet a variety of projects have been started to be developed a) in the
More informationGalaxy Survey data analysis using SDSS-III as an example
Galaxy Survey data analysis using SDSS-III as an example Will Percival (University of Portsmouth) showing work by the BOSS galaxy clustering working group" Cosmology from Spectroscopic Galaxy Surveys"
More informationarxiv:1007.4101v1 [astro-ph.co] 23 Jul 2010
arxiv:1007.4101v1 [astro-ph.co] 23 Jul 2010 Trumpeting the Vuvuzela: UltraDeep HI observations with MeerKAT Benne Willem Holwerda Astrophysics, Cosmology and Gravity Centre (ACGC), Astronomy Department,
More informationEinstein Rings: Nature s Gravitational Lenses
National Aeronautics and Space Administration Einstein Rings: Nature s Gravitational Lenses Leonidas Moustakas and Adam Bolton Taken from: Hubble 2006 Science Year in Review The full contents of this book
More informationData-Intensive Science and Scientific Data Infrastructure
Data-Intensive Science and Scientific Data Infrastructure Russ Rew, UCAR Unidata ICTP Advanced School on High Performance and Grid Computing 13 April 2011 Overview Data-intensive science Publishing scientific
More informationWriting Grid Service Using GT3 Core. Dec, 2003. Abstract
Writing Grid Service Using GT3 Core Dec, 2003 Long Wang wangling@mail.utexas.edu Department of Electrical & Computer Engineering The University of Texas at Austin James C. Browne browne@cs.utexas.edu Department
More informationALMA Overview. Leonardo Testi (European Southern Observatory)
ALMA Overview Leonardo Testi (European Southern Observatory) The ALMA Project Status Timeline towards Early and Full Science Operations Future Developments Atacama Large Millimeter Array At least 50x12m
More informationG-Monitor: Gridbus web portal for monitoring and steering application execution on global grids
G-Monitor: Gridbus web portal for monitoring and steering application execution on global grids Martin Placek and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab Department of Computer
More informationPreparing Scientists for Scalable Software Development
Preparing Scientists for Scalable Software Development Valerie Maxville Education Program Leader About ivec About ivec Five members: Four public universities CSIRO Three facilities Education and Programs
More informationCanadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre
Canadian Astronomy Data Centre Séverin Gaudet David Schade Canadian Astronomy Data Centre Data Activities in Astronomy Features of the astronomy data landscape Multi-wavelength datasets are increasingly
More informationThe astronomical Virtual Observatory : lessons learnt, looking forward. Françoise Genova - Forum VO-PDC d après ADASS XXI, Paris, nov.
The astronomical Virtual Observatory : lessons learnt, looking forward Examples taken from the European view, but other projects have followed similar paths The VO aim Enable seamless access to the wealth
More informationIntegraion und Steuerung von verteilten Sensorsystemen. Grid-Package for a Robotic Telescope Network (RTN)
Integraion und Steuerung von verteilten Sensorsystemen Grid-Package for a Robotic Telescope Network (RTN) Potsdam 2010 October 20, Harry Enke, Thomas Granzer Astrophysikalisches Institut Potsdam Overview
More informationSQL Databases to access cosmological simulation results. CLUES Workshop. Lyon, 2012 Fernando Campos
SQL Databases to access cosmological simulation results CLUES Workshop. Lyon, 2012 Fernando Campos SQL Databases to access cosmological simulation results Why?? Too big data to handle it on files Easy
More informationResearch Collaboration in the Cloud: - the NeCTAR Research Cloud
Research Collaboration in the Cloud: - the NeCTAR Research Cloud National eresearch Collaboration Tools and Resources nectar.org.au NeCTAR is an initiative of the Australian Government being conducted
More informationA Preliminary Summary of The VLA Sky Survey
A Preliminary Summary of The VLA Sky Survey Eric J. Murphy and Stefi Baum (On behalf of the entire Science Survey Group) 1 Executive Summary After months of critical deliberation, the Survey Science Group
More informationThe Mantid Project. The challenges of delivering flexible HPC for novice end users. Nicholas Draper SOS18
The Mantid Project The challenges of delivering flexible HPC for novice end users Nicholas Draper SOS18 What Is Mantid A framework that supports high-performance computing and visualisation of scientific
More informationsmart grid communications Management
smart grid communications Management Madhu Nunna - Ericsson Product Manager, Utilities 10th Annual Smart Utilities Australia & New Zealand Melbourne, November 20 th 2012 Industry overview Utilities are
More informationTHE HIGH GROWTH POTENTIAL OF AUSTRALIA S SPACE ECONOMY
THE HIGH GROWTH POTENTIAL OF AUSTRALIA S SPACE ECONOMY INTRODUCTION The downstream benefit of space-derived data to the Australian economy is estimated to be around AU$12-18B enhanced GDP by 2020. Globally,
More informationCloud Computing. Lecture 5 Grid Case Studies 2014-2015
Cloud Computing Lecture 5 Grid Case Studies 2014-2015 Up until now Introduction. Definition of Cloud Computing. Grid Computing: Schedulers Globus Toolkit Summary Grid Case Studies: Monitoring: TeraGRID
More informationAstroCompute. AWS101 - using the cloud for Science. Brendan Bouffler ( boof ) Scientific Computing (SciCo) @ AWS. ska-astrocompute@amazon.
AstroCompute AWS101 - using the cloud for Science Brendan Bouffler ( boof ) Scientific Computing (SciCo) @ AWS ska-astrocompute@amazon.com AWS is hoping to contribute to the development of data processing,
More informationSummary of Data Management Principles South Pole Telescope
Summary of Data Management Principles South Pole Telescope Experiment description - Where it is: The South Pole Telescope (SPT) is a 10-meter-diameter telescope located at the Amundsen-Scott South Pole
More informationEMC E20-018. Exam Name: Virtualized Data Center and Cloud Infrastructure Design Specialist
EMC E20-018 Exam Name: Virtualized Data Center and Cloud Infrastructure Design Specialist http://www.exams.solutions/e20-018-exam-guide.html Product: Demo Question: 1 What is the first phase of the Virtual
More informationAstroGrid : powering the Virtual Observatory
AstroGrid : powering the Virtual Observatory Andy Lawrence Institute for Astronomy, University of Edinburgh, Royal Observatory, Blackford Hill, Edinburgh EH9 3HJ, Scotland, UK On behalf of the AstroGrid
More informationCloud-Based Self Service Analytics
Cloud-Based Self Service Analytics Andrew G Naish* Chief Technical Officer, Space-Time Research, Melbourne, Australia andrew.naish@spacetimeresearch.com Abstracts Traditionally, the means by which official
More informationData Lab Operations Concepts
Data Lab Operations Concepts 1 Introduction This talk will provide an overview of Data Lab components to be implemented Core infrastructure User applications Science Capabilities User Interfaces The scope
More informationLSST Resources for Data Analysis
LSST Resources for the Community Lynne Jones University of Washington/LSST 1 Data Flow Nightly Operations : (at base facility) Each 15s exposure = 6.44 GB (raw) 2x15s = 1 visit 30 TB / night Generates
More informationINTEROPERABLE IMAGE DATA ACCESS THROUGH ARCGIS SERVER
INTEROPERABLE IMAGE DATA ACCESS THROUGH ARCGIS SERVER Qian Liu Environmental Systems Research Institute 380 New York Street Redlands, CA92373, U.S.A - qliu@esri.com KEY WORDS: OGC, Standard, Interoperability,
More informationGridscape: A Tool for the Creation of Interactive and Dynamic Grid Testbed Web Portals
Gridscape: A Tool for the Creation of Interactive and Dynamic Grid Testbed Web Portals Hussein Gibbins and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Laboratory Department of Computer
More informationData Management System for grid and portal services
Data Management System for grid and portal services Piotr Grzybowski 1, Cezary Mazurek 1, Paweł Spychała 1, Marcin Wolski 1 1 Poznan Supercomputing and Networking Center, ul. Noskowskiego 10, 61-704 Poznan,
More informationSystems and Networks for Astronomy. Marco de Vos ASTRON Director of R&D (devos@astron.nl)
Systems and Networks for Astronomy Marco de Vos ASTRON Director of R&D (devos@astron.nl) ASTRON NWO Knowledge Institute for Astronomical Instrumentation Our mission: Making astronomical discoveries happen,
More informationGridWay: Open Source Meta-scheduling Technology for Grid Computing
: Open Source Meta-scheduling Technology for Grid Computing Ruben S. Montero dsa-research.org Open Source Grid & Cluster Oakland CA, May 2008 Contents Introduction What is? Architecture & Components Scheduling
More informationBUILDING APPLICATIONS FROM A WEB SERVICE BASED COMPONENT ARCHITECTURE. D. Gannon, S. Krishnan, L. Fang, G. Kandaswamy, Y. Simmhan, A.
BUILDING APPLICATIONS FROM A WEB SERVICE BASED COMPONENT ARCHITECTURE D. Gannon, S. Krishnan, L. Fang, G. Kandaswamy, Y. Simmhan, A. Slominski What this talk is about How to build secure, reliable applications
More informationA Governance Framework for Data Audit Trail creation in large multi-disciplinary projects
20th International Congress on Modelling and Simulation, Adelaide, Australia, 1 6 December 2013 www.mssanz.org.au/modsim2013 A Governance Framework for Data Audit Trail creation in large multi-disciplinary
More informationThe Preservation and Sustainability of Research Data
The Preservation and Sustainability of Research Data Dr Markus Buchhorn, Director, ICT Environments Australian National University; Formerly: Head, ANU Internet Futures Grid Services Architect, APAC Grid
More informationAn ArrayLibraryforMS SQL Server
An ArrayLibraryforMS SQL Server Scientific requirements and an implementation László Dobos 1,2 --dobos@complex.elte.hu Alex Szalay 2, José Blakeley 3, Tamás Budavári 2, István Csabai 1,2, Dragan Tomic
More informationFuture Developments in UniGrids and NextGRID
Future Developments in UniGrids and NextGRID Dr. David Snelling Fujitsu Laboratories of Europe Unicore Summit Nice, France - October 2005 Overview Status Report New Gateway Architecture Parallel HTTP based
More informationMcIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data
McIDAS-V - A powerful data analysis and visualization tool for multi and hyperspectral environmental satellite data Thomas Achtor, Thomas Rink, Thomas Whittaker, David Parker and David Santek Space Science
More informationHosted Archiving Solutions
Contents Hosted Archiving Solutions Tim Smith, Director of Sales esolutions March 2007 Introducing Salmat Public Company listed ASX Market Cap $480m Turnover $525M+ 4000 + employees Sites throughout Asia
More informationMigrating a (Large) Science Database to the Cloud
The Sloan Digital Sky Survey Migrating a (Large) Science Database to the Cloud Ani Thakar Alex Szalay Center for Astrophysical Sciences and Institute for Data Intensive Engineering and Science (IDIES)
More informationHIC 2009 Workshop Introduction to Health Informatics
HIC 2009 Workshop Introduction to Health Informatics Part 2: Knowledge Domain & Educational Options Professor Anthony Maeder University of Western Sydney Health Informatics Knowledge Domain Perspectives
More informationWide-Field Plate Database: Service for Astronomy
Wide-Field Plate Database: Service for Astronomy Milcho K. Tsvetkov To cite this version: Milcho K. Tsvetkov. Wide-Field Plate Database: Service for Astronomy. IMCCE. International Workshop NAROO-GAIA
More informationOpen spatial data platform for visualization and analytics of geospatial data
Open spatial data platform for visualization and analytics of geospatial data Bill Simpson-Young Director, Engineering and Technology Development, NICTA. Co-founder, Terria. Geospatial World Forum, 25
More informationGrid Computing @ Sun Carlo Nardone. Technical Systems Ambassador GSO Client Solutions
Grid Computing @ Sun Carlo Nardone Technical Systems Ambassador GSO Client Solutions Phases of Grid Computing Cluster Grids Single user community Single organization Campus Grids Multiple user communities
More informationData providers technical feedback
Data providers technical feedback DCA WP 3.2 (LU) Report May 2007 Anita Richards (JBO) & Jonathan Tedds (LU) Terms of reference Activities up to 1 st PCT meeting Thurs Session 1 Plans Thurs Session 3 WP
More informationWOS for Research. ddn.com. DDN Whitepaper. Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved.
DDN Whitepaper WOS for Research Utilizing irods to manage collaborative research. 2012 DataDirect Networks. All Rights Reserved. irods and the DDN Web Object Scalar (WOS) Integration irods, an open source
More informationSummary of Data Management Principles Dark Energy Survey V2.1, 7/16/15
Summary of Data Management Principles Dark Energy Survey V2.1, 7/16/15 This Summary of Data Management Principles (DMP) has been prepared at the request of the DOE Office of High Energy Physics, in support
More informationScientific Computing Meets Big Data Technology: An Astronomy Use Case
Scientific Computing Meets Big Data Technology: An Astronomy Use Case Zhao Zhang AMPLab and BIDS UC Berkeley zhaozhang@cs.berkeley.edu In collaboration with Kyle Barbary, Frank Nothaft, Evan Sparks, Oliver
More information