Dominique Fouchez. 12 Fevrier 2011

Size: px
Start display at page:

Download "Dominique Fouchez. 12 Fevrier 2011"

Transcription

1 données données CPPM 12 Fevrier 2011

2 The Data données one 6.4-gigabyte image every 17 seconds 15 terabytes of raw scientific image data / night 60-petabyte final image data archive 20-petabyte final database catalog (multiple trillion rows) 2 million real time events per night every night for 10 years

3 Data processing by the project données Data management process the images for the community Image simulation / calibration manage by system team

4 Management team (July 2012) données

5 Management team (July 2012) données

6 Data Management products données

7 Data processing for données SWG : Science Working Groups use data delivered by DM add level 3 processing data center) combine with other data... DESC : Dark Energy Science Collaboration use data delivered by DM, mainly low level ( images) on pixel specific DE processing (psf - multifit etc) Combine with large set of non images...

8 The Data Management données Provide a highly reliable open source system to provide: Real time alerts catalog data products, image data yearly coadd realeases Provides the infrastructure to transport, process, and serve the data

9 Cyber infrastructure données

10 Processing pipelines données

11 Organisation for the Processing pipelines development données

12 Organisation for the Processing pipelines development données 1. Infrastructure, database and software deployment : evolving toward final and full size.

13 Organisation for the Processing pipelines development données 1. Infrastructure, database and software deployment : evolving toward final and full size. 2. Development of sofware : design / prototyping and test..

14 Organisation for the Processing pipelines development données 1. Infrastructure, database and software deployment : evolving toward final and full size. 2. Development of sofware : design / prototyping and test during data challenges (every 6 month / 1 year)

15 Organisation for the Processing pipelines development données 1. Infrastructure, database and software deployment : evolving toward final and full size. 2. Development of sofware : design / prototyping and test during data challenges (every 6 month / 1 year) 4. Next data challenge : Summer 2013 CCIN2P3 (+ france team) will process 1 half

16 French activities and commitment in computing and données

17 French activities and commitment in computing and données 1. 1 Half of Data (Challenge) at CC : from 2013, till the final design and the first light.

18 French activities and commitment in computing and données 1. 1 Half of Data (Challenge) at CC : from 2013, till the final design and the first light. 2. Simulation (and image reduction?) link with camera

19 French activities and commitment in computing and données 1. 1 Half of Data (Challenge) at CC : from 2013, till the final design and the first light. 2. Simulation (and image reduction?) link with camera 3. Work on images : CFHT LS images, (SDSS)

20 French activities and commitment in computing and données 1. 1 Half of Data (Challenge) at CC : from 2013, till the final design and the first light. 2. Simulation (and image reduction?) link with camera 3. Work on images : CFHT LS images, (SDSS) 4. IN2P3 : Science via DESC (and SWG)

21 French activities and commitment in computing and données 1. 1 Half of Data (Challenge) at CC : from 2013, till the final design and the first light. 2. Simulation (and image reduction?) link with camera 3. Work on images : CFHT LS images, (SDSS) 4. IN2P3 : Science via DESC (and SWG) Many opportunities : goodwill welcome

The LSST Data management and French computing activities. Dominique Fouchez on behalf of the IN2P3 Computing Team. LSST France April 8th,2015

The LSST Data management and French computing activities. Dominique Fouchez on behalf of the IN2P3 Computing Team. LSST France April 8th,2015 The LSST Data management and French computing activities Dominique Fouchez on behalf of the IN2P3 Computing Team LSST France April 8th,2015 OSG All Hands SLAC April 7-9, 2014 1 The LSST Data management

More information

LSST Resources for the Community Lynne Jones University of Washington/LSST

LSST Resources for the Community Lynne Jones University of Washington/LSST LSST Resources for the Community Lynne Jones University of Washington/LSST 1 Data Flow Nightly Operations : (at base facility) Each 15s exposure = 6.44 GB (raw) 2x15s = 1 visit 30 TB / night Generates

More information

WIYN ODI: Observing Process, Data Analysis and Archiving

WIYN ODI: Observing Process, Data Analysis and Archiving WIYN ODI: Observing Process, Data Analysis and Archiving Pierre Martin Yale Survey Workshop, October 2009 ODI: Scientific Challenges ODI is designed to take advantage of the best seeing conditions at WIYN.

More information

Introduction to LSST Data Management. Jeffrey Kantor Data Management Project Manager

Introduction to LSST Data Management. Jeffrey Kantor Data Management Project Manager Introduction to LSST Data Management Jeffrey Kantor Data Management Project Manager LSST Data Management Principal Responsibilities Archive Raw Data: Receive the incoming stream of images that the Camera

More information

Hunting Dwarf Galaxies: A Preview of the NOAO Data Lab

Hunting Dwarf Galaxies: A Preview of the NOAO Data Lab Hunting Dwarf Galaxies: A Preview of the NOAO Data Lab Data Lab team: Knut Olsen, Mike Fitzpatrick, Matthew Graham, Ken Mighell, Betty Stobie, Pat Norris, and Steve Ridgway 1 Big Data at NOAO Hundreds

More information

Libraries and Large Data

Libraries and Large Data Libraries and Large Data Super Computing 2012 Elisabeth Long University of Chicago Library What is the Library s Interest in Big Data? Large Data and Libraries We ve Always Collected Data Intellectual

More information

Data analysis of L2-L3 products

Data analysis of L2-L3 products Data analysis of L2-L3 products Emmanuel Gangler UBP Clermont-Ferrand (France) Emmanuel Gangler BIDS 14 1/13 Data management is a pillar of the project : L3 Telescope Caméra Data Management Outreach L1

More information

Introduction to Financial Management Summer I 2001. Stock Game Project

Introduction to Financial Management Summer I 2001. Stock Game Project to Financial Management Summer I 2001 to Financial Management Summer I 2001 to Financial Management Summer I 2001 to Financial Management Summer I 2001 to Financial Management Summer I 2001 to Financial

More information

LSST Data Management. Tim Axelrod Project Scientist - LSST Data Management. Thursday, 28 Oct 2010

LSST Data Management. Tim Axelrod Project Scientist - LSST Data Management. Thursday, 28 Oct 2010 LSST Data Management Tim Axelrod Project Scientist - LSST Data Management Thursday, 28 Oct 2010 Outline of the Presentation LSST telescope and survey Functions and architecture of the LSST data management

More information

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research

Astrophysics with Terabyte Datasets. Alex Szalay, JHU and Jim Gray, Microsoft Research Astrophysics with Terabyte Datasets Alex Szalay, JHU and Jim Gray, Microsoft Research Living in an Exponential World Astronomers have a few hundred TB now 1 pixel (byte) / sq arc second ~ 4TB Multi-spectral,

More information

Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science)

Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science) Data Literacy For All: Astrophysics and Beyond (Astronomy is evidence-based forensic science, thus it is a data & information science) Kirk Borne George Mason University, Fairfax, VA www.kirkborne.net

More information

Software challenges in the implementation of large surveys: the case of J-PAS

Software challenges in the implementation of large surveys: the case of J-PAS Software challenges in the implementation of large surveys: the case of J-PAS 1/21 Paulo Penteado - IAG/USP pp.penteado@gmail.com http://www.ppenteado.net/ast/pp_lsst_201204.pdf (K. Taylor) (A. Fernández-Soto)

More information

Big Data: Welcome to the future. A cut-out-and-keep guide for CIOs. Brought to you in partnership with

Big Data: Welcome to the future. A cut-out-and-keep guide for CIOs. Brought to you in partnership with : Welcome to the future A cut-out-and-keep guide for CIOs 1 Big data is about digital content and the information surrounding its consumption. It s also about the capture and analysis of this data. Companies

More information

irods at CC-IN2P3: managing petabytes of data

irods at CC-IN2P3: managing petabytes of data Centre de Calcul de l Institut National de Physique Nucléaire et de Physique des Particules irods at CC-IN2P3: managing petabytes of data Jean-Yves Nief Pascal Calvat Yonny Cardenas Quentin Le Boulc h

More information

Analytics-as-a-Service: From Science to Marketing

Analytics-as-a-Service: From Science to Marketing Analytics-as-a-Service: From Science to Marketing Data Information Knowledge Insights (Discovery & Decisions) Kirk Borne George Mason University, Fairfax, VA www.kirkborne.net @KirkDBorne Big Data: What

More information

Digital Preservation Lifecycle Management

Digital Preservation Lifecycle Management Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar San Diego Supercomputer Center, University of California,

More information

Euclid. Mapping the geometry of the dark Universe. Conseil scientifique de l IN2P3. 25 Octobre 2012. A Ealet (CPPM)

Euclid. Mapping the geometry of the dark Universe. Conseil scientifique de l IN2P3. 25 Octobre 2012. A Ealet (CPPM) Euclid Mapping the geometry of the dark Universe Conseil scientifique de l IN2P3 25 Octobre 2012 A Ealet (CPPM) Participation of IN2P3 to an ESA space mission OVERVIEW Euclid Scientific objectives The

More information

LSST Data Management plans: Pipeline outputs and Level 2 vs. Level 3

LSST Data Management plans: Pipeline outputs and Level 2 vs. Level 3 LSST Data Management plans: Pipeline outputs and Level 2 vs. Level 3 Mario Juric Robert Lupton LSST DM Project Scien@st Algorithms Lead LSST SAC Name of Mee)ng Loca)on Date - Change in Slide Master 1 Data

More information

Learning from Big Data in

Learning from Big Data in Learning from Big Data in Astronomy an overview Kirk Borne George Mason University School of Physics, Astronomy, & Computational Sciences http://spacs.gmu.edu/ From traditional astronomy 2 to Big Data

More information

Turning Big Data into Big Decisions Delivering on the High Demand for Data

Turning Big Data into Big Decisions Delivering on the High Demand for Data Turning Big Data into Big Decisions Delivering on the High Demand for Data Michael Ho, Vice President of Professional Services Digital Government Institute s Government Big Data Conference, October 31,

More information

LSST Data Management System Applications Layer Simulated Data Needs Description: Simulation Needs for DC3

LSST Data Management System Applications Layer Simulated Data Needs Description: Simulation Needs for DC3 LSST Data Management System Applications Layer Simulated Data Needs Description: Simulation Needs for DC3 Draft 25 September 2008 A joint document from the LSST Data Management Team and Image Simulation

More information

Kevin Blair CEO, NewGround. Retail 2020 FUTURE BANK

Kevin Blair CEO, NewGround. Retail 2020 FUTURE BANK Kevin Blair CEO, NewGround Retail 2020 FUTURE BANK Today, the amount of global big data = megabytes gigabytes terabytes petabytes exabytes SOURCE: Cisco Global Mobile Data Tracking Update (February 6,

More information

Yukikatsu Terada (Saitama Univ, Japan), on behalf of the Astro-H Software Calibration board

Yukikatsu Terada (Saitama Univ, Japan), on behalf of the Astro-H Software Calibration board Yukikatsu Terada (Saitama Univ, Japan), on behalf of the Astro-H Software Calibration board SKIP (Rob Introduction) The sixth series of the Japanese X-ray satellite. Collaboration with JAXA, NASA, and

More information

Taming the Internet of Things: The Lord of the Things

Taming the Internet of Things: The Lord of the Things Taming the Internet of Things: The Lord of the Things Kirk Borne @KirkDBorne School of Physics, Astronomy, & Computational Sciences College of Science, George Mason University, Fairfax, VA Taming the Internet

More information

One Degree Imager Pipeline Software and Archive Science Requirements Document

One Degree Imager Pipeline Software and Archive Science Requirements Document One Degree Imager Pipeline Software and Archive Science Requirements Document Version 1.5: 7/23/09!Ian!Dell(Antonio-!Daniel!Durand-!Daniel!1arbeck-!5nut!Olsen-!8ohn!Sal;er! Final!Draft!>dition?!Pierre!Aartin!

More information

MANAGING AND MINING THE LSST DATA SETS

MANAGING AND MINING THE LSST DATA SETS MANAGING AND MINING THE LSST DATA SETS Astronomy is undergoing an exciting revolution -- a revolution in the way we probe the universe and the way we answer fundamental questions. New technology enables

More information

MAST: The Mikulski Archive for Space Telescopes

MAST: The Mikulski Archive for Space Telescopes MAST: The Mikulski Archive for Space Telescopes Richard L. White Space Telescope Science Institute 2015 April 1, NRC Space Science Week/CBPSS A model for open access The NASA astrophysics data archives

More information

Making astronomical discoveries on the web

Making astronomical discoveries on the web Making astronomical discoveries on the web David W. Hogg Center for Cosmology and Particle Physics, New York University Max-Planck-Institut für Astronomie, Heidelberg 2011 July 12 Conclusions It is possible

More information

Grid Computing in Aachen

Grid Computing in Aachen GEFÖRDERT VOM Grid Computing in Aachen III. Physikalisches Institut B Berichtswoche des Graduiertenkollegs Bad Honnef, 05.09.2008 Concept of Grid Computing Computing Grid; like the power grid, but for

More information

PMCS - WBS with Definition

PMCS - WBS with Definition 02C Data Management Construction This WBS element provides the complete LSST Data Management System (DMS). The DMS has these main responsibilities in the LSST system: Process the incoming stream of images

More information

WFIRST- AFTA: European Interests

WFIRST- AFTA: European Interests WFIRST- AFTA: European Interests Mark Cropper Mullard Space Science Laboratory University College London Contents 1. WFI interests Europe- wide 2. Coronagraph interests, UK only see Anthony BoccaleJ s

More information

Data Management So,ware Stack Intro

Data Management So,ware Stack Intro Data Management So,ware Stack Intro Mario Jurić LSST Data Management Project Scien:st SLAC DM Stack Working Mee:ng 10-12 December, 2012 1 LSST Data Management Tasks Processes the incoming stream of images

More information

LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist

LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist LSST and the Cloud: Astro Collaboration in 2016 Tim Axelrod LSST Data Management Scientist DERCAP Sydney, Australia, 2009 Overview of Presentation LSST - a large-scale Southern hemisphere optical survey

More information

What Is Big Data? Craig C. Douglas University of Wyoming

What Is Big Data? Craig C. Douglas University of Wyoming What Is Big Data? Craig C. Douglas University of Wyoming What Is Big Data?... It Depends Unit Approximately 10 n Related to Kilobyte (KB) 1,000 bytes 3 Circa 1952 computer memory 32 KB Apollo 11 computer

More information

Milestone Solution Partner IT Infrastructure MTP Certification Report Scality RING Software-Defined Storage 11-16-2015

Milestone Solution Partner IT Infrastructure MTP Certification Report Scality RING Software-Defined Storage 11-16-2015 Milestone Solution Partner IT Infrastructure MTP Certification Report Scality RING Software-Defined Storage 11-16-2015 Table of Contents Introduction... 4 Certified Products... 4 Key Findings... 5 Solution

More information

The Past, Present, and Future of Data Science Education

The Past, Present, and Future of Data Science Education The Past, Present, and Future of Data Science Education Kirk Borne @KirkDBorne http://kirkborne.net George Mason University School of Physics, Astronomy, & Computational Sciences Outline Research and Application

More information

TAP into NAU. TAP is a single tool. How it works. Transfer Academic Plan nau.edu/tap

TAP into NAU. TAP is a single tool. How it works. Transfer Academic Plan nau.edu/tap TAP into and an degree: the catalog TAP into and an degree: the catalog TAP into and an degree: the catalog TAP into and an degree: the catalog TAP into and an degree: the catalog TAP into and an degree:

More information

Challenges in e-science: Research in a Digital World

Challenges in e-science: Research in a Digital World Challenges in e-science: Research in a Digital World Thom Dunning National Center for Supercomputing Applications National Center for Supercomputing Applications University of Illinois at Urbana-Champaign

More information

LSST All Hands Meeting SLAC, December 4-8 2006 (MAP)

LSST All Hands Meeting SLAC, December 4-8 2006 (MAP) LSST All Hands Meeting SLAC, December 4-8 2006 (MAP) Monday, December 4 th Plenary Session Day One, Kavli Auditorium Project Status 1:00 Welcome; Project and MREFC Status D. Sweeney 1:40 Directors Report

More information

FRENCH RADIOSOUNDING AUTOMATION EXPERIMENTS ABSTRACT

FRENCH RADIOSOUNDING AUTOMATION EXPERIMENTS ABSTRACT FRENCH RADIOSOUNDING AUTOMATION EXPERIMENTS MAGALI STOLL, YVAN LEMAITRE, CHRISTOPHE BARRIERE, MÉTÉO-FRANCE, DIRECTION OF OBSERVING SYSTEMS UPPER AIR OBSERVING SYSTEMS DEPARTMENT 42 AVENUE G.CORIOLIS F

More information

The CMS analysis chain in a distributed environment

The CMS analysis chain in a distributed environment The CMS analysis chain in a distributed environment on behalf of the CMS collaboration DESY, Zeuthen,, Germany 22 nd 27 th May, 2005 1 The CMS experiment 2 The CMS Computing Model (1) The CMS collaboration

More information

Queued Service Observations with MegaPrime Phase 1 Proposal Submission for Semester 2010A

Queued Service Observations with MegaPrime Phase 1 Proposal Submission for Semester 2010A CFHT, Instruments, Queue Scheduling Queued Service Observations with MegaPrime Phase 1 Proposal Submission for Semester 2010A Updated 08/24/09 Table of Contents A - Introduction The QSO Project Document

More information

Guidelines for HARPS observations

Guidelines for HARPS observations Guidelines for HARPS observations This is a general introduction to observe with the HARPS instrument attached at the 3.6m telescope from the new control room located in the former library building in

More information

Data Protection & Archiving: What you thought was old is new again. Tape summit, London - 2012

Data Protection & Archiving: What you thought was old is new again. Tape summit, London - 2012 Data Protection & Archiving: What you thought was old is new again Tape summit, London - 2012 Who We Are 9/4/2013 2 9/4/2013 3 In this session you will learn About a New Dynamic of storage for a New Age

More information

Refurbishment Mas Thibert / Arles

Refurbishment Mas Thibert / Arles Refurbishment Mas Thibert / Arles Gonzague Descoqs 13 Habitat 10th october 2012, Steering Committee, Malaga 13 Habitat, short presentation Social housing organisation, based in Marseille Around 32000 dwellings

More information

The World-Wide Telescope, an Archetype for Online Science

The World-Wide Telescope, an Archetype for Online Science The World-Wide Telescope, an Archetype for Online Science Jim Gray, Microsoft Research Alex Szalay, Johns Hopkins University June 2002 Technical Report MSR-TR-2002-75 Microsoft Research Microsoft Corporation

More information

Data Management Plan Extended Baryon Oscillation Spectroscopic Survey

Data Management Plan Extended Baryon Oscillation Spectroscopic Survey Data Management Plan Extended Baryon Oscillation Spectroscopic Survey Experiment description: eboss is the cosmological component of the fourth generation of the Sloan Digital Sky Survey (SDSS-IV) located

More information

Condor Supercomputer

Condor Supercomputer Introducing the Air Force Research Laboratory Information Directorate Condor Supercomputer DOD s Largest Interactive Supercomputer Ribbon Cutting Ceremony AFRL, Rome NY 1 Dec 2010 Approved for Public Release

More information

Summary of Data Management Principles Dark Energy Survey V2.1, 7/16/15

Summary of Data Management Principles Dark Energy Survey V2.1, 7/16/15 Summary of Data Management Principles Dark Energy Survey V2.1, 7/16/15 This Summary of Data Management Principles (DMP) has been prepared at the request of the DOE Office of High Energy Physics, in support

More information

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010

Virtual Observatories A New Era for Astronomy. Reinaldo R. de Carvalho DAS-INPE/MCT 2010 Virtual Observatories Virtual Observatories 1%%&'&$#-&6!&9:#,*3),!#,6!6#$C!&,&$D2 *:#%&+-3;& D&);&-$2!!"! "!" &,&$D2 %),-&,-!"#$%&'&#()*! $#%&!(!!! $ '!%&$ $! (% %)'6!6#$C!;#--&$G $! '!!! $#63#-3),G $!

More information

IBM G-Cloud IBM SPSS Decision Management Software as a Service

IBM G-Cloud IBM SPSS Decision Management Software as a Service IBM G-Cloud IBM SPSS Decision Management Software as a Service Service Definition 1 1. Summary 1.1 Service Description IBM SPSS Decision Management Software as a Service (SaaS) offers another way of delivering

More information

Expert Group on Cloud Computing Services and Standards ( EGCCSS ) Formation of Working Groups

Expert Group on Cloud Computing Services and Standards ( EGCCSS ) Formation of Working Groups For Discussion on 27 May 2014 Paper EGCCSS-6-3 Expert Group on Cloud Computing Services and Standards ( EGCCSS ) Formation of Working Groups Purpose To propose the setting up of two Working Groups under

More information

Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre

Canadian Astronomy Data Centre. Séverin Gaudet David Schade Canadian Astronomy Data Centre Canadian Astronomy Data Centre Séverin Gaudet David Schade Canadian Astronomy Data Centre Data Activities in Astronomy Features of the astronomy data landscape Multi-wavelength datasets are increasingly

More information

Summary of Data Management Principles South Pole Telescope

Summary of Data Management Principles South Pole Telescope Summary of Data Management Principles South Pole Telescope Experiment description - Where it is: The South Pole Telescope (SPT) is a 10-meter-diameter telescope located at the Amundsen-Scott South Pole

More information

Business Information Systems. IT Enabled Services And Emerging Technologies. Chapter 4: Facilitated e-learning Part 1 of 2 CA M S Mehta, FCA

Business Information Systems. IT Enabled Services And Emerging Technologies. Chapter 4: Facilitated e-learning Part 1 of 2 CA M S Mehta, FCA Business Information Systems IT Enabled Services And Emerging Technologies Chapter 4: Facilitated e-learning Part 1 of 2 CA M S Mehta, FCA 1 Business Information Systems Task Statements 1.6 Consider the

More information

The Large Synoptic Survey Telescope: Status Update

The Large Synoptic Survey Telescope: Status Update The Large Synoptic Survey Telescope: Status Update Steven M. Kahn LSST Director Mid-Decadal Review Committee December 13, 2015 LSST in a Nutshell The LSST is an integrated survey system designed to conduct

More information

Introduction to Computer Graphics

Introduction to Computer Graphics Introduction to Computer Graphics Torsten Möller TASC 8021 778-782-2215 torsten@sfu.ca www.cs.sfu.ca/~torsten Today What is computer graphics? Contents of this course Syllabus Overview of course topics

More information

University Computing Services Florida State University Data Storage and Server Hosting Options

University Computing Services Florida State University Data Storage and Server Hosting Options University Computing Services Florida State University Data Storage and Server Hosting Options The Office of Technology Integration (OTI), through its University Computing Services (UCS) division, extends

More information

Extraction Heights for STIS Echelle Spectra

Extraction Heights for STIS Echelle Spectra Instrument Science Report STIS 98-09 Extraction Heights for STIS Echelle Spectra Claus Leitherer and Ralph Bohlin March 1998 ABSTRACT The optimum extraction height (h) for STIS echelle spectra of 7 pixels

More information

An IDL for Web Services

An IDL for Web Services An IDL for Web Services Interface definitions are needed to allow clients to communicate with web services Interface definitions need to be provided as part of a more general web service description Web

More information

ESKISP6055.01 Manage security testing

ESKISP6055.01 Manage security testing Overview This standard covers the competencies concerning with managing security testing activities. Including managing resources activities and deliverables. This includes planning, conducting and reporting

More information

Good Research Practice

Good Research Practice Page 1 of 8 The Royal Veterinary College Introduction Preface Good Research Practice Funding bodies need to be assured of the quality and validity of research they fund and ensure their contractors are

More information

Product Overview. Payroll & Personnel Data Warehouse

Product Overview. Payroll & Personnel Data Warehouse Payroll & Personnel Data Warehouse Grapevine Solutions 2010 HAPPI HAPPI (History & Archiving for Payroll & Personnel Information) was developed by Grapevine Solutions to meet the needs of organisations

More information

Auto-Classification for Document Archiving and Records Declaration

Auto-Classification for Document Archiving and Records Declaration Auto-Classification for Document Archiving and Records Declaration Josemina Magdalen, Architect, IBM November 15, 2013 Agenda IBM / ECM/ Content Classification for Document Archiving and Records Management

More information

VITO Centre of Image Processing

VITO Centre of Image Processing 07/11/2013 VITO Centre of Image Processing Towards an Improved Scientific Exploitation of EO Data Sources in Support of Vegetation Monitoring Erwin Goor, VITO nv Outline» Introduction» The role & and objectives

More information

THE EMERGING GI ENVIRONMENT

THE EMERGING GI ENVIRONMENT THE EMERGING GI ENVIRONMENT BRUCE McCORMACK VICE PRESIDENT EUROGI (EUROPEAN UMBRELLA ORGANISATION FOR GEOGRAPHIC INFORMATION) ESTONIA GI ASSOCIATION ANNUAL CONFERENCE 23 October 2015 OUTLINE Questionnaire

More information

REFERENTIEL- SODERN. Autre référence / Other reference :

REFERENTIEL- SODERN. Autre référence / Other reference : Classification: NC Page : 1/8 Autre référence / Other reference : Type: Sector procedureprocédure sectorielle. Description: Exigences qualité pour les fournisseurs de Sodern version anglaise / Quality

More information

Cloud Computing Where ISR Data Will Go for Exploitation

Cloud Computing Where ISR Data Will Go for Exploitation Cloud Computing Where ISR Data Will Go for Exploitation 22 September 2009 Albert Reuther, Jeremy Kepner, Peter Michaleas, William Smith This work is sponsored by the Department of the Air Force under Air

More information

University Information Sheet

University Information Sheet Part A: University Information Sheet A.1- Brief description of your university: (history, main activities, number of students, courses offered, etc). The Sidi Mohammed Ben Abdellah University has been

More information

WHITE PAPER. Harnessing the Power of Advanced Analytics How an appliance approach simplifies the use of advanced analytics

WHITE PAPER. Harnessing the Power of Advanced Analytics How an appliance approach simplifies the use of advanced analytics WHITE PAPER Harnessing the Power of Advanced How an appliance approach simplifies the use of advanced analytics Introduction The Netezza TwinFin i-class advanced analytics appliance pushes the limits of

More information

EUDAT. Towards a pan-european Collaborative Data Infrastructure

EUDAT. Towards a pan-european Collaborative Data Infrastructure EUDAT Towards a pan-european Collaborative Data Infrastructure Damien Lecarpentier CSC-IT Center for Science, Finland EISCAT User Meeting, Uppsala,6 May 2013 2 Exponential growth Data trends Zettabytes

More information

Migrating a (Large) Science Database to the Cloud

Migrating a (Large) Science Database to the Cloud The Sloan Digital Sky Survey Migrating a (Large) Science Database to the Cloud Ani Thakar Alex Szalay Center for Astrophysical Sciences and Institute for Data Intensive Engineering and Science (IDIES)

More information

Hexaware E-book on Predictive Analytics

Hexaware E-book on Predictive Analytics Hexaware E-book on Predictive Analytics Business Intelligence & Analytics Actionable Intelligence Enabled Published on : Feb 7, 2012 Hexaware E-book on Predictive Analytics What is Data mining? Data mining,

More information

Promises and Pitfalls of Big-Data-Predictive Analytics: Best Practices and Trends

Promises and Pitfalls of Big-Data-Predictive Analytics: Best Practices and Trends Promises and Pitfalls of Big-Data-Predictive Analytics: Best Practices and Trends Spring 2015 Thomas Hill, Ph.D. VP Analytic Solutions Dell Statistica Overview and Agenda Dell Software overview Dell in

More information

The PACS Software System. (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.

The PACS Software System. (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1. The PACS Software System (A high level overview) Prepared by : E. Wieprecht, J.Schreiber, U.Klaas November,5 2007 Issue 1.0 PICC-ME-DS-003 1. Introduction The PCSS, the PACS ICC Software System, is the

More information

BaBar and ROOT data storage. Peter Elmer BaBar Princeton University ROOT2002 14 Oct. 2002

BaBar and ROOT data storage. Peter Elmer BaBar Princeton University ROOT2002 14 Oct. 2002 BaBar and ROOT data storage Peter Elmer BaBar Princeton University ROOT2002 14 Oct. 2002 The BaBar experiment BaBar is an experiment built primarily to study B physics at an asymmetric high luminosity

More information

Unified Surveillance Video Analysis and Storage An innovative approach to improve retention, availability, and expand analytic capabilities.

Unified Surveillance Video Analysis and Storage An innovative approach to improve retention, availability, and expand analytic capabilities. Unified Surveillance Video Analysis and Storage An innovative approach to improve retention, availability, and expand analytic capabilities. NFF White Paper December 2014 ...Most current surveillance solutions

More information

SQL Server PDW. Artur Vieira Premier Field Engineer

SQL Server PDW. Artur Vieira Premier Field Engineer SQL Server PDW Artur Vieira Premier Field Engineer Agenda 1 Introduction to MPP and PDW 2 PDW Architecture and Components 3 Data Structures 4 PDW Tools Data Load / Data Output / Administrative Console

More information

Gaming System Monitoring and Analysis Effort

Gaming System Monitoring and Analysis Effort for the Gaming System Monitoring and Analysis Effort DHS/S&T/PIA-025 October 11, 2012 Contact Point Douglas Maughan DHS S&T Cyber Security Division 202-254-6145 Reviewing Official Jonathan R. Cantor Acting

More information

Data Management using irods

Data Management using irods Data Management using irods Fundamentals of Data Management September 2014 Albert Heyrovsky Applications Developer, EPCC a.heyrovsky@epcc.ed.ac.uk 2 Course outline Why talk about irods? What is irods?

More information

Final Report. FASTMOD: A Framework for ReAltime Spatio- Temporal Monitoring of MObility Data. Gautam Thakur, Yibin Wang, Kun Li

Final Report. FASTMOD: A Framework for ReAltime Spatio- Temporal Monitoring of MObility Data. Gautam Thakur, Yibin Wang, Kun Li Final Report FASTMOD: A Framework for ReAltime Spatio- Temporal Monitoring of MObility Data Gautam Thakur, Yibin Wang, Kun Li Abstract: In this study, we apply large data science techniques for monitoring,

More information

Constructing the Subaru Advanced Data and Analysis Service on VO

Constructing the Subaru Advanced Data and Analysis Service on VO Constructing the Subaru Advanced Data and Analysis Service on VO Yuji Shirasaki on behalf of ADC National Astronomical Observatory of Japan Astronomy Data Center Contents Subaru Telescope and Instruments

More information

Creating value in the mobile and fixed businesses

Creating value in the mobile and fixed businesses This presentation contains forward-looking information and statements about the Bouygues group and its businesses. Forwardlooking statements may be identified by the use of words such as will, expects,

More information

FRENCH EXPERIENCE WITH NDS EIGHTH NDS USERS GROUP MEETING MEXICO 7-9 OCTOBER 2013

FRENCH EXPERIENCE WITH NDS EIGHTH NDS USERS GROUP MEETING MEXICO 7-9 OCTOBER 2013 FRENCH EXPERIENCE WITH NDS EIGHTH NDS USERS GROUP MEETING MEXICO 7-9 OCTOBER 2013 Aldine Fabreguettes The French National Agency for Medicines and Health Products Safety Narcotics and Psychotropics Department

More information

Big Data Opportunities in the US Medical Imaging Market

Big Data Opportunities in the US Medical Imaging Market Brochure More information from http://www.researchandmarkets.com/reports/3164076/ Big Data Opportunities in the US Medical Imaging Market Description: Medical imaging data volumes will soon be approaching

More information

Developed with the farmer in mind.

Developed with the farmer in mind. The precision ag concept is really quite simple. Precisely monitor cropping variables, collect data concerning those variables, analyze the data, and then use the learned information to increase productivity

More information

CFHT STRIPE82 SURVEY (CS82)

CFHT STRIPE82 SURVEY (CS82) CFHT STRIPE82 SURVEY (CS82) 160 degrees (130 effective) i=24.1, AB mag, 5σ, 2 aperture Seeing ~ 0.6 over full survey Pixel size : 0.187 Alexie Leauthaud. Jean-Paul Kneib. Martin Makler. Ludovic van Waerbeke.

More information

Data Pipelines & Archives for Large Surveys. Peter Nugent (LBNL)

Data Pipelines & Archives for Large Surveys. Peter Nugent (LBNL) Data Pipelines & Archives for Large Surveys Peter Nugent (LBNL) Overview Major Issues facing any large-area survey/search: Computational power for search - data transfer, processing, storage, databases

More information

CS521 CSE IITG 11/23/2012

CS521 CSE IITG 11/23/2012 CS521 CSE TG 11/23/2012 A Sahu 1 Degree of overlap Serial, Overlapped, d, Super pipelined/superscalar Depth Shallow, Deep Structure Linear, Non linear Scheduling of operations Static, Dynamic A Sahu slide

More information

Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop

Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop 1 Data Lake In Action: Real-time, Closed Looped Analytics On Hadoop 2 Pivotal s Full Approach It s More Than Just Hadoop Pivotal Data Labs 3 Why Pivotal Exists First Movers Solve the Big Data Utility Gap

More information

EUDAT. Towards a pan-european Collaborative Data Infrastructure. Willem Elbers

EUDAT. Towards a pan-european Collaborative Data Infrastructure. Willem Elbers EUDAT Towards a pan-european Collaborative Data Infrastructure Willem Elbers EUDAT / MPI-TLA Focus meeting: Data repositories SURF, Utrecht March 3, 2014 Outline EUDAT project EUDAT services Summary and

More information

Industrial Internet & Advanced Manufacturing

Industrial Internet & Advanced Manufacturing Industrial Internet & Advanced Manufacturing Marco Annunziata, Chief Economist April 08, 2014 Imagination at work. The Future of Work Advanced Manufacturing + The Industrial Internet + The Global Brain

More information

A GUIDE TO INFORMATION GOVERNANCE

A GUIDE TO INFORMATION GOVERNANCE A GUIDE TO INFORMATION GOVERNANCE C2C Systems 2014 TABLE OF CONTENTS 1. OVERVIEW 2. IGRM REFERENCE MODEL 3. GOVERNANCE AND RISK 4. GOVERNANCE AND RETENTION 5. GOVERNANCE AND COMPLIANCE 6. GOVERNANCE AND

More information

DECam Community Pipeline Software Requirements and Technical Specifications

DECam Community Pipeline Software Requirements and Technical Specifications DECam Community Pipeline Software Requirements and Technical Specifications Authors: R. C. Smith, A.R. Walker, C. Miller Feedback on this document should be directed to: Alistair Walker, awalker @ctio.noao.edu

More information

Génie industriel. Welcome to. «Design & organisation» From product or service design to the management of the production to the supply chain

Génie industriel. Welcome to. «Design & organisation» From product or service design to the management of the production to the supply chain Grenoble INP Génie industriel Welcome to Génie industriel «Design & organisation» From product or service design to the management of the production to the supply chain The school of reference in Industrial

More information

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES

SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES SAS BIG DATA SOLUTIONS ON AWS SAS FORUM ESPAÑA, OCTOBER 16 TH, 2014 IAN MEYERS SOLUTIONS ARCHITECT / AMAZON WEB SERVICES AWS GLOBAL INFRASTRUCTURE 10 Regions 25 Availability Zones 51 Edge locations WHAT

More information

ASTRI - Astrofisica con Specchi a Tecnologia Replicante Italiana

ASTRI - Astrofisica con Specchi a Tecnologia Replicante Italiana Code: Issue 1 DATE Page 1 ASTRI Software Requirements and Use Cases Prepared by: Name: Joseph Schwarz Signature: Date: May 09, 2012 Gino Tosti + ALL Reviewed by: Name: Signature: Date: Approved by: Name:

More information

Global Research Data Infrastructure: Path Forward for Progress. Dr. Chris Greer Senior Executive for Cyber Physical Systems

Global Research Data Infrastructure: Path Forward for Progress. Dr. Chris Greer Senior Executive for Cyber Physical Systems Global Research Data Infrastructure: Path Forward for Progress Dr. Chris Greer Senior Executive for Cyber Physical Systems R. Rathe NIST: Basic Stats and Facts Major assets ~ 3,000 employees ~ 2,800 associates

More information

current problems in data collection and analysis

current problems in data collection and analysis current problems in data collection and analysis Colleen Shannon cshannon @ caida.org www.caida.org/data/ CONMI - March 30, 2005 UCSD CSE Network Research Infrastructure What is network research infrastructure?

More information

Introduction to Scientific Data and Workflow Management

Introduction to Scientific Data and Workflow Management Introduction to Scientific Data and Workflow Management Michael Gertz gertz@ucdavis.edu Bertram Ludäscher ludaesch@ucdavis.edu Department of Computer Science University of California at Davis UC DAVIS

More information