VITO Centre of Image Processing
|
|
- Thomasina Spencer
- 8 years ago
- Views:
Transcription
1 07/11/2013 VITO Centre of Image Processing Towards an Improved Scientific Exploitation of EO Data Sources in Support of Vegetation Monitoring Erwin Goor, VITO nv
2 Outline» Introduction» The role & and objectives of VITO in scientific exploitation of EO data» Production, Archiving and Distribution» Processing on demand & user-oriented data analysis/dashboards 07/11/2013 2
3 07/11/2013 3
4 VITO (be) Flemish Institute for Technological Research VITO Remote Sensing Unit Geo Data Applications Technology platform satellites airplanes UAS instruments cameras sensors raw data pixel value digital image orthophoto 07/11/ information time series analysis land use change service delivery decisions end user client
5 The role of VITO in scientific exploitation of EO data Production, archiving and distribution SPOT-VEGETATION missions (till medio 2014) PROBA-V mission (from 2013: commissioning ongoing) Metop-AVHRR S10, ENVISAT-MERIS S10 Bio-geophysical products in GIO Global Land MARS for JRC 07/11/2013 5
6 The PROBA-V User Segment at VITO Kiruna (Comm.) Redu Data Ingestion (Decoding Raw Data) Image Quality Calibration Instrument Programming Processing Data (Generate Images) Product Distribution 07/11/2013 6
7 The PROBA-V User Segment at VITO Kiruna Redu Data Ingestion (Decoding Raw Data) Image Quality Calibration Instrument Programming Processing Data (Generate Images) Product Distribution 07/11/2013 7
8 Product Distribution Facility» Web based portal: more data coming!» Integration within GSCDA (Discovery & Ordering)» Connected to multiple processing facilities & Long-term Archive HMA product discovery HMA ordering Subscription Reporting 07/11/2013 8
9 Long Term Archive Data Access & Preservation» Independent Archiving Facility developed according to the OAIS principles» Integrated with PDF via the CDB» 2 main functionalities: LTDA» Data Access: ingestion and retrieval of heterogeneous EO data» Metadata is stored in a queryable metadata repository» Data Preservation: configurable lifecycle mgt» Long Term Storage: 2 LTO tape copies Ingestion Retrieval Heterogeneous data with corresponding metadata Long Term Archive Storage Management Heterogeneous data 07/11/2013 9
10 The role of VITO in scientific exploitation of EO data Production, archiving and distribution Remote Sensing applications research topics Agriculture Crop Monitoring, Early Warning & Food security Crop Mapping Index-based insurance Water Water quality (SPM, Chlorophyl) Environment Drought monitoring Desert Locust monitoring Ecosystem mapping Habitat quality mapping Growing towards Research platform & Information dashboards on BIG DATA Heterogeneous EO data is used: multi-mission applications 07/11/
11 ESE project Building towards» ESA/GSTP project» Project partners: VITO (BE), Spacebel (BE)» Key objectives: Phase 1: Nov 12 Feb 14 Requirements & Design Prototyping Phase 2: Mar 14 Sep 15 Implementation & Validation 3 Pilot projects Building an on-demand image processing and information extraction system allowing to generate user-tailored information on vegetation with the final aim to build a platform for the vegetation research to foster open innovation, suitable for rapid realization of Web accessible processing on demand services. Analyse time series of data: BIG Data Prototyping & Benchmarking of algorithms Multi-mission applications, with minimal data transfer: cloud-based solutions Using widely accepted open standards: WPS, WCPS and CSW/WMS/WCS/ EO data Expert users (data) & End users (visualise information) 07/11/
12 ESE system context GSCDA, ngeo, FTP WPS-G WCPS Authentication & authorisation Processing on private & public cloud 07/11/
13 Hadoop based Processing Engine» Use of Cloudera Hadoop distribution for distributed EO-data processing: data locality» WPS-G (reused from SSE-Grid) encapsulated Oozie workflows Workflows Oozie WPS-G client WPS-G WPS-G BPEL workflows Distributed processing mapreduce Distributed storage HDFS Data Manager Data Distribution Facilities 07/11/
14 Rasdaman for raster data analysis» Use of Rasdaman for fast raster data queries on 3D data cube (x/y/t)» Fast analysis of time series user-tailored information» Prototyping of vegetation parameters (i.e. image processing)» Use of WCPS as a standardised language to query raster data WCPS / WCS client On demand processing Rasdaman Petascope WCPS / WCS Web service Rasdaman Server Relational DBMS Flexible access to raster data OLAP cube Information dashboards (Interactive) Reports Database Database 07/11/
15 Towards User tailored Information Dashboards Demo Rasdaman petascope PostGIS OLAP Cube 07/11/
16 Roadmap: R&D and operationalisation Distribution Data from Sentinel s on-demand processing User tailored dashboards Cloud-based platform for researchers Federated authentication Collaboration 07/11/
17 Thank you Erwin Goor VITO Flemish Institute for Technological Research Belgium /11/
gebruiken voor aardse toepassingen
26/03/2014 Satellietgegevens gebruiken voor aardse toepassingen Dirk Van Speybroeck dirk.vanspeybroeck@vito.be VITO, VIsion on TechnOlogy» een op Europees vlak toonaangevend, onafhankelijk onderzoeks-
More informationEUMETSAT DATA CENTRES AND ARCHIVE AND LONG-TERM DATA PRESERVATION
Prepared by EUMETSAT Agenda Item: WGIV/5 EUMETSAT DATA CENTRES AND ARCHIVE AND LONG-TERM DATA PRESERVATION The importance of historic data and products derived from Meteorological Satellites, e.g. for
More informationThe Matsu Wheel: A Cloud-based Scanning Framework for Analyzing Large Volumes of Hyperspectral Data
The Matsu Wheel: A Cloud-based Scanning Framework for Analyzing Large Volumes of Hyperspectral Data Maria Patterson, PhD Open Science Data Cloud Center for Data Intensive Science (CDIS) University of Chicago
More informationCloud Computing @ JPL Science Data Systems
Cloud Computing @ JPL Science Data Systems Emily Law, GSAW 2011 Outline Science Data Systems (SDS) Space & Earth SDSs SDS Common Architecture Components Key Components using Cloud Computing Use Case 1:
More informationForestry Thematic Exploitation Platform Earth Observation Open Science 2.0
Forestry Thematic Exploitation Platform Earth Observation Open Science 2.0 Tuomas Häme VTT Technical Research of Finland Ltd and the Forestry TEP Team Objective One-stop shop for forestry remote sensing
More informationBig Data Analytics Platform @ Nokia
Big Data Analytics Platform @ Nokia 1 Selecting the Right Tool for the Right Workload Yekesa Kosuru Nokia Location & Commerce Strata + Hadoop World NY - Oct 25, 2012 Agenda Big Data Analytics Platform
More informationData Integration Checklist
The need for data integration tools exists in every company, small to large. Whether it is extracting data that exists in spreadsheets, packaged applications, databases, sensor networks or social media
More informationAdding Big Earth Data Analytics to GEOSS
Research funded through EU FP7 283610 EarthServer European Scalable Earth Science Service Environment Adding Big Earth Data Analytics to GEOSS GEO IX Plenary Foz do Iguacu, 2012-nov-20 Peter Baumann, Stefano
More informationData Governance in the Hadoop Data Lake. Kiran Kamreddy May 2015
Data Governance in the Hadoop Data Lake Kiran Kamreddy May 2015 One Data Lake: Many Definitions A centralized repository of raw data into which many data-producing streams flow and from which downstream
More informationDashboard Engine for Hadoop
Matt McDevitt Sr. Project Manager Pavan Challa Sr. Data Engineer June 2015 Dashboard Engine for Hadoop Think Big Start Smart Scale Fast Agenda Think Big Overview Engagement Model Solution Offerings Dashboard
More informationAgile Analytics on Extreme-Size Earth Science Data
Agile Analytics on Extreme-Size Earth Science Data COPERNICUS Big Data Workshop Brussels / BE, 2014-mar-14 Peter Baumann Jacobs University rasdaman GmbH p.baumann@jacobs-university.de What are the Big
More informationLuncheon Webinar Series May 13, 2013
Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration
More informationData Governance in the Hadoop Data Lake. Michael Lang May 2015
Data Governance in the Hadoop Data Lake Michael Lang May 2015 Introduction Product Manager for Teradata Loom Joined Teradata as part of acquisition of Revelytix, original developer of Loom VP of Sales
More informationA standards-based open source processing chain for ocean modeling in the GEOSS Architecture Implementation Pilot Phase 8 (AIP-8)
NATO Science & Technology Organization Centre for Maritime Research and Experimentation (STO-CMRE) Viale San Bartolomeo, 400 19126 La Spezia, Italy A standards-based open source processing chain for ocean
More informationMission Operations and Ground Segment
ESA Earth Observation Info Days Mission Operations and Ground Segment ESA EO Ground Segment and Mission Operations department (EOP-G) May 2013 EOEP 2013 Page 1 ESA Unclassified For Official Use MISSION
More informationCopernicus Space Component ESA Data Access Overview J. Martin (ESA), R. Knowelden (Airbus D&S)
Copernicus Space Component ESA Data Access Overview J. Martin (ESA), R. Knowelden (Airbus D&S) Introduction and Context Operational Scenarios Translation into interfaces Translation into services Current
More informationBIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON
BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing
More informationMatsu: An Elastic Cloud Connected to a SensorWeb for Disaster. (Session 12F Working Group: Cloud Computing for Spacecraft Operations)
Matsu: An Elastic Cloud Connected to a SensorWeb for Disaster Response (Session 12F Working Group: Cloud Computing for Spacecraft Operations) Daniel Mandl - NASA/GSFC 3/2/11 1 SensorWeb High Level Architecture
More informationBig Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies
Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data: Global Digital Data Growth Growing leaps and bounds by 40+% Year over Year! 2009 =.8 Zetabytes =.08
More informationAre You Big Data Ready?
ACS 2015 Annual Canberra Conference Are You Big Data Ready? Vladimir Videnovic Business Solutions Director Oracle Big Data and Analytics Introduction Introduction What is Big Data? If you can't explain
More information320473 Databases & Web Applications Lab 320454 Big Data Project A
320473 Databases & Web Applications Lab 320454 Big Data Project A Instructor: Peter Baumann email: p.baumann@jacobs-university.de tel: -3178 office: room 88, Research 1 320302 Databases & Web Applications
More informationLong Term Preservation of Earth Observation Space Data. Preservation Workflow
Long Term Preservation of Earth Observation Space Data Preservation Workflow CEOS-WGISS Doc. Ref.: CEOS/WGISS/DSIG/PW Data Stewardship Interest Group Date: March 2015 Issue: Version 1.0 Preservation Workflow
More informationVinay K Dadhwal Director. 50 th Session of Scientific & Technical Subcommittee of COPUOS, 11-22 Feb., 2013, Vienna
Vinay K Dadhwal Director 50 th Session of Scientific & Technical Subcommittee of COPUOS, 11-22 Feb., 2013, Vienna Demonstrated applications of EO for natural resources, infrastructure, planning & disaster
More informationEuropean Archival Records and Knowledge Preservation Database Archiving in the E-ARK Project
European Archival Records and Knowledge Preservation Database Archiving in the E-ARK Project Janet Delve, University of Portsmouth Kuldar Aas, National Archives of Estonia Rainer Schmidt, Austrian Institute
More informationStandards for Big Data in the Cloud
Standards for Big Data in the Cloud International Cloud Symposium 15/10/2013 Carola Carstens (Project Officer) DG CONNECT, Unit G3 Data Value Chain European Commission Outline 1) Data Value Chain Unit
More informationEGI services for distribution and federation of data and computing
EGI services for distribution and federation of data and computing Tiziana Ferrari Technical Director, EGI.eu tiziana.ferrari@egi.eu March 2014 EGI-InSPIRE RI-261323 1 Accelerating Excellent Science MISSION.
More informationEnd to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ
End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,
More informationBig Data Analytics WG: Use Case Array Databases
Big Data Analytics WG: Use Case Array Databases RDA 4th Plenary 2014-sep-22, Amsterdam, The Netherlands Peter Baumann Jacobs University rasdaman GmbH baumann@rasdaman.com Structural Variety in Big Data
More informationProcessing, Cataloguing and Distribution of UAS Images in Near-Real-Time. Andreas Kühnen GEOSYSTEMS
Processing, Cataloguing and Distribution of UAS Images in Near-Real-Time Andreas Kühnen GEOSYSTEMS Copyright GEOSYSTEMS GmbH 2013. Irrtum und Änderungen vorbehalten. R&D project of German Army System zur
More informationExtend your analytic capabilities with SAP Predictive Analysis
September 9 11, 2013 Anaheim, California Extend your analytic capabilities with SAP Predictive Analysis Charles Gadalla Learning Points Advanced analytics strategy at SAP Simplifying predictive analytics
More informationSimplifying Big Data Analytics: Unifying Batch and Stream Processing. John Fanelli,! VP Product! In-Memory Compute Summit! June 30, 2015!!
Simplifying Big Data Analytics: Unifying Batch and Stream Processing John Fanelli,! VP Product! In-Memory Compute Summit! June 30, 2015!! Streaming Analy.cs S S S Scale- up Database Data And Compute Grid
More informationA Web Service based U.S. Cropland Visualization, Dissemination and Querying System
A Web Service based U.S. Cropland Visualization, Dissemination and Querying System Rick Mueller, Zhengwei Yang, and Dave Johnson USDA/National Agricultural Statistics Service Weiguo Han and Liping Di GMU/Center
More informationGENESIS Employing Web Processing Services and Sensor Web Technology for Environmental Management
GENESIS Employing Web Processing Services and Sensor Web Technology for Environmental Management Steven Smolders (1), Christian Alegre (2), Simone Gianfranceschi (3), Marc Gilles (4), Bernd Resch (5),
More informationIntegrating Hadoop. Into Business Intelligence & Data Warehousing. Philip Russom TDWI Research Director for Data Management, April 9 2013
Integrating Hadoop Into Business Intelligence & Data Warehousing Philip Russom TDWI Research Director for Data Management, April 9 2013 TDWI would like to thank the following companies for sponsoring the
More informationBig Data and New Paradigms in Information Management. Vladimir Videnovic Institute for Information Management
Big Data and New Paradigms in Information Management Vladimir Videnovic Institute for Information Management 2 "I am certainly not an advocate for frequent and untried changes laws and institutions must
More informationAngelos Tzotsos IMIS Athena, Scientific & Technical Manager OSGeo Charter Member Copernicus Big Data Workshop, March 2014
Angelos Tzotsos IMIS Athena, Scientific & Technical Manager OSGeo Charter Member Copernicus Big Data Workshop, March 2014 Genesis of the project Consortium established on active research, commercial, and
More informationData and Information Management for EO Data Centers. Eberhard Mikusch German Aerospace Center - German Remote Sensing Data Center
Data and Information Management for EO Data Centers Eberhard Mikusch German Aerospace Center - Mexico, 23. 04 2008 Earth Observation System Environment at DLR/DFD 10010 00101 Radar 10010 00101 Atmospheric
More informationand Deployment Roadmap for Satellite Ground Systems
A Cloud-Based Reference Model and Deployment Roadmap for Satellite Ground Systems 2012 Ground System Architectures Workshop February 29, 2012 Dr. Craig A. Lee The Aerospace Corporation The Aerospace Corporation
More informationHow to avoid building a data swamp
How to avoid building a data swamp Case studies in Hadoop data management and governance Mark Donsky, Product Management, Cloudera Naren Korenu, Engineering, Cloudera 1 Abstract DELETE How can you make
More informationPROPOSAL To Develop an Enterprise Scale Disease Modeling Web Portal For Ascel Bio Updated March 2015
Enterprise Scale Disease Modeling Web Portal PROPOSAL To Develop an Enterprise Scale Disease Modeling Web Portal For Ascel Bio Updated March 2015 i Last Updated: 5/8/2015 4:13 PM3/5/2015 10:00 AM Enterprise
More informationA New Cloud-based Deployment of Image Analysis Functionality
243 A New Cloud-based Deployment of Image Analysis Functionality Thomas BAHR 1 and Bill OKUBO 2 1 Exelis Visual Information Solutions GmbH, Gilching/Germany thomas.bahr@exelisvis.com 2 Exelis Visual Information
More informationA very short talk about Apache Kylin Business Intelligence meets Big Data. Fabian Wilckens EMEA Solutions Architect
A very short talk about Apache Kylin Business Intelligence meets Big Data Fabian Wilckens EMEA Solutions Architect 1 The challenge today 2 Very quickly: OLAP Online Analytical Processing How many beers
More informationApache Hadoop: The Big Data Refinery
Architecting the Future of Big Data Whitepaper Apache Hadoop: The Big Data Refinery Introduction Big data has become an extremely popular term, due to the well-documented explosion in the amount of data
More informationHortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015
Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015 We Do Hadoop Fall 2014 Page 1 HDP delivers a comprehensive data management platform GOVERNANCE Hortonworks Data Platform
More informationRich Media & HD Video Streaming Integration with Brightcove
Rich Media & HD Video Streaming Integration with Brightcove IBM Digital Experience Version 8.5 Web Content Management IBM Ecosystem Development 2014 IBM Corporation Please Note IBM s statements regarding
More informationHow To Work With Big Data From Space In Europe
Industry & SMEs Round Table 2014 Conference on Big Data from Space (BiDS '14) Dr. Florin Serban Dr. Catalin Cucu-Dumitrescu 12-14 November 2014, ESRIN, Frascati, Italy Main aspects to be presented: Status
More informationImproving Data Processing Speed in Big Data Analytics Using. HDFS Method
Improving Data Processing Speed in Big Data Analytics Using HDFS Method M.R.Sundarakumar Assistant Professor, Department Of Computer Science and Engineering, R.V College of Engineering, Bangalore, India
More informationOn the Radar: Tessella
On the Radar: Tessella Creating an archive for the long-term preservation of digital content Reference Code: IT014-002789 Publication Date: 04 Sep 2013 Author: Sue Clarke SUMMARY Catalyst Ensuring that
More informationAstrium GEO UK Multi-Mission PDGS Facilities and Services
Astrium GEO UK Multi-Mission PDGS Facilities and Services Introduction UK-MM-PAC ERS-1/2 UK-MM-PAC ENVISAT Data Hosting Activities Future Activities Infoterra Archives LTDP Preparation Collaborative Activities
More informationThe Trials and Tribulations and ultimate success of parallelisation using Hadoop within the SCAPE project
The Trials and Tribulations and ultimate success of parallelisation using Hadoop within the SCAPE project Alastair Duncan STFC Pre Coffee talk STFC July 2014 SCAPE Scalable Preservation Environments The
More informationUnifying the Enterprise Data Hub and the Integrated Data Warehouse
Unifying the Enterprise Data Hub and the Integrated Data Warehouse CONTENTS Encompassing All of the Big Data Universe 1 The Ideal Structure 2 The Enterprise Data Hub: Refining Raw Data 3 The Integrated
More informationSector vs. Hadoop. A Brief Comparison Between the Two Systems
Sector vs. Hadoop A Brief Comparison Between the Two Systems Background Sector is a relatively new system that is broadly comparable to Hadoop, and people want to know what are the differences. Is Sector
More informationWhy archiving erecords influences the creation of erecords. Martin Stürzlinger scopepartner Vienna, Austria
Why archiving erecords influences the creation of erecords Martin Stürzlinger scopepartner Vienna, Austria Electronic Records In a Productive System Created Used Changed Deleted In an Archival System No
More informationARIS 9ARIS 9.6 map and Future Directions Die nächste Generation des Geschäftsprozessmanagements
ARIS 9ARIS 9.6 map and Future Directions Die nächste Generation des Geschäftsprozessmanagements Dr. Katrina Simon ARIS Product Management 2014 Software AG. All rights reserved. ARIS @ Software AG 2M END
More informationIBM InfoSphere Guardium Data Activity Monitor for Hadoop-based systems
IBM InfoSphere Guardium Data Activity Monitor for Hadoop-based systems Proactively address regulatory compliance requirements and protect sensitive data in real time Highlights Monitor and audit data activity
More informationOpen Access The Cooperative Study Between the Hadoop Big Data Platform and the Traditional Data Warehouse
Send Orders for Reprints to reprints@benthamscience.ae 1144 The Open Automation and Control Systems Journal, 2015, 7, 1144-1152 Open Access The Cooperative Study Between the Hadoop Big Data Platform and
More informationCROSS PLATFORM AUTOMATIC FILE REPLICATION AND SERVER TO SERVER FILE SYNCHRONIZATION
1 E N D U R A D A T A EDpCloud: A File Synchronization, Data Replication and Wide Area Data Distribution Solution CROSS PLATFORM AUTOMATIC FILE REPLICATION AND SERVER TO SERVER FILE SYNCHRONIZATION 2 Resilient
More informationIntroduction to Hadoop HDFS and Ecosystems. Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data
Introduction to Hadoop HDFS and Ecosystems ANSHUL MITTAL Slides credits: Cloudera Academic Partners Program & Prof. De Liu, MSBA 6330 Harvesting Big Data Topics The goal of this presentation is to give
More informationHandling Heterogeneous EO Datasets via the Web Coverage Processing Service
Handling Heterogeneous EO Datasets via the Web Coverage Processing Service Piero Campalani a*, Simone Mantovani b, Alan Beccati a, a a a Jacobs University Bremen (DE) / b MEEO Srl (IT) * {p.campalani@jacobs-university.de
More informationTrustworthiness of Big Data
Trustworthiness of Big Data International Journal of Computer Applications (0975 8887) Akhil Mittal Technical Test Lead Infosys Limited ABSTRACT Big data refers to large datasets that are challenging to
More informationSen-2 Agri System : Champion Users and Site Managers feedback
Sen-2 Agri System : Champion Users and Site Managers feedback 2 nd Sen2-Agri UsersWorkshop 18-19 Nov. 2015 Brussels, Belgium Sen-2Agri data flow Sen-2Agri system interface Skills requirement to run the
More informationTableau s Place in a Big Data Architecture DAMA, Tableau User Group Meeting November 13, 2014
s Place in a Big Data Architecture DAA, User Group eeting November 13, 2014 Agenda BI/DW Workload Categories & Three Integration odels Capability odels Architecture Patterns Summary Q & A 2 Workload Categories
More informationGanzheitliches Datenmanagement
Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist
More informationOracle Database - Engineered for Innovation. Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya
Oracle Database - Engineered for Innovation Sedat Zencirci Teknoloji Satış Danışmanlığı Direktörü Türkiye ve Orta Asya Oracle Database 11g Release 2 Shipping since September 2009 11.2.0.3 Patch Set now
More informationLeveraging Big Data Technologies to Support Research in Unstructured Data Analytics
Leveraging Big Data Technologies to Support Research in Unstructured Data Analytics BY FRANÇOYS LABONTÉ GENERAL MANAGER JUNE 16, 2015 Principal partenaire financier WWW.CRIM.CA ABOUT CRIM Applied research
More informationEO data hosting and processing core capabilities and emerging solutions
EO data hosting and processing core capabilities and emerging solutions Andrew Groom 4 th March 2015 Contents An introduction to Airbus Defence and Space, Geo-Intelligence Elements of the C3S vision EO
More informationImpact of Big Data in Oil & Gas Industry. Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India.
Impact of Big Data in Oil & Gas Industry Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India. New Age Information 2.92 billions Internet Users in 2014 Twitter processes 7 terabytes
More informationAgenda. Big Data & Hadoop ViPR HDFS Pivotal Big Data Suite & ViPR HDFS ViON Customer Feedback #EMCVIPR
1 Agenda Big Data & Hadoop ViPR HDFS Pivotal Big Data Suite & ViPR HDFS ViON Customer Feedback 2 A World of Connected Devices Need a new data management architecture for Internet of Things 21% the % of
More informationLong-term archiving and preservation planning
Long-term archiving and preservation planning Workflow in digital preservation Hilde van Wijngaarden Head, Digital Preservation Department National Library of the Netherlands The Challenge: Long-term Preservation
More informationBuilding Confidence in Big Data Innovations in Information Integration & Governance for Big Data
Building Confidence in Big Data Innovations in Information Integration & Governance for Big Data IBM Software Group Important Disclaimer THE INFORMATION CONTAINED IN THIS PRESENTATION IS PROVIDED FOR INFORMATIONAL
More informationGOSIC NEXRAD NIDIS NOMADS
NOAA National Climatic Data Center GOSIC NEXRAD NIDIS NOMADS Christina Lief NOAA/NESDIS/NCDC GOSIC Program Manager NOAA/NESDIS/NCDC Asheville, NC 28801 GEOSS AIP Phase 2 Workshop September 25-26, 2008
More informationSustainable Development with Geospatial Information Leveraging the Data and Technology Revolution
Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights
More informationBuilding a real-time, self-service data analytics ecosystem Greg Arnold, Sr. Director Engineering
Building a real-time, self-service data analytics ecosystem Greg Arnold, Sr. Director Engineering Self Service at scale 6 5 4 3 2 1 ? Relational? MPP? Hadoop? Linkedin data 350M Members 25B 3.5M 4.8B 2M
More information1 st Symposium on Colossal Data and Networking (CDAN-2016) March 18-19, 2016 Medicaps Group of Institutions, Indore, India
1 st Symposium on Colossal Data and Networking (CDAN-2016) March 18-19, 2016 Medicaps Group of Institutions, Indore, India Call for Papers Colossal Data Analysis and Networking has emerged as a de facto
More informationNASA s Big Data Challenges in Climate Science
NASA s Big Data Challenges in Climate Science Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at IEEE Big Data 2014 Workshop October 29, 2014 1 2 7-km GEOS-5 Nature Run
More informationPRIME DIMENSIONS. Revealing insights. Shaping the future.
PRIME DIMENSIONS Revealing insights. Shaping the future. Service Offering Prime Dimensions offers expertise in the processes, tools, and techniques associated with: Data Management Business Intelligence
More informationThis Symposium brought to you by www.ttcus.com
This Symposium brought to you by www.ttcus.com Linkedin/Group: Technology Training Corporation @Techtrain Technology Training Corporation www.ttcus.com Big Data Analytics as a Service (BDAaaS) Big Data
More informationearthnet online The ESA Earth Observation Multi-Mission User Information Services
r bulletin 93 february 1998 earthnet online The ESA Earth Observation Multi-Mission User Information Services G. Landgraf & L. Fusco Remote Sensing Exploitation Department, ESA Directorate of Application
More informationAgile Retrieval of Big Data with. EarthServer. ECMWF Visualization Week, Reading, 2015-sep-29
Agile Retrieval of Big Data with EarthServer ECMWF Visualization Week, Reading, 2015-sep-29 Peter Baumann Jacobs University rasdaman GmbH baumann@rasdaman.com [co-funded by EU through EarthServer, PublicaMundi]
More informationThe USGS Landsat Big Data Challenge
The USGS Landsat Big Data Challenge Brian Sauer Engineering and Development USGS EROS bsauer@usgs.gov U.S. Department of the Interior U.S. Geological Survey USGS EROS and Landsat 2 Data Utility and Exploitation
More informationThe IBM Archive Cloud Project: Compliant Archiving into the Cloud
Christian Bolik, IBM Research & Development, November 2010 The IBM Archive Cloud Project: Compliant Archiving into the Cloud (...or in German: Revisionssichere Ablage in der Cloud) Disclaimer Copyright
More informationLevels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1
Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model Dr.
More informationData Warehousing. Overview, Terminology, and Research Issues. Joachim Hammer. Joachim Hammer
Data Warehousing Overview, Terminology, and Research Issues 1 Heterogeneous Database Integration Integration System World Wide Web Digital Libraries Scientific Databases Personal Databases Collects and
More informationExploitation of ISS scientific data
Cooperative ISS Research data Conservation and Exploitation Exploitation of ISS scientific data Luigi Carotenuto Telespazio s.p.a. Copernicus Big Data Workshop March 13-14 2014 European Commission Brussels
More informationIMAGINES_VALIDATIONSITESNETWORK ISSUE 1.00. EC Proposal Reference N FP7-311766. Name of lead partner for this deliverable: EOLAB
Date Issued: 26.03.2014 Issue: I1.00 IMPLEMENTING MULTI-SCALE AGRICULTURAL INDICATORS EXPLOITING SENTINELS RECOMMENDATIONS FOR SETTING-UP A NETWORK OF SITES FOR THE VALIDATION OF COPERNICUS GLOBAL LAND
More informationHortonworks & SAS. Analytics everywhere. Page 1. Hortonworks Inc. 2011 2014. All Rights Reserved
Hortonworks & SAS Analytics everywhere. Page 1 A change in focus. A shift in Advertising From mass branding A shift in Financial Services From Educated Investing A shift in Healthcare From mass treatment
More informationImplement Hadoop jobs to extract business value from large and varied data sets
Hadoop Development for Big Data Solutions: Hands-On You Will Learn How To: Implement Hadoop jobs to extract business value from large and varied data sets Write, customize and deploy MapReduce jobs to
More informationWednesday, October 6, 2010
Evolving a New Analytical Platform What Works and What s Missing Jeff Hammerbacher Chief Scientist, Cloudera October 10, 2010 My Background Thanks for Asking hammer@cloudera.com Studied Mathematics at
More informationInformation Architecture
The Bloor Group Actian and The Big Data Information Architecture WHITE PAPER The Actian Big Data Information Architecture Actian and The Big Data Information Architecture Originally founded in 2005 to
More informationData processing goes big
Test report: Integration Big Data Edition Data processing goes big Dr. Götz Güttich Integration is a powerful set of tools to access, transform, move and synchronize data. With more than 450 connectors,
More informationThe Future of Data Management with Hadoop and the Enterprise Data Hub
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah Cofounder & CTO, Cloudera, Inc. Twitter: @awadallah 1 2 Cloudera Snapshot Founded 2008, by former employees of Employees
More informationThe only 100% open source, complete and flexible Business Intelligence suite
The only 100% open source, complete and flexible Business Intelligence suite by SpagoBI Competency Center - Engineering Group SpagoBI was awarded the Open Innovation Award at Open World Forum 2011 April
More informationSession 0202: Big Data in action with SAP HANA and Hadoop Platforms Prasad Illapani Product Management & Strategy (SAP HANA & Big Data) SAP Labs LLC,
Session 0202: Big Data in action with SAP HANA and Hadoop Platforms Prasad Illapani Product Management & Strategy (SAP HANA & Big Data) SAP Labs LLC, Bellevue, WA Legal disclaimer The information in this
More information27/01/2014. Workflows for Remote Sensing Data Processing: Software Development Strategy & Designing Operational Scenarios
27/01/2014 Workflows for Remote Sensing Data Processing: Software Development Strategy & Designing Operational Scenarios SW Development strategy Life cycle model Project-driven evolutionary life-cycle
More informationOpenAIRE Research Data Management Briefing paper
OpenAIRE Research Data Management Briefing paper Understanding Research Data Management February 2016 H2020-EINFRA-2014-1 Topic: e-infrastructure for Open Access Research & Innovation action Grant Agreement
More informationCopernicus Space Component Data Access Architecture. Meeting with Austria 27 May 2014, Vienna
Copernicus Space Component Data Access Architecture Meeting with Austria 27, Vienna Copernicus Data Policy Users shall have free, full and open access to Copernicus dedicated Sentinel data and Copernicus
More informationApplying Apache Hadoop to NASA s Big Climate Data!
National Aeronautics and Space Administration Applying Apache Hadoop to NASA s Big Climate Data! Use Cases and Lessons Learned! Glenn Tamkin (NASA/CSC)!! Team: John Schnase (NASA/PI), Dan Duffy (NASA/CO),!
More informationEmbedded Analytics & Big Data Visualization in Any App
Embedded Analytics & Big Data Visualization in Any App Boney Pandya Marketing Manager Greg Harris Systems Engineer Follow us @Jinfonet Our Mission Simplify the Complexity of Reporting and Visualization
More informationDigital Preservation Lifecycle Management
Digital Preservation Lifecycle Management Building a demonstration prototype for the preservation of large-scale multi-media collections Arcot Rajasekar San Diego Supercomputer Center, University of California,
More informationVulnerability assessment of ecosystem services for climate change impacts and adaptation (VACCIA)
Vulnerability assessment of ecosystem services for climate change impacts and adaptation (VACCIA) Action 2: Derivation of GMES-related remote sensing data Deliverable 1: Time-series of Earth Observation
More information