DIVER (Data Integration Visualization Exploration and Reporting)

Size: px
Start display at page:

Download "DIVER (Data Integration Visualization Exploration and Reporting)"

Transcription

1 DIVER (Data Integration Visualization Exploration and Reporting) Data Warehouse and Query Tools For the Deepwater Horizon Natural Resource Damage Assessment Data and Beyond Jay Coady I.M Systems Group Ben Shorr Spatial Data Branch Assessment & Restoration Division NOAA National Ocean Service Office of Response and Restoration 4/24/2015

2 How to effectively manage unprecedented amounts of environmental data and analysis? Leverage big data techniques Data warehouse and information portal Ingest, integrate and organize information. Business Intelligence Question Environmental Intelligence 2

3 Presentation Overview Background on NRDA and Data Sources Variations in data sources with the need to bring together across the NRDA case Data Warehouse Solution Flexible/scalable framework; data models and standards; related information/data DIVER Explorer (Data Query and Delivery) Query, reporting and export tools- supporting scientific analysis and reports for the Damage Assessment case 3

4 Natural Resource Damage Assessment (NRDA) 1) Preliminary Assessment (exposure assessment) 2) Injury Assessment/Restoration Planning Field Studies Data Evaluation Modeling Injury Quantification 3) Restoration Implementation

5 Marsh Assessment Shoreline Data Toxicity Data Oyster Collections Water Column Telemetry Data Seafood Safety Marine Mammal & Turtle Assessment

6 How did we get here? Vast amount of NRDA and Response data collected under different authorities, different formats, different destinations and management We (NOAA OR&R and partners) were part of key NRDA and Response data streams early and created: On-line repositories including File Collections Secure FTP (File Transfer Protocol) Site National Oceanographic Data Center (NODC) Archive

7 File Collections (aka NOAANRDA website)

8 Signal to Noise 1.5 years into NRDA case Priority of Measure Implementation Preliminary Measures and Dimensions; Priority of "Questions to Answer"; Data Sources that can be used to Answer Questions Dimensions (Ways to slice the Question) Measures (The Question to Answer) Time Spatial Depth Sample Type Habitat Site Study Workplan/Method Instrument Type Oiling Species Hypothesis Status Lab Current Data Warehouse Pulling Data From: 1 Contaminant Lab Results X X X X X X X X X X X X X Validated EDD, QM 2 Observation Data X X X X X X X X X X X X nn.org 3 Additional Lab Data Results X X X X X X X X X X X X X nn.org, 50+ labs 4 Response Activities Count and Duration X X X X X X X Spatial Data Team 5 Species Count X X X X X X X X X Observation (nn.org), Telemetry 6 Instrument Results X X X X X X X X X X X TBD: - Photographs (Photologger) - Video Clips (TBD-"Kaltura?") - Acoustic Clips (TBD-"Kaltura?") Multiple: NODC, Source, Database per Instrument (Currently does not exist)

9 Data Warehouse Approach Ingest Data Bring in data from different sources; flexible and scalable Adopt or adapt existing standards; develop and document new standards Manage structured and unstructured data/information Litigation quality Documented processes Relate Information Examples: samples and observations; field data and photographs 9

10 Common Data Model Examples (schemas) Samples: chemistry (QM), biological, more Oceanographic: cruise-collected sensor data Observations: shoreline, marsh, birds and mammals Telemetry: location tracking devices Photographs: keywords, location Restoration data: potential and implemented projects 10

11 Data Warehouse and Standardization Collate Source Data Apply Business Intelligence / ETL * Methods DIVER Data Warehouse Data Integration DIVER Explorer Visualization, Exploration, and Reporting Samples Samples Oceanographic Ocean Data Steps include: 1. Define the common model Telemetry Observations DIVER S COMMON DATA MODELS Restoration Photos 2. Accommodate additional data 3. STANDARDIZE Related Information Observations 4. Incorporate QA/QC, Validation and Auditing Visualization (ERMA, GIS) Export Photos *Extract-Transform-Load 11 Data for analysis Reports Technical Memos Publications Litigation Distribution

12 Data Integration Visualization Exporting and Reporting: DIVER Explorer Application Queries: Guided, Custom & Saved Download Data Packages Map & Legend Query by Shape Data Summary Data Tables Charts Photos Metadata Study Notes Export 12

13 DIVER Explorer: Guided Queries 13

14 Data Summary Data Table Charts Metadata Study Notes Export

15 DIVER Explorer: Dashboard Approach Data Summary

16 DIVER Explorer: Dashboard Approach Data Table

17 DIVER Explorer: Dashboard Approach Data Table

18 DIVER Explorer: Dashboard Approach

19 DIVER Explorer: Dashboard Approach

20 DIVER Explorer: Dashboard Approach

21 DIVER Explorer: Dashboard Approach

22 DIVER Explorer: Export

23 DIVER Explorer: Export

24 DIVER Explorer: Export

25 DIVER Explorer: Query By Shape Draw and Edit; Buffers; Standard Query Shapes

26 Export Packages: DIVER Explorer Exports Includes full FGDC Metadata (Federal Geographic Data Committee) Spreadsheet; Shapefile (GIS); KML (Google Earth) Electronic field data (spreadsheets) Automated output of updated data to: Gulf Spill Restoration and ERMA Gulf Response:

27 Public DIVER for Deepwater Horizon

28 DIVER Strategy for Data Management and Public DWH DIVER site Query Tools Make validated data (and approach) accessible to scientists, academia and public audience National DIVER OR&R developing public Regional DIVER sites, Contaminant Chemistry, Photos, Restoration, Response & Restoration data models Developing field data collection capability based on DWH techniques and tools

29 15 minutes goes quickly when you re talking big data! Technical Details: Amazon AWS; FedRAMP; NIST security standards compliant Liferay Portal Pentaho Data Integration tools PostgreSQL/PostGIS Infobright (Hadoop integration) Mapserver/OpenLayers Dojo Toolkit Javascript library Custom Java API and query engine Agile development approach: (data management and tool development) Senior Team (and co-authors): Dr. Amy Merten (Spatial Data Branch Chief) Ben Shorr (Spatial Data Branch) Jay Coady (I.M Systems Group Spatial Data Branch) Dan Hudgens (IEc Inc.) Neal Etre (IEc, Inc.) Jim Anderton (Solea Consulting) Jerry Bower (Sirius Computer Solutions)

Assessment and Restoration Division Data Management Strategy. Ben Shorr - Lead Author NOAA OR&R Assessment & Restoration Division April 2015

Assessment and Restoration Division Data Management Strategy. Ben Shorr - Lead Author NOAA OR&R Assessment & Restoration Division April 2015 Assessment and Restoration Division Data Management Strategy Ben Shorr - Lead Author NOAA OR&R Assessment & Restoration Division April 2015 This page is intentionally blank. Assessment and Restoration

More information

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies

Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data, Cloud Computing, Spatial Databases Steven Hagan Vice President Server Technologies Big Data: Global Digital Data Growth Growing leaps and bounds by 40+% Year over Year! 2009 =.8 Zetabytes =.08

More information

The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment

The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment George Graettinger NOAA s Ocean Service, Office of Response & Restoration Oil Observing Tools Training & Workshop

More information

The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment

The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment The Application of Synthetic Aperture Radar (SAR) to Natural Resource Damage Assessment George Graettinger, GIS Project Manager Jay Coady, Nicolas Eckhardt, Mathew Dorsey, and Paul Whelan NOAA s Ocean

More information

GeoKettle: A powerful open source spatial ETL tool

GeoKettle: A powerful open source spatial ETL tool GeoKettle: A powerful open source spatial ETL tool FOSS4G 2010 Dr. Thierry Badard, CTO Spatialytics inc. Quebec, Canada tbadard@spatialytics.com Barcelona, Spain Sept 9th, 2010 What is GeoKettle? It is

More information

Introduction to Natural Resource Damage Assessment NRDA

Introduction to Natural Resource Damage Assessment NRDA Introduction to Natural Resource Damage Assessment NRDA Topics Overview Legal: Laws and Regulations NRDA Process Restoration in the Arctic Summary 2 Top Three Things to Know Three liabilities from oil

More information

Introduction to Natural Resource Damage Assessment

Introduction to Natural Resource Damage Assessment Introduction to Natural Resource Damage Assessment Topics Overview Legal: Laws and Regulations NRDA Process Scaling Injuries and Restoration Restoration in the Arctic Summary 2 1 Top Three Things to Know

More information

Sextant. Spatial Data Infrastructure for Marine Environment. C. Satra Le Bris, E. Quimbert, M. Treguer

Sextant. Spatial Data Infrastructure for Marine Environment. C. Satra Le Bris, E. Quimbert, M. Treguer Sextant On-Line information system for marine geographical information E. Quimbert, M. Bellouis, F. Lecuy, M. Treguer Centre de Bretagne BP 70, Plouzané 29280 France E-mail: sextant@ifremer.fr Sextant

More information

Background on Elastic Compute Cloud (EC2) AMI s to choose from including servers hosted on different Linux distros

Background on Elastic Compute Cloud (EC2) AMI s to choose from including servers hosted on different Linux distros David Moses January 2014 Paper on Cloud Computing I Background on Tools and Technologies in Amazon Web Services (AWS) In this paper I will highlight the technologies from the AWS cloud which enable you

More information

Overview of Atlantic Offshore Renewable Energy Studies Program. Brian Hooker Office of Renewable Energy Programs

Overview of Atlantic Offshore Renewable Energy Studies Program. Brian Hooker Office of Renewable Energy Programs Overview of Atlantic Offshore Renewable Energy Studies Program Brian Hooker Office of Renewable Energy Programs February 2012 Completed Studies of Interest Compendium of Avian Information and Comprehensive

More information

Lecture 8. Online GIS

Lecture 8. Online GIS Lecture 8 Online GIS Lecture 8: Outline I. Online GIS 1. Google Earth 2. MSN Live Maps II. Open Source GIS III. ArcGIS Server and the ESRI suite of online software utility options IV. Advanced Data Mining

More information

There are various ways to find data using the Hennepin County GIS Open Data site:

There are various ways to find data using the Hennepin County GIS Open Data site: Finding Data There are various ways to find data using the Hennepin County GIS Open Data site: Type in a subject or keyword in the search bar at the top of the page and press the Enter key or click the

More information

Data Management Plan FAQs

Data Management Plan FAQs Data Management Plan FAQs This document is for Questions and Answers about NOAA s new data management plan requirements. It will be updated as new information becomes available. Questions and Answers from

More information

NODC s Data Stewardship for Jason-2 and Jason-3

NODC s Data Stewardship for Jason-2 and Jason-3 NODC s Data Stewardship for Jason-2 and Jason-3 Meeting October, 2013 Dr. Deirdre A. Byrne Dr. Yongsheng Zhang NOAA/NODC 1 What is NODC? NODC was founded in 1961 as part of the Naval Oceanographic Office

More information

The Integration of Hydrographic and Oceanographic Data in a Marine Geographic Information System U.S. Hydro 2015

The Integration of Hydrographic and Oceanographic Data in a Marine Geographic Information System U.S. Hydro 2015 The Integration of Hydrographic and Oceanographic Data in a Marine Geographic Information System U.S. Hydro 2015 Karen Hart CARIS USA Oceanography and Hydrography Defined Oceanography: The branch of Earth

More information

Natural Resource Damage Assessment and Restoration

Natural Resource Damage Assessment and Restoration Natural Resource Damage Assessment and Restoration Sarah Allan NOAA Office of Response and Restoration Anchorage, AK sarah.allan@noaa.gov NOAA OR&R United States Department of Commerce National Oceanic

More information

The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA

The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA The distribution of marine OpenData via distributed data networks and Web APIs. The example of ERDDAP, the message broker and data mediator from NOAA Dr. Conor Delaney 9 April 2014 GeoMaritime, London

More information

Microsoft. Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server

Microsoft. Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server Course 20463C: Implementing a Data Warehouse with Microsoft SQL Server Length : 5 Days Audience(s) : IT Professionals Level : 300 Technology : Microsoft SQL Server 2014 Delivery Method : Instructor-led

More information

Expansion of metadata management, visualization and data processing functionality of OBIS-SEAMAP for passive acoustic monitoring data

Expansion of metadata management, visualization and data processing functionality of OBIS-SEAMAP for passive acoustic monitoring data Expansion of metadata management, visualization and data processing functionality of OBIS-SEAMAP for passive acoustic monitoring data Dr. Patrick N. Halpin Duke University Box 90328 Durham, NC 27708-0328

More information

Rakesh Tej Kumar Kalahasthi and Benson Hilbert SAP BI Practice, Bangalore, India Email: rakeshtej@gmail.com, benhilbert.hilbert@gmail.com.

Rakesh Tej Kumar Kalahasthi and Benson Hilbert SAP BI Practice, Bangalore, India Email: rakeshtej@gmail.com, benhilbert.hilbert@gmail.com. 394 Business Intelligence Journal July A SHORT COMMUNICATION ON - HOW A LEADING POWER DISTRIBUTION COMPANY EFFECTIVELY TRACKS BUSINESS AREAS LIKE SAFETY, FINANCE AND OPERATION FOR REGION AND BUSINESS WISE

More information

Deepwater Horizon Oil Spill: FWC s Response with a focus on wildlife

Deepwater Horizon Oil Spill: FWC s Response with a focus on wildlife Deepwater Horizon Oil Spill: FWC s Response with a focus on wildlife Tom Ostertag Florida Fish and Wildlife Conservation Commission Division of Habitat and Species Conservation Background April 20 -- Explosion

More information

Deepwater Horizon Oil Spill Phase I Early Restoration Plan and Environmental Assessment

Deepwater Horizon Oil Spill Phase I Early Restoration Plan and Environmental Assessment Deepwater Horizon Oil Spill Phase I Early Restoration Plan and Environmental Assessment Prepared by the Deepwater Horizon Natural Resource Trustees from State of Alabama State of Florida State of Louisiana

More information

Information Access Platforms: The Evolution of Search Technologies

Information Access Platforms: The Evolution of Search Technologies Information Access Platforms: The Evolution of Search Technologies Managing Information in the Public Sphere: Shaping the New Information Space April 26, 2010 Purpose To provide an overview of current

More information

Florida Institute of Oceanography

Florida Institute of Oceanography Florida Institute of Oceanography Dr. William T. Hogarth, Interim Director, FIO & Dr. Jyotika I. Virmani, Associate Director, FIO National Water Quality Monitoring Council New Orleans, LA May 3-5, 2011

More information

Status of Restoration in Mississippi

Status of Restoration in Mississippi Status of Restoration in Mississippi Marc Wyatt Director Office of Oil Spill Restoration, Mississippi Department of Environmental Quality Robert Kroger Chief Scientific Officer, Covington Civil and Environmental

More information

Datenverwaltung im Wandel - Building an Enterprise Data Hub with

Datenverwaltung im Wandel - Building an Enterprise Data Hub with Datenverwaltung im Wandel - Building an Enterprise Data Hub with Cloudera Bernard Doering Regional Director, Central EMEA, Cloudera Cloudera Your Hadoop Experts Founded 2008, by former employees of Employees

More information

Open Source Business Intelligence Intro

Open Source Business Intelligence Intro Open Source Business Intelligence Intro Stefano Scamuzzo Senior Technical Manager Architecture & Consulting Research & Innovation Division Engineering Ingegneria Informatica The Open Source Question In

More information

Overview of the Division of Water Restoration Assistance

Overview of the Division of Water Restoration Assistance Overview of the Division of Water Restoration Assistance Presented by Trina Vielhauer Director, Division of Water Restoration Assistance Water Restoration Assistance Trina Vielhauer Director State Revolving

More information

NCDC Strategic Vision

NCDC Strategic Vision NOAA s National Climatic Data Center World s Largest Archive of Climate and Weather Data Presented to: Coastal Environmental Disasters Data Management Workshop September 16, 2014 Stephen Del Greco Deputy

More information

Data Integration Checklist

Data Integration Checklist The need for data integration tools exists in every company, small to large. Whether it is extracting data that exists in spreadsheets, packaged applications, databases, sensor networks or social media

More information

Business Intelligence for Big Data

Business Intelligence for Big Data Business Intelligence for Big Data Will Gorman, Vice President, Engineering May, 2011 2010, Pentaho. All Rights Reserved. www.pentaho.com. What is BI? Business Intelligence = reports, dashboards, analysis,

More information

Addressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO. Big Data Everywhere Conference, NYC November 2015

Addressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO. Big Data Everywhere Conference, NYC November 2015 Addressing Risk Data Aggregation and Risk Reporting Ben Sharma, CEO Big Data Everywhere Conference, NYC November 2015 Agenda 1. Challenges with Risk Data Aggregation and Risk Reporting (RDARR) 2. How a

More information

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes

Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Capitalize on Big Data for Competitive Advantage with Bedrock TM, an integrated Management Platform for Hadoop Data Lakes Highly competitive enterprises are increasingly finding ways to maximize and accelerate

More information

STATEMENT OF WORK. NETL Cooperative Agreement DE-FC26-02NT41476

STATEMENT OF WORK. NETL Cooperative Agreement DE-FC26-02NT41476 STATEMENT OF WORK NETL Cooperative Agreement DE-FC26-02NT41476 Database and Analytical Tool for the Management of Data Derived from U. S. DOE (NETL) Funded Fine Particulate (PM 2.5 ) Research PROJECT SCOPE

More information

University of Alaska Fairbanks

University of Alaska Fairbanks University of Alaska Fairbanks MEMO To: North Pacific Research Board 1007 West Third Avenue Anchorage, Alaska 99501 From: Lori Nunemann Proposal Office School of Fisheries and Ocean Sciences Date: August

More information

Geospatial Data Stewardship at an Interdisciplinary Data Center

Geospatial Data Stewardship at an Interdisciplinary Data Center Geospatial Data Stewardship at an Interdisciplinary Data Center Robert R. Downs, PhD Senior Digital Archivist and Senior Staff Associate Officer or Research Acting Head of Cyberinfrastructure and Informatics

More information

Coastal Research Proposal Abstracts

Coastal Research Proposal Abstracts Coastal Research Proposal Abstracts An Automated Data Analysis, Processing, and Management System Proposal to NASA with SAIC Total Budget $15K Submitted 10/31/2008 The goal of this study is to design,

More information

Decoding the Big Data Deluge a Virtual Approach. Dan Luongo, Global Lead, Field Solution Engineering Data Virtualization Business Unit, Cisco

Decoding the Big Data Deluge a Virtual Approach. Dan Luongo, Global Lead, Field Solution Engineering Data Virtualization Business Unit, Cisco Decoding the Big Data Deluge a Virtual Approach Dan Luongo, Global Lead, Field Solution Engineering Data Virtualization Business Unit, Cisco High-volume, velocity and variety information assets that demand

More information

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics

More information

1. Introduction ABSTRACT

1. Introduction ABSTRACT ISPRS SIPT IGU UCI CIG ACSG Table of contents Table des matières Authors index Index des auteurs Search Recherches Exit Sortir Oceans Management Internet Mapping Application (OMIMA): A GIS Web-Based Tool

More information

Three Open Blueprints For Big Data Success

Three Open Blueprints For Big Data Success White Paper: Three Open Blueprints For Big Data Success Featuring Pentaho s Open Data Integration Platform Inside: Leverage open framework and open source Kickstart your efforts with repeatable blueprints

More information

ArcGIS. Server. A Complete and Integrated Server GIS

ArcGIS. Server. A Complete and Integrated Server GIS ArcGIS Server A Complete and Integrated Server GIS ArcGIS Server A Complete and Integrated Server GIS ArcGIS Server enables you to distribute maps, models, and tools to others within your organization

More information

Unveiling the disaster. A satellite based habitat impact assessment of the Deepwater Horizon Oil Spill

Unveiling the disaster. A satellite based habitat impact assessment of the Deepwater Horizon Oil Spill Unveiling the disaster A satellite based habitat impact assessment of the Deepwater Horizon Oil Spill Gulf of Mexico Background of the disaster The Gulf oil spill situation has evolved, and so have the

More information

In ediscovery and Litigation Support Repositories MPeterson, June 2009

In ediscovery and Litigation Support Repositories MPeterson, June 2009 XAM PRESENTATION (extensible TITLE Access GOES Method) HERE In ediscovery and Litigation Support Repositories MPeterson, June 2009 Contents XAM Introduction XAM Value Propositions XAM Use Cases Digital

More information

Big Data Spatial Analytics An Introduction

Big Data Spatial Analytics An Introduction 2013 Esri International User Conference July 8 12, 2013 San Diego, California Technical Workshop Big Data Spatial Analytics An Introduction Marwa Mabrouk Mansour Raad Esri iu UC2013. Technical Workshop

More information

CHAPTER 13: PUBLIC COMMENT ON THE DRAFT PHASE III ERP/PEIS AND RESPONSES... 1 13.1 Introduction... 1 13.2 Organization of this Chapter... 1 13.

CHAPTER 13: PUBLIC COMMENT ON THE DRAFT PHASE III ERP/PEIS AND RESPONSES... 1 13.1 Introduction... 1 13.2 Organization of this Chapter... 1 13. CHAPTER 13: PUBLIC COMMENT ON THE DRAFT PHASE III ERP/PEIS AND RESPONSES... 1 13.1 Introduction... 1 13.2 Organization of this Chapter... 1 13.3 The Comment Analysis Process... 2 13.4 Major Comment Themes...

More information

Harvard Data Visualization Project

Harvard Data Visualization Project Esri User Conference, July 12-15, San Diego California Harvard Data Visualization Project Spatio-Temporal Visualization of Global Phenomena: 1850 to the Present Harvard Business School Geoffrey Jones Walter

More information

Virginia Commonwealth University Rice Rivers Center Data Management Plan

Virginia Commonwealth University Rice Rivers Center Data Management Plan Virginia Commonwealth University Rice Rivers Center Data Management Plan Table of Contents Objectives... 2 VCU Rice Rivers Center Research Protocol... 2 VCU Rice Rivers Center Data Management Plan... 3

More information

The True Cost of the BP Oil Spill for People, Communities, and the Environment

The True Cost of the BP Oil Spill for People, Communities, and the Environment The True Cost of the BP Oil Spill for People, Communities, and the Environment Calculating economic and environmental damages from any oil spill, let alone a spill the size of BP s Deepwater Horizon is

More information

IBM BigInsights for Apache Hadoop

IBM BigInsights for Apache Hadoop IBM BigInsights for Apache Hadoop Efficiently manage and mine big data for valuable insights Highlights: Enterprise-ready Apache Hadoop based platform for data processing, warehousing and analytics Advanced

More information

Sound GIS Project Experience

Sound GIS Project Experience Project Experience Marine Vegetation Atlas for Washington State Washington Department of Natural Resources. September 2012 January 2014 supported the marine scientists of DNR s Nearshore Habitat Program

More information

Environment Canada Data Management Program. Paul Paciorek Corporate Services Branch May 7, 2014

Environment Canada Data Management Program. Paul Paciorek Corporate Services Branch May 7, 2014 Environment Canada Data Management Program Paul Paciorek Corporate Services Branch May 7, 2014 EC Data Management Program (ECDMP) consists of 5 foundational, incremental projects which will implement

More information

Conservation Workshop ArcGIS Explorer

Conservation Workshop ArcGIS Explorer Conservation Workshop ArcGIS Explorer Bern Szukalski bszukalski@esri.com Topics for this session Introduction Overview of features Using ArcGIS Explorer effectively New features & capabilities Customization

More information

Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1

Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model 1 Levels of Archival Stewardship at the NOAA National Oceanographic Data Center: A Conceptual Model Dr.

More information

3. Provide the capacity to analyse and report on priority business questions within the scope of the master datasets;

3. Provide the capacity to analyse and report on priority business questions within the scope of the master datasets; Business Intelligence Policy Version Information A. Introduction Purpose Business Intelligence refers to the practice of connecting facts, objects, people and processes of interest to an organisation in

More information

Build a Streamlined Data Refinery. An enterprise solution for blended data that is governed, analytics-ready, and on-demand

Build a Streamlined Data Refinery. An enterprise solution for blended data that is governed, analytics-ready, and on-demand Build a Streamlined Data Refinery An enterprise solution for blended data that is governed, analytics-ready, and on-demand Introduction As the volume and variety of data has exploded in recent years, putting

More information

Guidance for Shipboard Data Management Coordinator

Guidance for Shipboard Data Management Coordinator Guidance for Shipboard Data Management Coordinator Subsurface Monitoring Unit MC252 Deepwater Horizon Oil Spill Prepared by: NOAA EPA BP Updated Monday, September 18, 2010 Version 4.04 1 Unified Command

More information

Developing Business Intelligence and Data Visualization Applications with Web Maps

Developing Business Intelligence and Data Visualization Applications with Web Maps Developing Business Intelligence and Data Visualization Applications with Web Maps Introduction Business Intelligence (BI) means different things to different organizations and users. BI often refers to

More information

6 Steps to Faster Data Blending Using Your Data Warehouse

6 Steps to Faster Data Blending Using Your Data Warehouse 6 Steps to Faster Data Blending Using Your Data Warehouse Self-Service Data Blending and Analytics Dynamic market conditions require companies to be agile and decision making to be quick meaning the days

More information

Big Data Solutions. Portal Development with MongoDB and Liferay. Solutions

Big Data Solutions. Portal Development with MongoDB and Liferay. Solutions Big Data Solutions Portal Development with MongoDB and Liferay Solutions Introduction Companies have made huge investments in Business Intelligence and analytics to better understand their clients and

More information

How To Write An Nccwsc/Csc Data Management Plan

How To Write An Nccwsc/Csc Data Management Plan Guidance and Requirements for NCCWSC/CSC Plans (Required for NCCWSC and CSC Proposals and Funded Projects) Prepared by the CSC/NCCWSC Working Group Emily Fort, Data and IT Manager for the National Climate

More information

Oracle Architecture, Concepts & Facilities

Oracle Architecture, Concepts & Facilities COURSE CODE: COURSE TITLE: CURRENCY: AUDIENCE: ORAACF Oracle Architecture, Concepts & Facilities 10g & 11g Database administrators, system administrators and developers PREREQUISITES: At least 1 year of

More information

Measuring Quality of Service & tracking performance SMARTERDECISIONS

Measuring Quality of Service & tracking performance SMARTERDECISIONS Measuring Quality of Service & tracking performance SMARTERDECISIONS Business analytics Intergraph SG&I Deutschland GmbH Harald J. Behnke Business Analytics What is Business Analytics (BA)? Business Analytics

More information

AN INTEGRATED SOLUTION FOR MANAGING EXPLORATION DATA

AN INTEGRATED SOLUTION FOR MANAGING EXPLORATION DATA www.wipro.com AN INTEGRATED SOLUTION FOR MANAGING EXPLORATION DATA Sandipan Chakraborti, Senior Architect ENU Table of Contents 03... Introduction 04... Lack of Holistic View 06... Figure 1: Conceptual

More information

Pentaho BI Capability Profile

Pentaho BI Capability Profile Pentaho BI Capability Profile InfoAxon s Pentaho BI Integration Capabilities InfoAxon s Pentaho BI Integration Capabilities Challenge Organizations are under continuous pressure to improve their business

More information

Implementing Data Models and Reports with Microsoft SQL Server 20466C; 5 Days

Implementing Data Models and Reports with Microsoft SQL Server 20466C; 5 Days Lincoln Land Community College Capital City Training Center 130 West Mason Springfield, IL 62702 217-782-7436 www.llcc.edu/cctc Implementing Data Models and Reports with Microsoft SQL Server 20466C; 5

More information

Eliminating Complexity to Ensure Fastest Time to Big Data Value

Eliminating Complexity to Ensure Fastest Time to Big Data Value Eliminating Complexity to Ensure Fastest Time to Big Data Value Copyright 2015 Pentaho Corporation. Redistribution permitted. All trademarks are the property of their respective owners. For the latest

More information

OMAO Data Management Roadmap

OMAO Data Management Roadmap OMAO Data Management Roadmap LCDR Mark Van Waes INMARTECH 2014 Corvallis, Oregon November 18, 2014 Ships and aircraft and data, oh my! OMAO HAS DATA? 2 Data Collected by OMAO From NOAA s ships: hydrographic

More information

Data Governance for Regulated Industries

Data Governance for Regulated Industries Data Governance for Regulated Industries Amir Halfon CTO, Worldwide Financial Service Agenda Components of Data Governance Challenges Solutions and Case Studies Q&A SLIDE: 2 Data Governance Considerations

More information

IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS!

IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS! The Bloor Group IBM AND NEXT GENERATION ARCHITECTURE FOR BIG DATA & ANALYTICS VENDOR PROFILE The IBM Big Data Landscape IBM can legitimately claim to have been involved in Big Data and to have a much broader

More information

Big Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth

Big Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth MAKING BIG DATA COME ALIVE Big Data Architecture & Analytics A comprehensive approach to harness big data architecture and analytics for growth Steve Gonzales, Principal Manager steve.gonzales@thinkbiganalytics.com

More information

An Introduction to Open Source Geospatial Tools

An Introduction to Open Source Geospatial Tools An Introduction to Open Source Geospatial Tools by Tyler Mitchell, author of Web Mapping Illustrated GRSS would like to thank Mr. Mitchell for this tutorial. Geospatial technologies come in many forms,

More information

Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP)

Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP) Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP) USBR Science and Technology Project ID 3625 Eric Peterson, May 2014. Duration: Fiscal Year 2010 through

More information

The Role of Environmental Monitoring and Data Management in Supporting Science to Inform Decision Making: A Case Study

The Role of Environmental Monitoring and Data Management in Supporting Science to Inform Decision Making: A Case Study The Role of Environmental Monitoring and Data Management in Supporting Science to Inform Decision Making: A Case Study Presented by: Dwayne E. Porter Arnold School of Public Health and Baruch Institute

More information

Implementing a Data Warehouse with Microsoft SQL Server

Implementing a Data Warehouse with Microsoft SQL Server Course Code: M20463 Vendor: Microsoft Course Overview Duration: 5 RRP: 2,025 Implementing a Data Warehouse with Microsoft SQL Server Overview This course describes how to implement a data warehouse platform

More information

Final Report - HydrometDB Belize s Climatic Database Management System. Executive Summary

Final Report - HydrometDB Belize s Climatic Database Management System. Executive Summary Executive Summary Belize s HydrometDB is a Climatic Database Management System (CDMS) that allows easy integration of multiple sources of automatic and manual stations, data quality control procedures,

More information

Investigating Hadoop for Large Spatiotemporal Processing Tasks

Investigating Hadoop for Large Spatiotemporal Processing Tasks Investigating Hadoop for Large Spatiotemporal Processing Tasks David Strohschein dstrohschein@cga.harvard.edu Stephen Mcdonald stephenmcdonald@cga.harvard.edu Benjamin Lewis blewis@cga.harvard.edu Weihe

More information

May 2015 Robert Gibbon & Jochen Stroobants

May 2015 Robert Gibbon & Jochen Stroobants May 2015 Robert Gibbon & Jochen Stroobants 1 Robert Gibbon Founder at Big Industries Technical solution architect Hands on knowledge of Big Data design, build and operation Hadoop guru Jochen Stroobants

More information

2010 Oracle Corporation 1

2010 Oracle Corporation 1 1 Introduction to Geospatial Visualization in Oracle Business Intelligence Enterprise Edition, 11g Product Mgmt., Oracle Business Intelligence and Spatial Agenda Introduction When

More information

Paper DM10 SAS & Clinical Data Repository Karthikeyan Chidambaram

Paper DM10 SAS & Clinical Data Repository Karthikeyan Chidambaram Paper DM10 SAS & Clinical Data Repository Karthikeyan Chidambaram Cognizant Technology Solutions, Newbury Park, CA Clinical Data Repository (CDR) Drug development lifecycle consumes a lot of time, money

More information

The Enterprise Data Hub and The Modern Information Architecture

The Enterprise Data Hub and The Modern Information Architecture The Enterprise Data Hub and The Modern Information Architecture Dr. Amr Awadallah CTO & Co-Founder, Cloudera Twitter: @awadallah 1 2013 Cloudera, Inc. All rights reserved. Cloudera Overview The Leader

More information

Extracting and Preparing Metadata to Make Video Files Searchable

Extracting and Preparing Metadata to Make Video Files Searchable Extracting and Preparing Metadata to Make Video Files Searchable Meeting the Unique File Format and Delivery Requirements of Content Aggregators and Distributors Table of Contents Executive Overview...

More information

Making MAGIC with Your Data: Interactive Maps, Map Mashups, and Data Visualization Tools

Making MAGIC with Your Data: Interactive Maps, Map Mashups, and Data Visualization Tools Making MAGIC with Your Data: Interactive Maps, Map Mashups, and Data Visualization Tools Michael Howser Connecticut State Data Center Coordinator & Undergraduate Education & GIS Librarian What is the Connecticut

More information

SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling

SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling SCOOP Data Management: A Standards-based Distributed System for Coastal Data and Modeling Helen Conover, Bruce Beaumont, Marilyn Drewry, Sara Graves, Ken Keiser, Manil Maskey, Matt Smith The University

More information

Accessing Geographic Information Services and Visualization Products at NOAA s National Climatic Data Center

Accessing Geographic Information Services and Visualization Products at NOAA s National Climatic Data Center Accessing Geographic Information Services and Visualization Products at NOAA s National Climatic Data Center Rich Baldwin *, Steve Ansari, and Neal Lott NOAA National Climatic Data Center, Asheville, North

More information

The Big Picture on Big Data. Princeton Section 307 Dinner Meeting December 11, 2013 Richard Herczeg

The Big Picture on Big Data. Princeton Section 307 Dinner Meeting December 11, 2013 Richard Herczeg The Big Picture on Big Data Princeton Section 307 Dinner Meeting December 11, 2013 Richard Herczeg Objective of Talk 1. Deliver a Primer on Big Data. 2. How does this emerging topic apply to Quality? 3.

More information

CrossPoint for Managed Collaboration and Data Quality Analytics

CrossPoint for Managed Collaboration and Data Quality Analytics CrossPoint for Managed Collaboration and Data Quality Analytics Share and collaborate on healthcare files. Improve transparency with data quality and archival analytics. Ajilitee 2012 Smarter collaboration

More information

Apache Hadoop: The Big Data Refinery

Apache Hadoop: The Big Data Refinery Architecting the Future of Big Data Whitepaper Apache Hadoop: The Big Data Refinery Introduction Big data has become an extremely popular term, due to the well-documented explosion in the amount of data

More information

Coastal Waters Consortium (CWC) Data Management Plan

Coastal Waters Consortium (CWC) Data Management Plan I. General Description Coastal Waters Consortium (CWC) Data Management Plan The Coastal Waters Consortium The Effects of the Macondo Oil Spill on Coastal Ecosystems will address the fundamental objective

More information

Ganzheitliches Datenmanagement

Ganzheitliches Datenmanagement Ganzheitliches Datenmanagement für Hadoop Michael Kohs, Senior Sales Consultant @mikchaos The Problem with Big Data Projects in 2016 Relational, Mainframe Documents and Emails Data Modeler Data Scientist

More information

BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by:

BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE. Prepared by: BIG DATA COURSE 1 DATA QUALITY STRATEGIES - CUSTOMIZED TRAINING OUTLINE Cerulium Corporation has provided quality education and consulting expertise for over six years. We offer customized solutions to

More information

Guidelines on Information Deliverables for Research Projects in Grand Canyon National Park

Guidelines on Information Deliverables for Research Projects in Grand Canyon National Park INTRODUCTION Science is playing an increasing role in guiding National Park Service (NPS) management activities. The NPS is charged with protecting and maintaining data and associated information that

More information

North Highland Data and Analytics. Data Governance Considerations for Big Data Analytics

North Highland Data and Analytics. Data Governance Considerations for Big Data Analytics North Highland and Analytics Governance Considerations for Big Analytics Agenda Traditional BI/Analytics vs. Big Analytics Types of Requiring Governance Key Considerations Information Framework Organizational

More information

Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps

Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps Presented by: Mike Sharp State Geographic Information Coordinator Oklahoma Office of Geographic Information MAGIC 2014 Symposium April 28-May1,

More information

Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG)

Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG) Global Earth Observation Integrated Data Environment (GEO-IDE) Presentation to the Data Archiving and Access Requirements Working Group (DAARWG) Ken McDonald Data Management Integration Architect National

More information

Enterprise Data Quality Dashboards and Alerts: Holistic Data Quality

Enterprise Data Quality Dashboards and Alerts: Holistic Data Quality Enterprise Data Quality Dashboards and Alerts: Holistic Data Quality Jay Zaidi Bonnie O Neil (Fannie Mae) Data Governance Winter Conference Ft. Lauderdale, Florida November 16-18, 2011 Agenda 1 Introduction

More information

GRAPHICAL USER INTERFACE, ACCESS, SEARCH AND REPORTING

GRAPHICAL USER INTERFACE, ACCESS, SEARCH AND REPORTING MEDIA MONITORING AND ANALYSIS GRAPHICAL USER INTERFACE, ACCESS, SEARCH AND REPORTING Searchers Reporting Delivery (Player Selection) DATA PROCESSING AND CONTENT REPOSITORY ADMINISTRATION AND MANAGEMENT

More information

desert conservation program Data Management Guidelines

desert conservation program Data Management Guidelines desert conservation program Data Management Guidelines Introduction The Multiple Species Habitat Conservation Plan (MSHCP) and the U.S. Fish and Wildlife Service Biological and Conference Opinion on Clark

More information

Oracle BI 11g R1: Create Analyses and Dashboards

Oracle BI 11g R1: Create Analyses and Dashboards Oracle University Contact Us: Local: 1800 103 4775 Intl: +91 80 67863102 Oracle BI 11g R1: Create Analyses and Dashboards Duration: 5 Days What you will learn This Oracle BI 11g R1: Create Analyses and

More information

Geographic Information Systems (GIS) @ GIS at UCSD. Here to help you explore our world

Geographic Information Systems (GIS) @ GIS at UCSD. Here to help you explore our world Geographic Information Systems (GIS) @ GIS at UCSD Here to help you explore our world GIS at UCSD what it is and what it means to you Tracey Hughes UCSD GIS Coordinator 2006 Image from Google Earth An

More information