Best PracDces for Building and Deploying PredicDve Models Over Big Data. Module 12: Case Study Matsu

Size: px
Start display at page:

Download "Best PracDces for Building and Deploying PredicDve Models Over Big Data. Module 12: Case Study Matsu"

Transcription

1 Best PracDces for Building and Deploying PredicDve Models Over Big Data Module 12: Case Study Matsu Robert Grossman Open Data Group & Univ. of Chicago Collin Benne= Open Data Group October 23, 2012

2 Zoom Levels Zoom Level 1: 4 images Zoom Level 2: 16 images Zoom Level 3: 64 images Zoom Level 4: 256 images

3 Build Tile Cache - Mapper Mapper Input Key: Bounding Box Mapper Input Value: (minx = miny = 45.0 maxx = maxy = 67.5) Mapper Output Key: Bounding Box Mapper Output Value: Mapper Output Key: Bounding Box Mapper Output Value: Mapper Output Key: Bounding Box Mapper Output Value: Step 1: Input to Mapper Mapper resizes and/or cuts up the original image into pieces to output Bounding Boxes Mapper Output Key: Bounding Box Mapper Output Value: Mapper Output Key: Bounding Box Mapper Output Value: Mapper Output Key: Bounding Box Mapper Output Value: Mapper Output Key: Bounding Box Mapper Output Value: Step 2: Processing in Mapper Mapper Output Key: Bounding Box Mapper Output Value: Step 3: Mapper Output

4 Build Tile Cache - Reducer Reducer Key Input: Bounding Box (minx = miny = maxx = maxy = ) Reducer Value Input: Step 1: Input to Reducer Assemble Images based on bounding box Output to Accumulo Builds up Layers for WMS for various datasets Step 2: Reducer Output

5 Tiling procedure in detail

6 Preprocess Satellite Imagery EO- 1 images are provided by NASA as Level 1 images Each band and the metadata are individual files For distributed processing in Hadoop, we need to read all of an image s bands in the same map instance So we serialize the band files into a single file

7 Image SerializaDon Project Matsu supports two soludons: Regular file, Base64- encoded EnDre file is a single line Hadoop SequenceFile, Base64- encoded Each band is a single line Each approach uses Avro (open source Apache Soiware FoundaDon project) for serializadon.

8 SerializaDon Approaches Mapper reads every band and specifies which ones are kept. Less efficient, more portable as it does not rely on Hadoop SequenceFile support Mapper specifies which bands to read More efficient, only the bands needed for the analydc are read

9 Tiling procedure in detail

10 Map An image is read by a single mapper Actual bands are selected and/or virtual bands created Sent to reducer by geographical Dles

11 Tiling procedure in detail

12 Reduce Reducers produce Web Tiles for each zoom level Storage in Accumulo Index: Graphic Tile Timestamp Value: Image Metadata

13 Building zoomed- out images Reduce step overlays Dles and builds zoomed- out images Four neighboring Dles are combined and shrunken to decrease by one zoom level Process condnues undl one image covers the endre region that the reducer is responsible for (e.g. 1/2 N th of the world) Tdepth- lngindex- latindex parent is depth 1, lng/2, lat/2

14 Tiling procedure in detail

15 AnalyDc Modules If an analydc produces a web Dle, then it can piggy back along the web Dling workflow The data generated is only the addidonal bands to be displayed

16 Embedding MulDple Modules

17 Example: Algebraic combinadon of spectral bands Some CO2 acdvity follows visible cloud formadons, some doesn t Icelandic volcano in April 2010 (Eyjanallajökull) Visible frame is full of ash clouds CO2 distribudon is non- uniform

18 Example: Algebraic combinadon of spectral bands Some CO2 acdvity follows visible cloud formadons, some doesn t Icelandic volcano in April 2010 (Eyjanallajökull) Visible frame is full of ash clouds CO2 distribudon is non- uniform Module Code to Create AddiDonal Band: sum1 = 4. sumx = sumxx = 183.** ** ** **2 sumy = B183 + B184 + B188 + B189 sumxy = 183.*B *B *B *B189 delta = sum1*sumxx - sumx**2 constant = (sumxx*sumy - sumx*sumxy) / delta linear = (sum1*sumxy - sumx*sumy) / delta subtracted = (B185 - (constant *linear))/2. + (B186 - (constant *linear))/2.

19 QuesDons? For the most current version of these slides, please see tutorials.opendatagroup.com

20 About Open Data Open Data began operadons in 2001 and has built predicdve models for companies for over ten years Open Data provides management consuldng, outsourced analydc services, & analydc staffing For more informadon

Matsu Workflow: Web Tiles and Analytics over MapReduce for Multispectral and Hyperspectral Images

Matsu Workflow: Web Tiles and Analytics over MapReduce for Multispectral and Hyperspectral Images Matsu Workflow: Web Tiles and Analytics over MapReduce for Multispectral and Hyperspectral Images Open Cloud Consortium Open Data Group September 7, 2012 1 Materials for Matsu Matsu is a public project.

More information

The Matsu Wheel: A Cloud-based Scanning Framework for Analyzing Large Volumes of Hyperspectral Data

The Matsu Wheel: A Cloud-based Scanning Framework for Analyzing Large Volumes of Hyperspectral Data The Matsu Wheel: A Cloud-based Scanning Framework for Analyzing Large Volumes of Hyperspectral Data Maria Patterson, PhD Open Science Data Cloud Center for Data Intensive Science (CDIS) University of Chicago

More information

UK Location Programme

UK Location Programme Location Information Interoperability Board Data Publisher How To Guide Understand the background to establishing an INSPIRE View Service using GeoServer DOCUMENT CONTROL Change Summary Version Date Author/Editor

More information

Figure 2: System Flow Diagram for Workflow Management

Figure 2: System Flow Diagram for Workflow Management 5. WORKFLOW MANAGEMENT The developed system EASKB uses the open source content management system called Drupal ([2]). A Content Management System - CMS is a tool that enables many user friendly features

More information

Keystone Image Management System

Keystone Image Management System Image management solutions for satellite and airborne sensors Overview The Keystone Image Management System offers solutions that archive, catalogue, process and deliver digital images from a vast number

More information

Supervised Classification workflow in ENVI 4.8 using WorldView-2 imagery

Supervised Classification workflow in ENVI 4.8 using WorldView-2 imagery Supervised Classification workflow in ENVI 4.8 using WorldView-2 imagery WorldView-2 is the first commercial high-resolution satellite to provide eight spectral sensors in the visible to near-infrared

More information

CURSO Inspire INSPIRE. SPEAKER: Pablo Echamendi Lorente. JEUDI 23/ THURSDAY 23 rd W S V : G E O S P A T I A L D A T A A C C E S S

CURSO Inspire INSPIRE. SPEAKER: Pablo Echamendi Lorente. JEUDI 23/ THURSDAY 23 rd W S V : G E O S P A T I A L D A T A A C C E S S CURSO Inspire JEUDI 23/ THURSDAY 23 rd SPEAKER: Pablo Echamendi Lorente WS 5 SCHEDULE WMS OVERVIEW ACTIONS OGC SPECIFICATIONS OTHER SERVICES OVERVIEW proposal: Member States shall establish and operate

More information

Introduction to Imagery and Raster Data in ArcGIS

Introduction to Imagery and Raster Data in ArcGIS Esri International User Conference San Diego, California Technical Workshops July 25, 2012 Introduction to Imagery and Raster Data in ArcGIS Simon Woo slides Cody Benkelman - demos Overview of Presentation

More information

VISUAL INSPECTION OF EO DATA AND PRODUCTS - OVERVIEW

VISUAL INSPECTION OF EO DATA AND PRODUCTS - OVERVIEW WMS services from the EUMETSAT real-time Image Gallery Uwe Voges (1), Michael Schick (2), Udo Einspanier (1) (1) con terra GmbH Martin-Luther-King-Weg 24, 48155, Münster, Germany EMail: (U.Voges U.Einspanier)@conterra.de

More information

SRS BIO OPTICAL WORKFLOW

SRS BIO OPTICAL WORKFLOW SRS BIO OPTICAL WORKFLOW Version 2.0 22 nd March 2013 Data Workflows emii, the data management facility for IMOS, has developed workflows for each IMOS sub facility to describe the flow of IMOS data from

More information

NCDC's Application of Climate Data to Tourism Business Decision-Making

NCDC's Application of Climate Data to Tourism Business Decision-Making NCDC's Application of Climate Data to Tourism Business Decision-Making Climate, Weather, and Tourism Workshop November 14-15, 2008 East Carolina University Greenville, NC Neal Lott NOAA s National Climatic

More information

Assignment # 1 (Cloud Computing Security)

Assignment # 1 (Cloud Computing Security) Assignment # 1 (Cloud Computing Security) Group Members: Abdullah Abid Zeeshan Qaiser M. Umar Hayat Table of Contents Windows Azure Introduction... 4 Windows Azure Services... 4 1. Compute... 4 a) Virtual

More information

Conservation Workshop ArcGIS Explorer

Conservation Workshop ArcGIS Explorer Conservation Workshop ArcGIS Explorer Bern Szukalski bszukalski@esri.com Topics for this session Introduction Overview of features Using ArcGIS Explorer effectively New features & capabilities Customization

More information

ITG Software Engineering

ITG Software Engineering Introduction to Cloudera Course ID: Page 1 Last Updated 12/15/2014 Introduction to Cloudera Course : This 5 day course introduces the student to the Hadoop architecture, file system, and the Hadoop Ecosystem.

More information

2009 CAP Grant Kickoff USGS, Reston, VA May 21, 2009

2009 CAP Grant Kickoff USGS, Reston, VA May 21, 2009 Leveraging GOS Map and Data Services for Search and Rescue Operations using NASA WorldWind Open Source 3D Visualization Platform Nadine Alameh, Ph.D. MobiLaps LLC 2009 CAP Grant Kickoff USGS, Reston, VA

More information

The USGS Landsat Big Data Challenge

The USGS Landsat Big Data Challenge The USGS Landsat Big Data Challenge Brian Sauer Engineering and Development USGS EROS bsauer@usgs.gov U.S. Department of the Interior U.S. Geological Survey USGS EROS and Landsat 2 Data Utility and Exploitation

More information

A GIS helps you answer questions and solve problems by looking at your data in a way that is quickly understood and easily shared.

A GIS helps you answer questions and solve problems by looking at your data in a way that is quickly understood and easily shared. A Geographic Information System (GIS) integrates hardware, software, and data for capturing, managing, analyzing, and displaying all forms of geographically referenced information. GIS allows us to view,

More information

Advanced Image Management using the Mosaic Dataset

Advanced Image Management using the Mosaic Dataset Esri International User Conference San Diego, California Technical Workshops July 25, 2012 Advanced Image Management using the Mosaic Dataset Vinay Viswambharan, Mike Muller Agenda ArcGIS Image Management

More information

What s new in Carmenta Server 4.2

What s new in Carmenta Server 4.2 What s new in Carmenta Server 4.2 A complete solution for cost-effective visualisation and distribution of GIS data through web services Carmenta Server provides cost-effective technology for building

More information

COURSE CONTENT Big Data and Hadoop Training

COURSE CONTENT Big Data and Hadoop Training COURSE CONTENT Big Data and Hadoop Training 1. Meet Hadoop Data! Data Storage and Analysis Comparison with Other Systems RDBMS Grid Computing Volunteer Computing A Brief History of Hadoop Apache Hadoop

More information

Intergraph Geospatial Portfolio 2013

Intergraph Geospatial Portfolio 2013 W H A T S N E W? Intergraph Geospatial Portfolio 2013 Photogrammetry LPS ImageStation Remote Sensing ERDAS IMAGINE GIS GeoMedia Server GeoMedia WebMap GeoMedia Smart Client ERDAS APOLLO Geospatial SDI

More information

Cloud Technology Influence on Testing Testing and new found challenges that come with cloud technologies.

Cloud Technology Influence on Testing Testing and new found challenges that come with cloud technologies. White Paper: Cloud Technology Influence on Testing Cloud Technology Influence on Testing Testing and new found challenges that come with cloud technologies. http://www.prakat.com USA India info@prakat.com

More information

AN OPENGIS WEB MAP SERVER FOR THE ESA MULTI-MISSION CATALOGUE

AN OPENGIS WEB MAP SERVER FOR THE ESA MULTI-MISSION CATALOGUE AN OPENGIS WEB MAP SERVER FOR THE ESA MULTI-MISSION CATALOGUE T. Westin a, *, C. Caspar b, L. Edgardh a, L. Schylberg c a Spacemetric AB, Tingsv 19, 19161 Sollentuna, Sweden - tw@spacemetric.se b ESA Esrin,

More information

INTEROPERABLE IMAGE DATA ACCESS THROUGH ARCGIS SERVER

INTEROPERABLE IMAGE DATA ACCESS THROUGH ARCGIS SERVER INTEROPERABLE IMAGE DATA ACCESS THROUGH ARCGIS SERVER Qian Liu Environmental Systems Research Institute 380 New York Street Redlands, CA92373, U.S.A - qliu@esri.com KEY WORDS: OGC, Standard, Interoperability,

More information

Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps

Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps Oklahoma s Open Source Spatial Data Clearinghouse: OKMaps Presented by: Mike Sharp State Geographic Information Coordinator Oklahoma Office of Geographic Information MAGIC 2014 Symposium April 28-May1,

More information

Lecture 32 Big Data. 1. Big Data problem 2. Why the excitement about big data 3. What is MapReduce 4. What is Hadoop 5. Get started with Hadoop

Lecture 32 Big Data. 1. Big Data problem 2. Why the excitement about big data 3. What is MapReduce 4. What is Hadoop 5. Get started with Hadoop Lecture 32 Big Data 1. Big Data problem 2. Why the excitement about big data 3. What is MapReduce 4. What is Hadoop 5. Get started with Hadoop 1 2 Big Data Problems Data explosion Data from users on social

More information

Big Data: Using ArcGIS with Apache Hadoop. Erik Hoel and Mike Park

Big Data: Using ArcGIS with Apache Hadoop. Erik Hoel and Mike Park Big Data: Using ArcGIS with Apache Hadoop Erik Hoel and Mike Park Outline Overview of Hadoop Adding GIS capabilities to Hadoop Integrating Hadoop with ArcGIS Apache Hadoop What is Hadoop? Hadoop is a scalable

More information

3D VISUALIZATION OF GEOTHERMAL WELLS DIRECTIONAL SURVEYS AND INTEGRATION WITH DIGITAL ELEVATION MODEL (DEM)

3D VISUALIZATION OF GEOTHERMAL WELLS DIRECTIONAL SURVEYS AND INTEGRATION WITH DIGITAL ELEVATION MODEL (DEM) Presented at Short Course VII on Exploration for Geothermal Resources, organized by UNU-GTP, GDC and KenGen, at Lake Bogoria and Lake Naivasha, Kenya, Oct. 27 Nov. 18, 2012. GEOTHERMAL TRAINING PROGRAMME

More information

Professional Hadoop Solutions

Professional Hadoop Solutions Brochure More information from http://www.researchandmarkets.com/reports/2542488/ Professional Hadoop Solutions Description: The go-to guidebook for deploying Big Data solutions with Hadoop Today's enterprise

More information

Obtaining and Processing MODIS Data

Obtaining and Processing MODIS Data Obtaining and Processing MODIS Data MODIS is an extensive program using sensors on two satellites that each provide complete daily coverage of the earth. The data have a variety of resolutions; spectral,

More information

Handling Heterogeneous EO Datasets via the Web Coverage Processing Service

Handling Heterogeneous EO Datasets via the Web Coverage Processing Service Handling Heterogeneous EO Datasets via the Web Coverage Processing Service Piero Campalani a*, Simone Mantovani b, Alan Beccati a, a a a Jacobs University Bremen (DE) / b MEEO Srl (IT) * {p.campalani@jacobs-university.de

More information

Frequently Asked Questions: Wetlands Mapper

Frequently Asked Questions: Wetlands Mapper Frequently Asked Questions: Wetlands Mapper December 2015 Mapper Content and Display How does the public access the new Mapper? The Wetlands Mapper can be found at: http://www.fws.gov/wetlands/ Does the

More information

Creating a universe on Hive with Hortonworks HDP 2.0

Creating a universe on Hive with Hortonworks HDP 2.0 Creating a universe on Hive with Hortonworks HDP 2.0 Learn how to create an SAP BusinessObjects Universe on top of Apache Hive 2 using the Hortonworks HDP 2.0 distribution Author(s): Company: Ajay Singh

More information

Standard requirements for service management in federated infrastructure

Standard requirements for service management in federated infrastructure Standard requirements for service management in federated infrastructure Owen Appleton Emergence Tech Ltd Helix Nebula Workshop, FrascaD, 16 Jan 2013 Overview RaDonale and approach to improving ITSM Relevance

More information

Chapter 7. Using Hadoop Cluster and MapReduce

Chapter 7. Using Hadoop Cluster and MapReduce Chapter 7 Using Hadoop Cluster and MapReduce Modeling and Prototyping of RMS for QoS Oriented Grid Page 152 7. Using Hadoop Cluster and MapReduce for Big Data Problems The size of the databases used in

More information

Project Title: Project PI(s) (who is doing the work; contact Project Coordinator (contact information): information):

Project Title: Project PI(s) (who is doing the work; contact Project Coordinator (contact information): information): Project Title: Great Northern Landscape Conservation Cooperative Geospatial Data Portal Extension: Implementing a GNLCC Spatial Toolkit and Phenology Server Project PI(s) (who is doing the work; contact

More information

The Hadoop Implementation. Thomas Zimmermann Philipp Berger

The Hadoop Implementation. Thomas Zimmermann Philipp Berger Link Analysis goes MapReduce The Hadoop Implementation Thomas Zimmermann Philipp Berger Flashback 2 Overview 3 1. Pre- / Postprocessing 2. Our Jobs 3. Evaluation Overview 4 1. Pre- / Postprocessing 2.

More information

Quick and Easy Web Maps with Google Fusion Tables. SCO Technical Paper

Quick and Easy Web Maps with Google Fusion Tables. SCO Technical Paper Quick and Easy Web Maps with Google Fusion Tables SCO Technical Paper Version History Version Date Notes Author/Contact 1.0 July, 2011 Initial document created. Howard Veregin 1.1 Dec., 2011 Updated to

More information

Recognization of Satellite Images of Large Scale Data Based On Map- Reduce Framework

Recognization of Satellite Images of Large Scale Data Based On Map- Reduce Framework Recognization of Satellite Images of Large Scale Data Based On Map- Reduce Framework Vidya Dhondiba Jadhav, Harshada Jayant Nazirkar, Sneha Manik Idekar Dept. of Information Technology, JSPM s BSIOTR (W),

More information

Real Time Monitor of Grid Job Executions. Janusz Martyniak Imperial College London

Real Time Monitor of Grid Job Executions. Janusz Martyniak Imperial College London Real Time Monitor of Grid Job Executions Janusz Martyniak Imperial College London What is the RTM RTM is a GRID monitoring system which gives on overview of current state of the infrastructure. The RTM's

More information

Workshop Internet of Things. LAAS CNRS October 21, 2008

Workshop Internet of Things. LAAS CNRS October 21, 2008 Workshop Internet of Things LAAS CNRS October 21, 2008 Internet Of Things (IOT) Definitions: Things having identities and virtual personalities operating in smart spaces using intelligent interfaces to

More information

Using Big Data and GIS to Model Aviation Fuel Burn

Using Big Data and GIS to Model Aviation Fuel Burn Using Big Data and GIS to Model Aviation Fuel Burn Gary M. Baker USDOT Volpe Center 2015 Transportation DataPalooza June 17, 2015 The National Transportation Systems Center Advancing transportation innovation

More information

Create and share a map with GIScloud.com

Create and share a map with GIScloud.com Create and share a map with GIScloud.com GIS Cloud is a web based Geographic Information System powered by Cloud Computing and with the full power of desktop GIS. It allows users to create and access your

More information

Developing a MapReduce Application

Developing a MapReduce Application TIE 12206 - Apache Hadoop Tampere University of Technology, Finland November, 2014 Outline 1 MapReduce Paradigm 2 Hadoop Default Ports 3 Outline 1 MapReduce Paradigm 2 Hadoop Default Ports 3 MapReduce

More information

3.1 Infrastructure with Virtualization as a Prerequisite

3.1 Infrastructure with Virtualization as a Prerequisite 3. Technology Technology UKAI This article introduces our research into the UKAI* 1 storage system, which enables flexible control over the actual data locations of virtual disk images of virtual machines

More information

INFORMATION MANAGERS ROUNDTABLE SHELLEY COOKE, WHITNEY WEBER MONDAY APRIL 23, 2012 1:30 3:00 PM PST

INFORMATION MANAGERS ROUNDTABLE SHELLEY COOKE, WHITNEY WEBER MONDAY APRIL 23, 2012 1:30 3:00 PM PST INFORMATION MANAGERS ROUNDTABLE SHELLEY COOKE, WHITNEY WEBER MONDAY APRIL 23, 2012 1:30 3:00 PM PST I. Biotics 4 Session Topics Compatibility issues, other common challenges, support for Biotics 4 (Informational,

More information

Building and Applying Geographical Information System Grids. 1. Introduction: Information Architecture for the Data Deluge

Building and Applying Geographical Information System Grids. 1. Introduction: Information Architecture for the Data Deluge Building and Applying Geographical Information System Grids Galip Aydin 1,2, Ahmet Sayar 1, 2, Harshawardhan Gadgil 1,2, Mehmet S. Aktas 1,2, Geoffrey C. Fox 1,2,3, Sunghoon Ko 1, Hasan Bulut 1,2,and Marlon

More information

GXP WebView GEOSPATIAL EXPLOITATION PRODUCTS (GXP )

GXP WebView GEOSPATIAL EXPLOITATION PRODUCTS (GXP ) GEOSPATIAL EXPLOITATION PRODUCTS (GXP ) GXP WebView A Web-based, full-resolution image viewing tool for visualization, annotation, measurement, and publishing providing access to remote data from any location.

More information

DEVELOPMENT OF OPEN SOURCE SOFTWARE FOR MULTI-TEMPORAL DISASTER MONITORING ACROSS NETWORK WITH DYNAMIC DATA EXCHANGE

DEVELOPMENT OF OPEN SOURCE SOFTWARE FOR MULTI-TEMPORAL DISASTER MONITORING ACROSS NETWORK WITH DYNAMIC DATA EXCHANGE DEVELOPMENT OF OPEN SOURCE SOFTWARE FOR MULTI-TEMPORAL DISASTER MONITORING ACROSS NETWORK WITH DYNAMIC DATA EXCHANGE Wanapong Kaewsing, Anusorn Rungsripanij, Pisut Naknuenwai, Siam Lawawirojwong, Sitthisak

More information

DEVELOPMENT OF THE INTEGRATING AND SHARING PLATFORM OF SPATIAL WEBSERVICES

DEVELOPMENT OF THE INTEGRATING AND SHARING PLATFORM OF SPATIAL WEBSERVICES DEVELOPMENT OF THE INTEGRATING AND SHARING PLATFORM OF SPATIAL WEBSERVICES Lan Xiaoji 1,2 Lu Guonian 1 Zhang Shuliang 1 Shi Miaomiao 1 Yin Lili 1 1. Jiangsu Provincial Key Lab of GIS Science, Nanjing Normal

More information

Storytelling with Maps: Workflows and Best Practices

Storytelling with Maps: Workflows and Best Practices Storytelling with Maps: Workflows and Best Practices Introduction What is a story map? Story maps are interactive maps combined with text and other content to tell a story about the world. Typically story

More information

SeeMore. The 2013 Geospatial Portfolio Desktop. Geospatial for Smarter Decisions

SeeMore. The 2013 Geospatial Portfolio Desktop. Geospatial for Smarter Decisions SeeMore The 2013 Geospatial Portfolio Desktop Geospatial for Smarter Decisions united. Modern. Dynamic. domore Geospatial for Smarter Decisions powering the geospatial enterprise More than ever before,

More information

MDS. Measured Data Server Online Measurement Network. Properties and Benefits »»» »»»» ProduCt information

MDS. Measured Data Server Online Measurement Network. Properties and Benefits »»» »»»» ProduCt information ProduCt information MDS Measured Data Server Online Measurement Network Properties and Benefits Unlimited access to your data via Internet Measured data can be transferred online in minute intervals Economical

More information

GIS Solutions for FTTx Design. David Nelson, GISP

GIS Solutions for FTTx Design. David Nelson, GISP GIS Solutions for FTTx Design David Nelson, GISP Telecom GIS Manager, Black & Veatch Agenda Intro to GIS Telecom GIS Vision GIS Strategy Project Execution Mobile Online Services Dashboards Client Deliverables

More information

Activity: Using ArcGIS Explorer

Activity: Using ArcGIS Explorer Activity: Using ArcGIS Explorer Requirements You must have ArcGIS Explorer for this activity. Preparation: Download ArcGIS Explorer. The link below will bring you to the ESRI ArcGIS Explorer download page.

More information

Software requirements * :

Software requirements * : Title: Product Type: Developer: Target audience: Format: Software requirements * : Data: Estimated time to complete: Fire Mapping using ASTER Part I: The ASTER instrument and fire damage assessment Part

More information

Developing Fleet and Asset Tracking Solutions with Web Maps

Developing Fleet and Asset Tracking Solutions with Web Maps Developing Fleet and Asset Tracking Solutions with Web Maps Introduction Many organizations have mobile field staff that perform business processes away from the office which include sales, service, maintenance,

More information

Documentation of open source GIS/RS software projects

Documentation of open source GIS/RS software projects Contract no. Workpackage Delivery Delivery Date 030776 WP1 D1.6 2007-07-02 CASCADOSS Development of a trans-national cascade training programme on Open Source GIS&RS Software for environmental applications

More information

A Tutorial Introduc/on to Big Data. Hands On Data Analy/cs over EMR. Robert Grossman University of Chicago Open Data Group

A Tutorial Introduc/on to Big Data. Hands On Data Analy/cs over EMR. Robert Grossman University of Chicago Open Data Group A Tutorial Introduc/on to Big Data Hands On Data Analy/cs over EMR Robert Grossman University of Chicago Open Data Group Collin BenneE Open Data Group November 12, 2012 1 Amazon AWS Elas/c MapReduce allows

More information

WEB MAPPING TOOL DOCUMENTATION

WEB MAPPING TOOL DOCUMENTATION ENTERPRISE ZONES RE DESIGNATION WEB MAPPING TOOL DOCUMENTATION January 26, 2015 COVER PAGE TABLE OF CONTENTS INTRODUCTION 1 APPLICATION LAYOUT 2 WEB MAP NAVIGATION 3 LOCATION SEARCH 4 MAP LEGEND 5 BASEMAP

More information

BIG DATA - HADOOP PROFESSIONAL amron

BIG DATA - HADOOP PROFESSIONAL amron 0 Training Details Course Duration: 30-35 hours training + assignments + actual project based case studies Training Materials: All attendees will receive: Assignment after each module, video recording

More information

Big Data Volume & velocity data management with ERDAS APOLLO. Alain Kabamba Hexagon Geospatial

Big Data Volume & velocity data management with ERDAS APOLLO. Alain Kabamba Hexagon Geospatial Big Data Volume & velocity data management with ERDAS APOLLO Alain Kabamba Hexagon Geospatial Intergraph is Part of the Hexagon Family Hexagon is dedicated to delivering actionable information through

More information

Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES

Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES The NORMAP Project team has prepared this document to present functionality of the NORMAP portal.

More information

Express Server: Standards-Based Image Delivery for the Geospatial Industry

Express Server: Standards-Based Image Delivery for the Geospatial Industry Express Server: Standards-Based Image Delivery for the Geospatial Industry Advancements in the collection of geospatial imagery in recent years have resulted in the increasing availability of greater quantities

More information

and what s upcoming Headline Goes Here

and what s upcoming Headline Goes Here Apache HBase Where we ve been DO NOT USE PUBLICLY and what s upcoming PRIOR TO 10/23/12 Headline Goes Here Jonathan Hsieh @jmhsieh Speaker Name or Subhead Goes Here SoMware Engineer at Cloudera HBase PMC

More information

. Perspectives on the Economics of Aging. : University of Chicago Press,. p 3 http://site.ebrary.com/id/10209979?ppg=3 Copyright University of

. Perspectives on the Economics of Aging. : University of Chicago Press,. p 3 http://site.ebrary.com/id/10209979?ppg=3 Copyright University of : University of Chicago Press,. p 3 http://site.ebrary.com/id/10209979?ppg=3 : University of Chicago Press,. p 4 http://site.ebrary.com/id/10209979?ppg=4 : University of Chicago Press,. p 297 http://site.ebrary.com/id/10209979?ppg=297

More information

Ron Shaham. Expert Witness in Islamic Courts : Medicine and Crafts in the Service of Law. : University of Chicago Press,. p 38

Ron Shaham. Expert Witness in Islamic Courts : Medicine and Crafts in the Service of Law. : University of Chicago Press,. p 38 : University of Chicago Press,. p 38 http://site.ebrary.com/id/10381149?ppg=38 : University of Chicago Press,. p 39 http://site.ebrary.com/id/10381149?ppg=39 : University of Chicago Press,. p 40 http://site.ebrary.com/id/10381149?ppg=40

More information

May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law.

May not be reproduced in any form without permission from the publisher, except fair uses permitted under U.S. or applicable copyright law. : University of Chicago Press,. p 24 http://site.ebrary.com/id/10292358?ppg=24 : University of Chicago Press,. p 25 http://site.ebrary.com/id/10292358?ppg=25 : University of Chicago Press,. p 26 http://site.ebrary.com/id/10292358?ppg=26

More information

Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP)

Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP) Integrated Information Management System, Development of Web Interface, a.k.a. Online Data Portal (ODP) USBR Science and Technology Project ID 3625 Eric Peterson, May 2014. Duration: Fiscal Year 2010 through

More information

MATRIX borehole logging system

MATRIX borehole logging system MATRIX borehole logging system Combining their long experience in the slimhole logging industry Mount Sopris and ALT have teamed up to develop M A T R I X, providing a single solution to the multiplication

More information

Allows the access and modification to all graphic and alphanumeric data in all layers of SIGPAC central database.

Allows the access and modification to all graphic and alphanumeric data in all layers of SIGPAC central database. SIGPAC SOFTWARE APPLICATIONS 1 SIGPAC DNEditor 2 DNEditor Allows the access and modification to all graphic and alphanumeric data in all layers of SIGPAC central database. Data stored in databases (MAPA

More information

HELCOM Data and Map Service. User Manual

HELCOM Data and Map Service. User Manual HELCOM Data and Map Service User Manual Version 2.2 - February 2015 1 Table of contents 1. General Information... 3 1.1 Background... 3 1.2 Technical requirements... 3 1.3 Contact... 3 2. Accessing HELCOM

More information

Enhancing MapReduce Functionality for Optimizing Workloads on Data Centers

Enhancing MapReduce Functionality for Optimizing Workloads on Data Centers Available Online at www.ijcsmc.com International Journal of Computer Science and Mobile Computing A Monthly Journal of Computer Science and Information Technology IJCSMC, Vol. 2, Issue. 10, October 2013,

More information

Version 3.0, April 16, 2012, updated for ArcGIS 10.0 Produced by the Geographic Information Network of Alaska http://www.gina.alaska.

Version 3.0, April 16, 2012, updated for ArcGIS 10.0 Produced by the Geographic Information Network of Alaska http://www.gina.alaska. Using the AlaskaMapped Web Services in ESRI ArcGIS Version 3.0, April 16, 2012, updated for ArcGIS 10.0 Produced by the Geographic Information Network of Alaska http://www.gina.alaska.edu AlaskaMapped

More information

Real-Time Analytics on Large Datasets: Predictive Models for Online Targeted Advertising

Real-Time Analytics on Large Datasets: Predictive Models for Online Targeted Advertising Real-Time Analytics on Large Datasets: Predictive Models for Online Targeted Advertising Open Data Partners and AdReady April 2012 1 Executive Summary AdReady is working to develop and deploy sophisticated

More information

A Web-Based Library and Algorithm System for Satellite and Airborne Image Products

A Web-Based Library and Algorithm System for Satellite and Airborne Image Products DISTRIBUTION STATEMENT A: Approved for public release; distribution is unlimited. A Web-Based Library and Algorithm System for Satellite and Airborne Image Products W. Paul Bissett Florida Environmental

More information

Geospatial exploitation Products. GXP WebView. Powered by the GXP Platform

Geospatial exploitation Products. GXP WebView. Powered by the GXP Platform Geospatial exploitation Products GXP WebView Powered by the GXP Platform Exploitation Capabilities GXP WebView Powered by the GXP Platform Detailed annotation (text, points, lines, and polygons) Distance,

More information

Intel Modular Server System MFSYS25

Intel Modular Server System MFSYS25 Intel Modular Server System MFSYS25 Intel Modular Server Control OEM Branding December 5, 2007 Enterprise Platforms and Services Division 2 Intel Modular Server System MFSYS25 Intel Modular Server Control

More information

Interoperable Solutions in Web-based Mapping

Interoperable Solutions in Web-based Mapping ISPRS SIPT IGU UCI CIG ACSG Table of contents Table des matières Authors index Index des auteurs Search Recherches Exit Sortir Interoperable Solutions in Web-based Mapping Marta Wojnarowska and Bridget

More information

Effec%ve Commercial Lines Underwri%ng using Big Data and Risk Analy%cs

Effec%ve Commercial Lines Underwri%ng using Big Data and Risk Analy%cs Effec%ve Commercial Lines Underwri%ng using Big Data and Risk Analy%cs Lakshan De Silva Lakshan.desilva@intellectdesign.com April 2015 " A quality first quarter earnings announcement could push shares

More information

NetCDF and HDF Data in ArcGIS

NetCDF and HDF Data in ArcGIS 2013 Esri International User Conference July 8 12, 2013 San Diego, California Technical Workshop NetCDF and HDF Data in ArcGIS Nawajish Noman Kevin Butler Esri UC2013. Technical Workshop. Outline NetCDF

More information

On Demand Satellite Image Processing

On Demand Satellite Image Processing On Demand Satellite Image Processing Next generation technology for processing Terabytes of imagery on the Cloud WHITEPAPER MARCH 2015 Introduction Profound changes are happening with computing hardware

More information

May 2013 Oracle Spatial and Graph User Conference

May 2013 Oracle Spatial and Graph User Conference 1 May 2013 Oracle Spatial and Graph User Conference May 22, 2013 Ronald Reagan Building and International Trade Center Washington, DC USA Paul Welding Sr. Manager Software Development Imagery Inventory

More information

Page 1. Editor Patrick Blandin, Centre Henri Tudor, Luxembourg

Page 1. Editor Patrick Blandin, Centre Henri Tudor, Luxembourg ITEA- 2 (09008) Newsletter 10/2012 Page 1 Summary of the 4 Demos presented at Co-Summit 2012 Demo 1 File based Broadcast Content Delivery Broadcaster and Mobile/Telecom Operators are facing the challenge

More information

ArcGIS Data Models Practical Templates for Implementing GIS Projects

ArcGIS Data Models Practical Templates for Implementing GIS Projects ArcGIS Data Models Practical Templates for Implementing GIS Projects GIS Database Design According to C.J. Date (1995), database design deals with the logical representation of data in a database. The

More information

GS Big Data Platform

GS Big Data Platform GS Big Data Platform DataPhilosophy 1 Instrument everything 2 Put all data in one place 3 Data first, questions later 4 Store first, structure later 5 Let everyone party on the data (with controls) 6 Keep

More information

Reef Explorer User Guide

Reef Explorer User Guide Reef Explorer User Guide Contents USER INTERFACE...2 DATA CONTENT...3 BASEMAPS...4 ESRI BASEMAPS...4 National Geographic World Map...4 Light Gray Canvas Map...4 Ocean Basemap...4 World Terrain Base...4

More information

GIS Databases With focused on ArcSDE

GIS Databases With focused on ArcSDE Linköpings universitet / IDA / Div. for human-centered systems GIS Databases With focused on ArcSDE Imad Abugessaisa g-imaab@ida.liu.se 20071004 1 GIS and SDBMS Geographical data is spatial data whose

More information

Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases. Lecture 15

Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases. Lecture 15 Department of Computer Science University of Cyprus EPL646 Advanced Topics in Databases Lecture 15 Big Data Management V (Big-data Analytics / Map-Reduce) Chapter 16 and 19: Abideboul et. Al. Demetris

More information

Hortonworks CISC Innovation day

Hortonworks CISC Innovation day Hortonworks CISC Innovation day Simon gregory sgregory@hortonworks.com Here was the ask Hortonworks' data reposition - how this works and the types of data you work with. 1: Data Types & Value. What have

More information

MobileMap and Spatial Content Management: Integrating Field Data Collection, Document Management and Enterprise GIS for Natural Resources

MobileMap and Spatial Content Management: Integrating Field Data Collection, Document Management and Enterprise GIS for Natural Resources MobileMap and Spatial Content Management: Integrating Field Data Collection, Document Management and Enterprise GIS for Natural Resources BRIAN GRASS MASON, BRUCE & GIRARD The Mobile Revolution Proliferation

More information

Hadoop 只 支 援 用 Java 開 發 嘛? Is Hadoop only support Java? 總 不 能 全 部 都 重 新 設 計 吧? 如 何 與 舊 系 統 相 容? Can Hadoop work with existing software?

Hadoop 只 支 援 用 Java 開 發 嘛? Is Hadoop only support Java? 總 不 能 全 部 都 重 新 設 計 吧? 如 何 與 舊 系 統 相 容? Can Hadoop work with existing software? Hadoop 只 支 援 用 Java 開 發 嘛? Is Hadoop only support Java? 總 不 能 全 部 都 重 新 設 計 吧? 如 何 與 舊 系 統 相 容? Can Hadoop work with existing software? 可 以 跟 資 料 庫 結 合 嘛? Can Hadoop work with Databases? 開 發 者 們 有 聽 到

More information

Presenters: Luke Dougherty & Steve Crabb

Presenters: Luke Dougherty & Steve Crabb Presenters: Luke Dougherty & Steve Crabb About Keylink Keylink Technology is Syncsort s partner for Australia & New Zealand. Our Customers: www.keylink.net.au 2 ETL is THE best use case for Hadoop. ShanH

More information

COP Video & Data Integrations

COP Video & Data Integrations COP Video & Data Integrations COP: Common Operating Picture A Common Operating Picture (COP) is a computing platform based on Geographical Information System (GIS) technology that provides a single source

More information

Embedding Maps into Microsoft Office and Microsoft SharePoint

Embedding Maps into Microsoft Office and Microsoft SharePoint Embedding Maps into Microsoft Office and Microsoft SharePoint Toronto Esri Canada User Conference Tuesday, October 16, 2012 Presented By: Heather Hainsworth hhainsworth@esri.ca Agenda This seminar is designed

More information

ArcGIS Viewer for Silverlight An Introduction

ArcGIS Viewer for Silverlight An Introduction Esri International User Conference San Diego, California Technical Workshops July 26, 2012 ArcGIS Viewer for Silverlight An Introduction Rich Zwaap Agenda Background Product overview Getting started and

More information

Final Report - HydrometDB Belize s Climatic Database Management System. Executive Summary

Final Report - HydrometDB Belize s Climatic Database Management System. Executive Summary Executive Summary Belize s HydrometDB is a Climatic Database Management System (CDMS) that allows easy integration of multiple sources of automatic and manual stations, data quality control procedures,

More information

Apache Hadoop: The Pla/orm for Big Data. Amr Awadallah CTO, Founder, Cloudera, Inc. aaa@cloudera.com, twicer: @awadallah

Apache Hadoop: The Pla/orm for Big Data. Amr Awadallah CTO, Founder, Cloudera, Inc. aaa@cloudera.com, twicer: @awadallah Apache Hadoop: The Pla/orm for Big Data Amr Awadallah CTO, Founder, Cloudera, Inc. aaa@cloudera.com, twicer: @awadallah 1 The Problems with Current Data Systems BI Reports + Interac7ve Apps RDBMS (aggregated

More information

Cloudera Certified Developer for Apache Hadoop

Cloudera Certified Developer for Apache Hadoop Cloudera CCD-333 Cloudera Certified Developer for Apache Hadoop Version: 5.6 QUESTION NO: 1 Cloudera CCD-333 Exam What is a SequenceFile? A. A SequenceFile contains a binary encoding of an arbitrary number

More information