How To Visualize And Analyze Sonar Data
|
|
- Austin Foster
- 3 years ago
- Views:
Transcription
1 4D environmental data visualization and analysis. What we have learned from the unique challenges in working with complex temporal and spatial (4-dimensional) data derived from modern fisheries sonar systems. Tim Pauly, Greg Lee, John Corbett and Matthew Wilson SonarData Pty Ltd, 110 Murray Street, Hobart, Tasmania 7001 Abstract Modern fisheries sonar systems present unique challenges in data complexity and data quantity. Visualization is essential to all stages of working with fisheries sonar data: quality assurance; filtering; analysis and hypothesis forming; and presentation of results. SonarData s software products meet these challenges through a commitment to continuous development supporting the requirements of leading researchers around the world. SonarData s Echoview software has been extended to provide a unique 4-dimensional visualization and analysis environment to meet the demands of new-generation fisheries multibeam and scanning sonar systems. This has guided developers and users in further understanding the requirements for visualization and analysis of fisheries acoustics data and their fusion with other environmental data. Through data fusion and the advancing capability of computing technologies, we present these requirements with a view to achieving outcomes for better understanding environmental dynamics and change detection, and ecological systems. The ability to fuse data from multiple sources in a versatile 4-dimensional visualization environment provides new opportunities for observation and interaction, and insights into marine ecosystems. It will ultimately yield the analysis methodologies of the future. Keywords: fusion, visualization, fisheries, acoustic, software, scanning sonar, multibeam sonar Contact Author: Tim Pauly Phone fax tim@sonardata.com Part 1: Background The nature of sonar data Active fisheries sonar provides backscatter data which is a convolution of pulses of sound through space and time. The convolution typically includes transmission properties (e.g. beam pattern through the water column and vessel motion) and the insitu scattering properties of particles and objects in the water column, along with the structure and composition of the seabed. The echotrace or echogram is a data visualization of this backscatter for narrow beam echo sounders. It presents a representation of the world beneath a vessel traversing the ocean surface. The echogram is so intuitive a representation that it can obscure complexities and assumptions which might not be understood or checked. So the echogram provides us with a duality. First; a powerful and intuitive data representation for a complex set of Page 1 of 8
2 processes, and second; processes if scrutinized that can be highly challenging to deconvolve. The sustained use of the echogram as a data representation is testament to the fact that it provides high bandwidth contextual information. The user gets an immediate picture of the water column, its contents and the seabed. It is often only when we are faced with artifacts within an echogram that are difficult to explain, that we are challenged to interpret the complex processes represented within the convolution. Visualize the current state of the data Foote et al described a system combining echogram visualization, data scrutiny and quantitative echo integration analysis. Echoview s development has followed a design objective to visualize the current state of the data within each step of an analysis. This necessitates the visualization of all variables of interest, that is; channels, features and attributes. For example, Figures 1 and 2 shows the novel visualization of attributes such as phase and angle data, along with logical data types for filtering or partioning regions and individual samples within echograms. Integrated as a single application this provides a functionally rich palette for users. a Figure 1: Visualization for each step of an analysis - primary data: a) GPS track plot; b) raw angle data; c) Sv raw pings; d) TS raw pings b c d High level support for visualization throughout a process provides feedback opportunities, not only for users but also developers. By representing a process as a Page 2 of 8
3 data flow diagram, the results of each step can be quickly visualized and checked. This contributes to efficient and robust working methods for users and code developers. The outcome is processed echogram data providing, for example, tracked targets that can be visualized (Figure 2). The next logical step is to place results back into a representation of space and time (a 4D scene) providing the user with a wider environmental context to their data (Figure 2 and 3). a b c d Figure 2: Visualization for each step of an analysis primary to transformed data: a) primary TS raw pings; b) logical bit mask, grey = true; c) bit mask applied to TS; d) single target detection applied to masked angle and TS data; e) 4D scene with echogram curtain and 3D tracked target from single target detections. e Page 3 of 8
4 Support for complex instruments 4D scenes enable representation of results of echogram analysis in context with other environmental data, but they also provide a powerful intuitive representation for the complex data from new scanning sonar and multibeam systems (Figure 3). a b Figure 3: 4D scenes - a) scanning sonar data with horizontal and vertical modes, and 3D school detection; b) multibeam data with sector plot curtain, soundings classification { school, noise & seabed} indicated by color, and combined with 3D schools detection. Summary: Significant outcomes of this journey Intuitive representations of complex data through powerful visualization enhances information bandwidth to the brain. If coupled with a supporting environment of tools for investigating subtle and multi-faceted aspects of the data significant value is added. Visualization of intermediate results at each step in an analysis provides efficient feedback when using and developing processes. The requirement for some generality to achieve this also provides greater opportunity for deeper insight and development of creative methods. Developing immersive real world visualizations provides enhanced opportunities for insight into data. Visualizations that can provide rapid contextual information adding value to fused data. Future developments need to provide a generalized, responsive and immersive visualization and analysis environment, which addresses the following: efficient and elegant data access; visualization tools that support large complex data sets; represent real world phenomenon as objects; who s attributes can be queried and relationships explored. Part 2: The Future This section presents selected aspects of a data fusion project underway at SonarData. Our aim is to provide a suite of innovative tools which significantly enhance the ease with which scientists manipulate complex marine spatio-temporal environmental data. In particular, we seek to facilitate the fusion of different data types, so that the analyst can Page 4 of 8
5 pose novel questions regarding feature relationships in an integrated context. For example, such tools might target: dynamics - the study of change over short time intervals; change detection - the study of change over long time intervals; the bridging of specialist domains such as physical oceanography and fisheries research by enabling coincident visualization and analysis of trans-disciplinary results; fusion of coastal habitat data with a variety of fisheries data. Contributing to future work on these types of problems requires assembling a wide variety of knowledge and skills. Here we will briefly discuss how the use of data flows, visualization, and the use of topology might contribute to such work. Data flows Data flow diagrams provide a pivotal tool for developing, recording, visualizing and communicating the elements of analysis methods. Enhanced as an object model - maintaining relationships between objects - data flows can provide an efficient and powerful research tool. Nested data flows provide a hierarchical assembly enabling consideration of a process at differing scales, both horizontally (traversing a process) and vertically (examining the detail of a nested method). A data flow also provides metadata for an analysis process it is a visual summary of the components that comprise a method. At the most abstract level, data flow objects are categorized as data sources, operators or visualizers. A data source provides a logical handle to render a heterogeneous data storage mechanism transparent to the user, whether these be local files, distributed databases or web services. Operators provide a user-extensible set of functions that transform the data passing through them. These may range from simple logical and arithmetic functions through to sophisticated filters and complex transformations. Visualizers provide the mechanism by which the end product of a data flow is observed, from simple graphs through to complex 4D objects embedded in a data scene. Visualization Human beings have highly evolved visual systems. Vision and cognition are entwined. These are the reasons that a picture is worth a thousand words. For humans, to see is to understand. Visualization is critical to data analysis. Usually, visualization provides the first contact with data, revealing structure that cannot otherwise be readily absorbed. Since John Tukey s seminal 1977 work Exploratory Data Analysis, visualization has also been an integral part of how we interrogate data. After Tukey, changes in computer systems modified visualization methods, but not the goals: through visualization we familiarize ourselves with data, form new hypotheses and explode established ones. There are two components to visualizing data: graphical display and model fitting. These are often applied alternately in an interactive fashion. We need graphics, of course, because visualization implies a process in which information appears in a visual display. Fitting models to data is equally important. Fitting a model and visualizing deviations between the model and the data can reveal important structural features that would otherwise remain obscure. Consider plotting simple graphs of raw data: model fitting is applied by imagining what the data would look like under certain assumptions, and checking that the data display is conformant. More sophisticated models require additional methods, but the process remains the same. Page 5 of 8
6 Tools matter. To visualize data effectively we must choose the right equipment. It is easy to be dazzled by a visually appealing data display. We have a tendency to be misled into thinking we are absorbing relevant information when we see a lot of detail. But the success of a visualization tool should be based on the extent to which it enhances understanding. When data are prepared for visualization, the data are encoded in a display method. When viewed by the analyst, information is visually decoded from the display. Human visual perception is a vital link in the process. No matter how clever the choice of data and no matter how technologically impressive the encoding, visualization tools fail if the decoding fails. The art is in achieving an optimal match between the data, the nature of the enquiry, and visualization method. Understanding visual perception allows informed choices between tools. Some display methods lead to efficient and accurate decoding, others don t. Bill Cleveland s Trellis Graphics system provides a notable example of perception-informed methods. His book Visualizing Data is organized around applications of the visualization tools that became Trellis Graphics, showing the role of each tool in Exploratory Data Analysis and the class of problems that it helps to solve. It demonstrates the power of having the correct tool for the job: several visualizations reveal obvious effects that were missed in the original analyses. Topology and data fusion SonarData s data fusion project is working on the utilization of topology to provide advanced functionality in true data fusion problem domains. Spatial data can generally be described by a combination of geometric and topological properties. The geometric description includes the set of spatial locations of objects within the data set. For example, the set of spatial coordinates that are used to approximate the position of a continuous line through space would be considered part of the geometrical description of a data set. On the other hand, the topological description is concerned with the spatial relationships between objects in a data set. Such a description may include assertions such as point A lies within polygon B, or line C forms part of the boundary of polygon D, or polygon E partially overlaps polygon F. In general, topological properties can be inferred from the geometric description of the data if the geometric description is complete. In other words, we can discover the set of topological relationships between objects in a data set by analyzing the spatial locations of all objects. For this reason, storage of topological information has typically been viewed as unnecessary, particularly in GIS applications where data storage space has been a premium consideration. Instead, topological relationships have been inferred dynamically as required, and discarded. In recent years there has been a shift in the GIS field towards utilizing topological relationships for more advanced spatial data analysis and the persistence of topological information. Applications of this approach include the enforcement of quality control restrictions across multiple data sets. For example, topological rulesets describing the allowed relationships between multiple spatial data themes are commonly used to maintain data quality in critical spatial repositories. These topological rules act as filters on modifications to the data, allowing modifications to be made only if all the topological constraints are met. For example, consider an aquaculture license management scheme in which licenses are granted to allow farming within specific regions. Page 6 of 8
7 Topological constraints such as no fish farm license polygon shall overlap with a marine reserve polygon ensure the consistency of the license allocations. In the realm of data fusion, topology offers a powerful mechanism for discovering and analyzing spatial relationships between disparate data sources. With the advent of the data fusion project, we are implementing a highly generalized way of storing both geometric and topological data, along with a set of generalized analysis operations to take advantage of the fusion of varying data types. In particular, we envisage supporting the fusion of multiple data sets while maintaining topological relationships between all original spatial objects and therefore available to subsequent analysis operations.. Our definition of data structures for storing fused data are general enough to handle objects of arbitrary dimensionality, whether these be regular (gridded) or irregular (vector) data types. So, for example, a set of individual fish tracks could be fused over a bathymetric surface, overlayed with a gridded sea surface temperature map, and data from a 3-dimensional current model. Attributes from each of these objects, and the spatial relationships between them, would all be available for analysis. We believe that this structure offers great potential for enabling novel hypothesis formation and testing. A simple example of such an analysis may be the rapid identification of all time intervals in which a target fish species was found within a particular water mass. Such a question may require the integration of fishery trawl data with ocean model and observation data, in order to verify, classify and track a water mass through time. The generalization of data structures beyond the traditional 2 and 3-dimensional structures most often used in the GIS domain will allow for more powerful analysis in high dimensional feature spaces. Strong support for the 4 th (temporal) dimension will provide a sound basis for work in change detection and dynamics. It will also be possible to utilize higher dimensional data structures and operations to allow analysis in rich feature spaces. For example, we may investigate relationships between species by examining the structure of clusters of several species observations. The structure of these clusters could be examined in the abstract space defined by water temperature, salinity and depth, season, and productivity. By creating structures in this high dimensional space and utilizing generalized analysis functions, queries become very powerful yet remain straightforward. A strong emphasis on the topological description of spatial data also opens up the possibility of dealing with poorly specified geometric information (or observational uncertainty) using constructs such as fuzzy boundaries. By allowing specification of spatial locations with confidence measures constrained by a well defined topology, we can retain analytical power and help to quantify spatial error. Classification work may greatly benefit from underlying support for such fuzzy data representations. Summary SonarData s data fusion project aims to deliver a powerful combination of data access, fusion, analysis and visualization. It targets diverse, feature-rich spatio-temporal environmental data sets and seeks to provide new opportunities for analysis by offering innovative tools in a novel environment. These aims will be achieved by core Page 7 of 8
8 technologies that provide highly responsive and immersive visualization, and highly generalized object and topology models. We aim to enhance the excitement of discovery that visualization brings to data analysis, to provide a suite of tools that makes the interesting absolutely fascinating and the mundane easy, and ultimately to offer inter-ocular traumatic impact - understanding that hits you between the eyes. References K. G. Foote, H. P. Knudsen, R. J. Korneliussen, P. E. Nordbo, and K Roang, Postprocessing system for echo sounder data, J. Aoust. Soc. 90 (1), 37-47, W. S. Cleveland, Visualizing Data, Hobart Press, J. Tukey, Exploratory Data Analysis, Addison-Wesley, Page 8 of 8
The Scientific Data Mining Process
Chapter 4 The Scientific Data Mining Process When I use a word, Humpty Dumpty said, in rather a scornful tone, it means just what I choose it to mean neither more nor less. Lewis Carroll [87, p. 214] In
More informationExploratory Data Analysis for Ecological Modelling and Decision Support
Exploratory Data Analysis for Ecological Modelling and Decision Support Gennady Andrienko & Natalia Andrienko Fraunhofer Institute AIS Sankt Augustin Germany http://www.ais.fraunhofer.de/and 5th ECEM conference,
More informationAPPENDIX E THE ASSESSMENT PHASE OF THE DATA LIFE CYCLE
APPENDIX E THE ASSESSMENT PHASE OF THE DATA LIFE CYCLE The assessment phase of the Data Life Cycle includes verification and validation of the survey data and assessment of quality of the data. Data verification
More informationWhat is Visualization? Information Visualization An Overview. Information Visualization. Definitions
What is Visualization? Information Visualization An Overview Jonathan I. Maletic, Ph.D. Computer Science Kent State University Visualize/Visualization: To form a mental image or vision of [some
More informationA Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data
White Paper A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data Contents Executive Summary....2 Introduction....3 Too much data, not enough information....3 Only
More informationVisualization methods for patent data
Visualization methods for patent data Treparel 2013 Dr. Anton Heijs (CTO & Founder) Delft, The Netherlands Introduction Treparel can provide advanced visualizations for patent data. This document describes
More informationtelemetry Rene A.J. Chave, David D. Lemon, Jan Buermans ASL Environmental Sciences Inc. Victoria BC Canada rchave@aslenv.com I.
Near real-time transmission of reduced data from a moored multi-frequency sonar by low bandwidth telemetry Rene A.J. Chave, David D. Lemon, Jan Buermans ASL Environmental Sciences Inc. Victoria BC Canada
More informationThe Integration of Hydrographic and Oceanographic Data in a Marine Geographic Information System U.S. Hydro 2015
The Integration of Hydrographic and Oceanographic Data in a Marine Geographic Information System U.S. Hydro 2015 Karen Hart CARIS USA Oceanography and Hydrography Defined Oceanography: The branch of Earth
More informationASSESSMENT OF VISUALIZATION SOFTWARE FOR SUPPORT OF CONSTRUCTION SITE INSPECTION TASKS USING DATA COLLECTED FROM REALITY CAPTURE TECHNOLOGIES
ASSESSMENT OF VISUALIZATION SOFTWARE FOR SUPPORT OF CONSTRUCTION SITE INSPECTION TASKS USING DATA COLLECTED FROM REALITY CAPTURE TECHNOLOGIES ABSTRACT Chris Gordon 1, Burcu Akinci 2, Frank Boukamp 3, and
More informationHow To Create A Visual Analytics Tool
W H I T E P A P E R Visual Analytics for the Masses 1 State of Visual Analytics Visual analytics, in the field of business intelligence, is the integration of data visualization and interactive visual
More informationSpatial Data Analysis
14 Spatial Data Analysis OVERVIEW This chapter is the first in a set of three dealing with geographic analysis and modeling methods. The chapter begins with a review of the relevant terms, and an outlines
More informationBig Data: Rethinking Text Visualization
Big Data: Rethinking Text Visualization Dr. Anton Heijs anton.heijs@treparel.com Treparel April 8, 2013 Abstract In this white paper we discuss text visualization approaches and how these are important
More information(1) define the objectives and intended use of the maps and spatial data and
Mapping coastal seabed habitats in Tasmania: development and integration of remote sensing techniques within a hierarchical framework Alan Jordan Vanessa Halley Miles Lawler Richard Mount Project Planning
More informationDraft Martin Doerr ICS-FORTH, Heraklion, Crete Oct 4, 2001
A comparison of the OpenGIS TM Abstract Specification with the CIDOC CRM 3.2 Draft Martin Doerr ICS-FORTH, Heraklion, Crete Oct 4, 2001 1 Introduction This Mapping has the purpose to identify, if the OpenGIS
More informationPrinciples and Practices of Data Integration
Data Integration Data integration is the process of combining data of different themes, content, scale or spatial extent, projections, acquisition methods, formats, schema, or even levels of uncertainty,
More informationCOMBINING THE METHODS OF FORECASTING AND DECISION-MAKING TO OPTIMISE THE FINANCIAL PERFORMANCE OF SMALL ENTERPRISES
COMBINING THE METHODS OF FORECASTING AND DECISION-MAKING TO OPTIMISE THE FINANCIAL PERFORMANCE OF SMALL ENTERPRISES JULIA IGOREVNA LARIONOVA 1 ANNA NIKOLAEVNA TIKHOMIROVA 2 1, 2 The National Nuclear Research
More information3D Interactive Information Visualization: Guidelines from experience and analysis of applications
3D Interactive Information Visualization: Guidelines from experience and analysis of applications Richard Brath Visible Decisions Inc., 200 Front St. W. #2203, Toronto, Canada, rbrath@vdi.com 1. EXPERT
More informationSpotfire and Tableau Positioning. Summary
Licensed for distribution Summary Both TIBCO Spotfire and Tableau allow users of various skill levels to create attractive visualizations of data, displayed as charts, dashboards and other visual constructs.
More informationMIDLAND ISD ADVANCED PLACEMENT CURRICULUM STANDARDS AP ENVIRONMENTAL SCIENCE
Science Practices Standard SP.1: Scientific Questions and Predictions Asking scientific questions that can be tested empirically and structuring these questions in the form of testable predictions SP.1.1
More informationCHAPTER 1 INTRODUCTION
1 CHAPTER 1 INTRODUCTION Exploration is a process of discovery. In the database exploration process, an analyst executes a sequence of transformations over a collection of data structures to discover useful
More informationCourse 803401 DSS. Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
Oman College of Management and Technology Course 803401 DSS Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization CS/MIS Department Information Sharing
More informationSPATIAL DATA CLASSIFICATION AND DATA MINING
, pp.-40-44. Available online at http://www. bioinfo. in/contents. php?id=42 SPATIAL DATA CLASSIFICATION AND DATA MINING RATHI J.B. * AND PATIL A.D. Department of Computer Science & Engineering, Jawaharlal
More informationData Exploration Data Visualization
Data Exploration Data Visualization What is data exploration? A preliminary exploration of the data to better understand its characteristics. Key motivations of data exploration include Helping to select
More informationNEW DIGITAL TERRAIN MODELING (DTM) TOOLS FOR CABLE ROUTE PLANNING by Dr. Jose M. Andres Makai Ocean Engineering Inc.
NEW DIGITAL TERRAIN MODELING (DTM) TOOLS FOR CABLE ROUTE PLANNING by Dr. Jose M. Andres Makai Ocean Engineering Inc. EXISTING CABLE ROUTE PLANNING TOOLS In recent years, methods used for submarine cable
More informationDesign and Deployment of Specialized Visualizations for Weather-Sensitive Electric Distribution Operations
Fourth Symposium on Policy and Socio-Economic Research 4.1 Design and Deployment of Specialized Visualizations for Weather-Sensitive Electric Distribution Operations Lloyd A. Treinish IBM, Yorktown Heights,
More informationChapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
Turban, Aronson, and Liang Decision Support Systems and Intelligent Systems, Seventh Edition Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization
More informationMoving GIS into the Ocean Realm: Meeting the Need for Intelligent Data
Title: Authors: Moving GIS into the Ocean Realm: Meeting the Need for Intelligent Data Simon Evans, Jeanne Murday and Richard Lawrence. Environmental Systems Research Institute Inc. Redlands, California,
More informationData Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep. Neil Raden Hired Brains Research, LLC
Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep Neil Raden Hired Brains Research, LLC Traditionally, the job of gathering and integrating data for analytics fell on data warehouses.
More informationKALMAN FILTERING FOR 3 D REAL TIME DATA VISUALIZATION OF MULTIBEAM SONAR RECORDS
Volume 6 HYDROACOUSTICS KALMAN FILTERING FOR 3 D REAL TIME DATA VISUALIZATION OF MULTIBEAM SONAR RECORDS JERZY DEMKOWICZ, MAREK MOSZYŃSKI Technical University ofgdańsk ul. Narutowicza 11/12 Gdańsk demjot@eti.pg.gda.pl
More informationGEOGRAPHIC INFORMATION SYSTEMS
GEOGRAPHIC INFORMATION SYSTEMS WHAT IS A GEOGRAPHIC INFORMATION SYSTEM? A geographic information system (GIS) is a computer-based tool for mapping and analyzing spatial data. GIS technology integrates
More informationInformation Visualization WS 2013/14 11 Visual Analytics
1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and
More informationENHANCING INTELLIGENCE SUCCESS: DATA CHARACTERIZATION Francine Forney, Senior Management Consultant, Fuel Consulting, LLC May 2013
ENHANCING INTELLIGENCE SUCCESS: DATA CHARACTERIZATION, Fuel Consulting, LLC May 2013 DATA AND ANALYSIS INTERACTION Understanding the content, accuracy, source, and completeness of data is critical to the
More informationGEOGRAPHIC INFORMATION SYSTEMS CERTIFICATION
GEOGRAPHIC INFORMATION SYSTEMS CERTIFICATION GIS Syllabus - Version 1.2 January 2007 Copyright AICA-CEPIS 2009 1 Version 1 January 2007 GIS Certification Programme 1. Target The GIS certification is aimed
More informationInstrumentation for Monitoring around Marine Renewable Energy Devices
Instrumentation for Monitoring around Marine Renewable Energy Devices 1 Introduction As marine renewable energy has developed, a set of consistent challenges has emerged following attempts to understand
More informationIris Sample Data Set. Basic Visualization Techniques: Charts, Graphs and Maps. Summary Statistics. Frequency and Mode
Iris Sample Data Set Basic Visualization Techniques: Charts, Graphs and Maps CS598 Information Visualization Spring 2010 Many of the exploratory data techniques are illustrated with the Iris Plant data
More informationData Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining
Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar Tan,Steinbach, Kumar Introduction to Data Mining 8/05/2005 1 What is data exploration? A preliminary
More informationVisualization. For Novices. ( Ted Hall ) University of Michigan 3D Lab Digital Media Commons, Library http://um3d.dc.umich.edu
Visualization For Novices ( Ted Hall ) University of Michigan 3D Lab Digital Media Commons, Library http://um3d.dc.umich.edu Data Visualization Data visualization deals with communicating information about
More informationGood Graphs: Graphical Perception and Data Visualization
Good Graphs: Graphical Perception and Data Visualization Nina Zumel August 28th, 2009 1 Introduction What makes a good graph? When faced with a slew of numeric data, graphical visualization can be a more
More informationCOSC 6344 Visualization
COSC 64 Visualization University of Houston, Fall 2015 Instructor: Guoning Chen chengu@cs.uh.edu Course Information Location: AH 2 Time: 10am~11:am Tu/Th Office Hours: 11:am~12:pm Tu /Th or by appointment
More informationData Discovery, Analytics, and the Enterprise Data Hub
Data Discovery, Analytics, and the Enterprise Data Hub Version: 101 Table of Contents Summary 3 Used Data and Limitations of Legacy Analytic Architecture 3 The Meaning of Data Discovery & Analytics 4 Machine
More informationThe Future of Business Analytics is Now! 2013 IBM Corporation
The Future of Business Analytics is Now! 1 The pressures on organizations are at a point where analytics has evolved from a business initiative to a BUSINESS IMPERATIVE More organization are using analytics
More informationWorkflow Requirements (Dec. 12, 2006)
1 Functional Requirements Workflow Requirements (Dec. 12, 2006) 1.1 Designing Workflow Templates The workflow design system should provide means for designing (modeling) workflow templates in graphical
More informationChoosing a successful structure for your visualization
IBM Software Business Analytics Visualization Choosing a successful structure for your visualization By Noah Iliinsky, IBM Visualization Expert 2 Choosing a successful structure for your visualization
More informationWhite Paper. Thirsting for Insight? Quench It With 5 Data Management for Analytics Best Practices.
White Paper Thirsting for Insight? Quench It With 5 Data Management for Analytics Best Practices. Contents Data Management: Why It s So Essential... 1 The Basics of Data Preparation... 1 1: Simplify Access
More informationA Capability Model for Business Analytics: Part 2 Assessing Analytic Capabilities
A Capability Model for Business Analytics: Part 2 Assessing Analytic Capabilities The first article of this series presented the capability model for business analytics that is illustrated in Figure One.
More informationDATA ANALYSIS, INTERPRETATION AND PRESENTATION
DATA ANALYSIS, INTERPRETATION AND PRESENTATION OVERVIEW Qualitative and quantitative Simple quantitative analysis Simple qualitative analysis Tools to support data analysis Theoretical frameworks: grounded
More informationEffective Visualization Techniques for Data Discovery and Analysis
WHITE PAPER Effective Visualization Techniques for Data Discovery and Analysis Chuck Pirrello, SAS Institute, Cary, NC Table of Contents Abstract... 1 Introduction... 1 Visual Analytics... 1 Static Graphs...
More informationAPLS 2011. GIS Data: Classification, Potential Misuse, and Practical Limitations
APLS 2011 GIS Data: Classification, Potential Misuse, and Practical Limitations GIS Data: Classification, Potential Misuse, and Practical Limitations Goals & Objectives Develop an easy to use geospatial
More informationChapter 5. Warehousing, Data Acquisition, Data. Visualization
Decision Support Systems and Intelligent Systems, Seventh Edition Chapter 5 Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization 5-1 Learning Objectives
More informationP16_IBM_WebSphere_Business_Monitor_V602.ppt. Page 1 of 17
Welcome to the IBM WebSphere Business Monitor presentation as part of the SAP integration workshop. This presentation will give you an introduction to the WebSphere Business Monitor and monitoring over
More informationIs Multibeam Water Column Data Really Worth the Disk Space?
Is Multibeam Water Column Data Really Worth the Disk Space? Authors: GEE Lindsay 1, DOUCET Maurice 1, PARKER David 2, WEBER Tom 3, and BEAUDOIN Jonathan 3 1. Quality Positioning Services, Inc., 104 Congress
More informationA GENERAL TAXONOMY FOR VISUALIZATION OF PREDICTIVE SOCIAL MEDIA ANALYTICS
A GENERAL TAXONOMY FOR VISUALIZATION OF PREDICTIVE SOCIAL MEDIA ANALYTICS Stacey Franklin Jones, D.Sc. ProTech Global Solutions Annapolis, MD Abstract The use of Social Media as a resource to characterize
More informationCS171 Visualization. The Visualization Alphabet: Marks and Channels. Alexander Lex alex@seas.harvard.edu. [xkcd]
CS171 Visualization Alexander Lex alex@seas.harvard.edu The Visualization Alphabet: Marks and Channels [xkcd] This Week Thursday: Task Abstraction, Validation Homework 1 due on Friday! Any more problems
More informationBUSINESS RULES AND GAP ANALYSIS
Leading the Evolution WHITE PAPER BUSINESS RULES AND GAP ANALYSIS Discovery and management of business rules avoids business disruptions WHITE PAPER BUSINESS RULES AND GAP ANALYSIS Business Situation More
More informationExperience studies data management How to generate valuable analytics with improved data processes
www.pwc.com/us/insurance Experience studies data management How to generate valuable analytics with improved data processes An approach to managing data for experience studies October 2015 Table of contents
More informationLEADing Practice: Artifact Description: Business, Information & Data Object Modelling. Relating Objects
LEADing Practice: Artifact Description: Business, Information & Data Object Modelling Relating Objects 1 Table of Contents 1.1 The Way of Thinking with Objects... 3 1.2 The Way of Working with Objects...
More informationCOM CO P 5318 Da t Da a t Explora Explor t a ion and Analysis y Chapte Chapt r e 3
COMP 5318 Data Exploration and Analysis Chapter 3 What is data exploration? A preliminary exploration of the data to better understand its characteristics. Key motivations of data exploration include Helping
More informationCourse Descriptions: Undergraduate/Graduate Certificate Program in Data Visualization and Analysis
9/3/2013 Course Descriptions: Undergraduate/Graduate Certificate Program in Data Visualization and Analysis Seton Hall University, South Orange, New Jersey http://www.shu.edu/go/dava Visualization and
More informationVisualization of Large Multi-Dimensional Datasets
***TITLE*** ASP Conference Series, Vol. ***VOLUME***, ***PUBLICATION YEAR*** ***EDITORS*** Visualization of Large Multi-Dimensional Datasets Joel Welling Department of Statistics, Carnegie Mellon University,
More informationNorwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES
Norwegian Satellite Earth Observation Database for Marine and Polar Research http://normap.nersc.no USE CASES The NORMAP Project team has prepared this document to present functionality of the NORMAP portal.
More informationAn Introduction to Point Pattern Analysis using CrimeStat
Introduction An Introduction to Point Pattern Analysis using CrimeStat Luc Anselin Spatial Analysis Laboratory Department of Agricultural and Consumer Economics University of Illinois, Urbana-Champaign
More informationDATA QUALITY IN GIS TERMINOLGY GIS11
DATA QUALITY IN GIS When using a GIS to analyse spatial data, there is sometimes a tendency to assume that all data, both locational and attribute, are completely accurate. This of course is never the
More informationMaking confident decisions with the full spectrum of analysis capabilities
IBM Software Business Analytics Analysis Making confident decisions with the full spectrum of analysis capabilities Making confident decisions with the full spectrum of analysis capabilities Contents 2
More informationOracle Big Data Spatial and Graph
Oracle Big Data Spatial and Graph Oracle Big Data Spatial and Graph offers a set of analytic services and data models that support Big Data workloads on Apache Hadoop and NoSQL database technologies. For
More informationSelf-Service Business Intelligence
Self-Service Business Intelligence BRIDGE THE GAP VISUALIZE DATA, DISCOVER TRENDS, SHARE FINDINGS Solgenia Analysis provides users throughout your organization with flexible tools to create and share meaningful
More informationUSING THE INTERNET TO MANAGE AND DISTRIBUTE GEOSPATIAL SUBMARINE CABLE DATA
USING THE INTERNET TO MANAGE AND DISTRIBUTE GEOSPATIAL SUBMARINE CABLE DATA GIS Database World Wide Web Internet Data Management Cable Marine RPL Protection David Caswell, Bill Gilmour, David Millar Racal
More informationRESEARCH ON THE FRAMEWORK OF SPATIO-TEMPORAL DATA WAREHOUSE
RESEARCH ON THE FRAMEWORK OF SPATIO-TEMPORAL DATA WAREHOUSE WANG Jizhou, LI Chengming Institute of GIS, Chinese Academy of Surveying and Mapping No.16, Road Beitaiping, District Haidian, Beijing, P.R.China,
More informationData Mining: Exploring Data. Lecture Notes for Chapter 3. Introduction to Data Mining
Data Mining: Exploring Data Lecture Notes for Chapter 3 Introduction to Data Mining by Tan, Steinbach, Kumar What is data exploration? A preliminary exploration of the data to better understand its characteristics.
More informationMeasurement with Ratios
Grade 6 Mathematics, Quarter 2, Unit 2.1 Measurement with Ratios Overview Number of instructional days: 15 (1 day = 45 minutes) Content to be learned Use ratio reasoning to solve real-world and mathematical
More informationHYDROGRAPHIC ECHOSOUNDER FOR SOUNDING INLAND WATERS ANDRZEJ JEDEL, LECH KILIAN, JACEK MARSZAL, ZAWISZA OSTROWSKI, ZBIGNIEW WOJAN, KRZYSZTOF ZACHARIASZ
HYDROGRAPHIC ECHOSOUNDER FOR SOUNDING INLAND WATERS ANDRZEJ JEDEL, LECH KILIAN, JACEK MARSZAL, ZAWISZA OSTROWSKI, ZBIGNIEW WOJAN, KRZYSZTOF ZACHARIASZ Gdańsk University of Technology, Faculty of Electronics,
More informationREGIONAL SEDIMENT MANAGEMENT: A GIS APPROACH TO SPATIAL DATA ANALYSIS. Lynn Copeland Hardegree, Jennifer M. Wozencraft 1, Rose Dopsovic 2 INTRODUCTION
REGIONAL SEDIMENT MANAGEMENT: A GIS APPROACH TO SPATIAL DATA ANALYSIS Lynn Copeland Hardegree, Jennifer M. Wozencraft 1, Rose Dopsovic 2 ABSTRACT: Regional sediment management (RSM) requires the capability
More informationInteractive Graphic Design Using Automatic Presentation Knowledge
Interactive Graphic Design Using Automatic Presentation Knowledge Steven F. Roth, John Kolojejchick, Joe Mattis, Jade Goldstein School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213
More informationPublic Data Visualization and Social Connectivity
Public Data Visualization and Social Connectivity Introduction For a society that seeks inclusive participation from citizens towards governance, open data is key. Giving public data to citizens in the
More informationLIDAR and Digital Elevation Data
LIDAR and Digital Elevation Data Light Detection and Ranging (LIDAR) is being used by the North Carolina Floodplain Mapping Program to generate digital elevation data. These highly accurate topographic
More informationEcho Statistics of Fish Behavior Models
DISTRIBUTION STATEMENT A. Approved for public release; distribution is unlimited. Modeling Statistics of Fish Patchiness and Predicting Associated Influence on Statistics of Acoustic Echoes Timothy K.
More informationCustomer Analytics. Turn Big Data into Big Value
Turn Big Data into Big Value All Your Data Integrated in Just One Place BIRT Analytics lets you capture the value of Big Data that speeds right by most enterprises. It analyzes massive volumes of data
More informationQlik s Associative Model
White Paper Qlik s Associative Model See the Whole Story that Lives Within Your Data August, 2015 qlik.com Table of Contents Introduction 3 Qlik s associative model 3 Query-based visualization tools only
More informationUnderstanding Raster Data
Introduction The following document is intended to provide a basic understanding of raster data. Raster data layers (commonly referred to as grids) are the essential data layers used in all tools developed
More informationLecture 2: Descriptive Statistics and Exploratory Data Analysis
Lecture 2: Descriptive Statistics and Exploratory Data Analysis Further Thoughts on Experimental Design 16 Individuals (8 each from two populations) with replicates Pop 1 Pop 2 Randomly sample 4 individuals
More informationA STUDY OF DATA MINING ACTIVITIES FOR MARKET RESEARCH
205 A STUDY OF DATA MINING ACTIVITIES FOR MARKET RESEARCH ABSTRACT MR. HEMANT KUMAR*; DR. SARMISTHA SARMA** *Assistant Professor, Department of Information Technology (IT), Institute of Innovation in Technology
More informationRemote Sensing, GPS and GIS Technique to Produce a Bathymetric Map
Remote Sensing, GPS and GIS Technique to Produce a Bathymetric Map Mark Schnur EES 5053 Remote Sensing Fall 2007 University of Texas at San Antonio, Department of Earth and Environmental Science, San Antonio,
More informationModule 8 VIDEO CODING STANDARDS. Version 2 ECE IIT, Kharagpur
Module 8 VIDEO CODING STANDARDS Version ECE IIT, Kharagpur Lesson H. andh.3 Standards Version ECE IIT, Kharagpur Lesson Objectives At the end of this lesson the students should be able to :. State the
More informationInformation Services for Smart Grids
Smart Grid and Renewable Energy, 2009, 8 12 Published Online September 2009 (http://www.scirp.org/journal/sgre/). ABSTRACT Interconnected and integrated electrical power systems, by their very dynamic
More informationCourtesy of José Aguilar-Manjarrez
Fish ponds for culture of Nile tilapia, African catfish and African bonytongue, Cameroon There is considerable potential to expand inland aquaculture in Africa to improve food security. To aid aquaculture
More informationWeb-Based Visualization of Marine Environment Data
Web-Based Visualization of Marine Environment Data HE Yawen 1,2,3,*, Su Fenzhen 2, Du Yunyan 2 Xiao Rulin 2,3 1 Yantai Institute of Coastal Zone Research, CAS, Yantai 264003, China 2 Institute of Geographic
More informationQuality for All and All for Quality
Quality for All and All for Quality The motto above, Quality for All and All for Quality, was designed to represent all we stand for and value. It is the essence of our mission statement which itself encompasses
More informationTDA and Machine Learning: Better Together
TDA and Machine Learning: Better Together TDA AND MACHINE LEARNING: BETTER TOGETHER 2 TABLE OF CONTENTS The New Data Analytics Dilemma... 3 Introducing Topology and Topological Data Analysis... 3 The Promise
More informationClustering & Visualization
Chapter 5 Clustering & Visualization Clustering in high-dimensional databases is an important problem and there are a number of different clustering paradigms which are applicable to high-dimensional data.
More informationTutorial on how to use MGDS tools for seafloor bathymetry data April 2009
Tutorial on how to use MGDS tools for seafloor bathymetry data April 2009 The MGDS serves a gridded global synthesis of high-resolution seafloor bathymetry data collected from multibeam or swath sonar
More informationRisk Analysis and Quantification
Risk Analysis and Quantification 1 What is Risk Analysis? 2. Risk Analysis Methods 3. The Monte Carlo Method 4. Risk Model 5. What steps must be taken for the development of a Risk Model? 1.What is Risk
More informationA Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1
A Platform for Supporting Data Analytics on Twitter: Challenges and Objectives 1 Yannis Stavrakas Vassilis Plachouras IMIS / RC ATHENA Athens, Greece {yannis, vplachouras}@imis.athena-innovation.gr Abstract.
More informationICT Perspectives on Big Data: Well Sorted Materials
ICT Perspectives on Big Data: Well Sorted Materials 3 March 2015 Contents Introduction 1 Dendrogram 2 Tree Map 3 Heat Map 4 Raw Group Data 5 For an online, interactive version of the visualisations in
More informationART A. PROGRAM RATIONALE AND PHILOSOPHY
ART A. PROGRAM RATIONALE AND PHILOSOPHY Art education is concerned with the organization of visual material. A primary reliance upon visual experience gives an emphasis that sets it apart from the performing
More informationGeospatial Semantic Architecture Objectives to Support a Graduate Course on Ontology and Semantics
Geospatial Semantic Architecture Objectives to Support a Graduate Course on Ontology and Semantics Dalia Varanka, Adjunct Professor Johns Hopkins University, Advanced Academic Programs October 29, 2013
More informationMalay A. Dalal Madhav Erraguntla Perakath Benjamin. Knowledge Based Systems, Inc. (KBSI) College Station, TX 77840, U.S.A.
AN INTRODUCTION TO USING PROSIM FOR BUSINESS PROCESS SIMULATION AND ANALYSIS Malay A. Dalal Madhav Erraguntla Perakath Benjamin Knowledge Based Systems, Inc. (KBSI) College Station, TX 77840, U.S.A. ABSTRACT
More informationInteractive Information Visualization of Trend Information
Interactive Information Visualization of Trend Information Yasufumi Takama Takashi Yamada Tokyo Metropolitan University 6-6 Asahigaoka, Hino, Tokyo 191-0065, Japan ytakama@sd.tmu.ac.jp Abstract This paper
More informationK N O W L E D G E M A N A G E M E N T S E R I E S V I S U A L I Z A T I O N
K N O W L E D G E M A N A G E M E N T S E R I E S V I S U A L I Z A T I O N Visualization GBA CONSULTING (P) LTD Knowledge Management Series ISSUE 3 VOLUME 1 DECEMBER/2011 VISUALIZATION A TOOL Editorial
More informationWhy Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization. Learning Goals. GENOME 560, Spring 2012
Why Taking This Course? Course Introduction, Descriptive Statistics and Data Visualization GENOME 560, Spring 2012 Data are interesting because they help us understand the world Genomics: Massive Amounts
More informationMonitoring chemical processes for early fault detection using multivariate data analysis methods
Bring data to life Monitoring chemical processes for early fault detection using multivariate data analysis methods by Dr Frank Westad, Chief Scientific Officer, CAMO Software Makers of CAMO 02 Monitoring
More informationDATA QUALITY AND SCALE IN CONTEXT OF EUROPEAN SPATIAL DATA HARMONISATION
DATA QUALITY AND SCALE IN CONTEXT OF EUROPEAN SPATIAL DATA HARMONISATION Katalin Tóth, Vanda Nunes de Lima European Commission Joint Research Centre, Ispra, Italy ABSTRACT The proposal for the INSPIRE
More information