massive aerial LiDAR point clouds



Similar documents
Point Cloud Workshop at OTB

Scalable visualization of massive point clouds

3D Data Management From Point Cloud to City Model GeoSmart Africa 2016, Cape Town

Management of massive point cloud data: wet and dry. Editorial P.J.M. van Oosterom, M.G. Vosselman, Th.A.G.P. van Dijk, M.

SECONDARY STORAGE TERRAIN VISUALIZATION IN A CLIENT-SERVER ENVIRONMENT: A SURVEY

Databases for 3D Data Management: From Point Cloud to City Model

Create a folder on your network drive called DEM. This is where data for the first part of this lesson will be stored.

CityGML goes to Broadway

<Insert Picture Here> Data Management Innovations for Massive Point Cloud, DEM, and 3D Vector Databases

GIS Databases With focused on ArcSDE

A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model

Service-Oriented Visualization of Virtual 3D City Models

GIS Data in ArcGIS. Pay Attention to Data!!!

MrSID Plug-in for 3D Analyst

Advanced Image Management using the Mosaic Dataset

ERDAS IMAGINE The world s most widely-used remote sensing software package

CitusDB Architecture for Real-Time Big Data

LIDAR and Digital Elevation Data

Point cloud data management Peter van Oosterom, Siva Ravada, Mike Horhammer, Oscar Marinez Rubi, Milena Ivanova, Martin Kodde and Theo Tijssen

ADVANCED DATA STRUCTURES FOR SURFACE STORAGE

1. INTRODUCTION Graphics 2

Parallel Simplification of Large Meshes on PC Clusters

WHAT WOULD IT MEAN IF YOU COULD VISUALISE ALL YOUR DATA IN LESS THAN A SECOND FROM WHEREVER YOU ARE?

ArcGIS 10.1 Geodatabase Administration. Gordon Sumerling & Christopher Brown

3D web visualization of huge CityGML models

GEOGRAPHIC INFORMATION SYSTEMS

EIVA NaviModel3. Efficient Sonar Data Cleaning. Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3. Lars Dall, EIVA A/S

Multiresolution Terrain Database Visualization

EXPERIMENTAL EVALUATION OF LIDAR DATA VISUALIZATION SCHEMES

Web-Based Enterprise Data Visualization a 3D Approach. Oleg Kachirski, Black and Veatch

Technologies Enabling the Evolution of a Smart City. Brad Schmidt, Intergraph Canada

AN STUDY ON DATA CONSISTENCY IN SPATIAL DATABASE SYSTEM

LAR-IAC4 Status and User Group Meeting. October 8, 2015

3D MODELING OF LARGE AND COMPLEX SITE USING MULTI-SENSOR INTEGRATION AND MULTI-RESOLUTION DATA

Location tracking: technology, methodology and applications

Teaching and Learning Strategies for 3D Urban and Landscape Modelling

GPU Architecture. Michael Doggett ATI

STATE OF NEVADA Department of Administration Division of Human Resource Management CLASS SPECIFICATION

Files Used in this Tutorial

NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect

Key words: Laser Scanning, LIDAR, Surveying and Mapping, Point Cloud, Geospatial software

ArcGIS Platform. An Integrated System. Portal

Transforming Geodata for Immersive Visualisation

A FRAMEWORK FOR REAL-TIME TERRAIN VISUALIZATION WITH ADAPTIVE SEMI- REGULAR MESHES

Hydrographic Data Management using GIS Technologies

Validation and automatic repair of two- and three-dimensional GIS datasets

3D City Modelling from LIDAR Data

Analysing Big Data in ArcGIS

Getting Started With LP360

Efficient Storage, Compression and Transmission

Emerging Geospatial Trends The Convergence of Technologies. Jim Steiner Vice President, Product Management

POINT CLOUD VISUALIZATION IN AN OPEN SOURCE 3D GLOB3

Understanding Data: A Comparison of Information Visualization Tools and Techniques

I-SiTE - Laser Scanning Revolutionises Site Survey

The Scientific Data Mining Process

Real-time Processing and Visualization of Massive Air-Traffic Data in Digital Landscapes

Where is... How do I get to...

A 3d particle visualization system for temperature management

Developing Fleet and Asset Tracking Solutions with Web Maps

Geo-information in The Hague & National SDI hub PDOK

An Introduction to Open Source Geospatial Tools

HPC technology and future architecture

Big Data Analytics WG: Use Case Array Databases

Ignite Your Creative Ideas with Fast and Engaging Data Discovery

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May ISSN BIG DATA: A New Technology

Working with Digital Elevation Models and Digital Terrain Models in ArcMap 9

Intergraph Geospatial Portfolio 2013

GEOENGINE MSc in Geomatics Engineering (Master Thesis) Anamelechi, Falasy Ebere

Towards Generalization Processes of LiDAR Data based on GRID and OGC Web Processing Services

Cloud Computing and the Future of Internet Services. Wei-Ying Ma Principal Researcher, Research Area Manager Microsoft Research Asia

How to Ingest Data into Google BigQuery using Talend for Big Data. A Technical Solution Paper from Saama Technologies, Inc.

Introduction to Computer Graphics. Reading: Angel ch.1 or Hill Ch1.

Parallel Visualization for GIS Applications

<Insert Picture Here> Web 2.0 Data Visualization with JSF. Juan Camilo Ruiz Senior Product Manager Oracle Development Tools

Big Data Analytics in LinkedIn. Danielle Aring & William Merritt

ARCHITECTURE ANALYSIS OF A THREE-DIMENSIONAL HIGHWAY REAL-TIME SYSTEM

DEVELOPMENT OF REAL-TIME VISUALIZATION TOOLS FOR THE QUALITY CONTROL OF DIGITAL TERRAIN MODELS AND ORTHOIMAGES

What's new in gvsig Desktop 2.0

Cache-friendly progressive data streaming with variable-scale data structures

CHAPTER FIVE RESULT ANALYSIS

Managing Bathymetry in the Cloud with GIS

APPLICATIONS AND RESEARCH ON GIS FOR THE REAL ESTATE

Data Data Everywhere, We are now in the Big Data era

How To Use Lidar Data Processing Software

Euclideon White Paper

Managing Lidar (and other point cloud) Data. Lindsay Weitz Cody Benkelman

Development of 3D Cadastre System to Monitor Land Value and Capacity of Zoning (Case study: Tehran)

A NEW METHOD OF STORAGE AND VISUALIZATION FOR MASSIVE POINT CLOUD DATASET

Norwegian Satellite Earth Observation Database for Marine and Polar Research USE CASES

Understanding the Value of In-Memory in the IT Landscape

Applying GIS Analysis to Archaeological Research in Canada

Visualization methods for patent data

A Distributed Storage Schema for Cloud Computing based Raster GIS Systems. Presented by Cao Kang, Ph.D. Geography Department, Clark University

ARIZONA DEPARTMENT OF TRANSPORTATION. Presented by Lonnie D. Hendrix, P.E. Assistant State Engineer, Maintenance

How To Handle Big Data With A Data Scientist

3D Building Roof Extraction From LiDAR Data

MEng, BSc Applied Computer Science

Hardware design for ray tracing

REGIONAL SEDIMENT MANAGEMENT: A GIS APPROACH TO SPATIAL DATA ANALYSIS. Lynn Copeland Hardegree, Jennifer M. Wozencraft 1, Rose Dopsovic 2 INTRODUCTION

GeoManitoba Spatial Data Infrastructure Update. Presented by: Jim Aberdeen Shawn Cruise

Transcription:

Visualization, storage, analysis and distribution of massive aerial LiDAR point clouds Gerwin de Haan and Hugo Ledoux Data Visualization group GIS technology group GeoWeb 2010, Vancouver July 28 2010 1 / 30

AHN 2 : A dataset covering totally the Netherlands compiled by the government (x, y, z) points raster (50cm grid available) at least 4 pts/m 2 > 150 billions points 2 / 30

AHN 2 : A tiled dataset 3 / 30

AHN 2 : A tiled dataset 3 / 30

File g37en1 08.xyz 82993.039,447517.568,-0.003 82993.334,447517.102,-0.042 82993.633,447516.614,-0.044 82992.494,447517.148,-0.005 82992.788,447516.682,-0.044 82993.689,447515.201,-0.022 82993.987,447514.719,-0.033 82994.282,447514.245,-0.052 82994.576,447513.770,-0.070 82994.884,447513.247,-0.012......... 4 / 30

Our challenges when dealing with massive point clouds 1 Real-time visualisation 2 Storage + spatial analysis 3 Distribution of such datasets Can our tools/workflows scale to massive datasets? 5 / 30

Real-time Visualisation 6 / 30

Why visualise point clouds? Because it s a nice challenge! Because we need to: Perform visual inspection of raw measurements Gain insights from numbers Rendering Visualisation Interaction 7 / 30

From DEM terrain... (AHN2 DEM 0.5m grid) 8 / 30

... to point cloud ( 2 millions points from AHN2 ) 9 / 30

Our tools of choice OpenSceneGraph most popular FOSS scene graph engine based on flight-simulator software (not GIS) OpenSceneGraph-based VRMeer software Python abstraction layers http://code.google.com/p/osgswig 10 / 30

Demonstration video 11 / 30

Visualisation pipeline overview Point Cloud Server Real-Time Visualization Client LiDAR Offline LOD generator Data Server LOD tiles network Database Pager Thread display Visualization Thread 12 / 30

Multi-resolution data struture L1 L1 L0 L0 L0 L0 L1 L2 L1 Ln 13 / 30

Multi-resolution data struture Split LOD0 LOD1 LOD2 Merge LOD3... LOD N 13 / 30

LOD effects 14 / 30

Interaction Stereoscopic display 3D interaction with space-mouse, Wii balance board interaction More info: PhD thesis Techniques and Architectures for 3D Interaction, Gerwin de Haan, TU Delft, 2009. 15 / 30

Interaction 16 / 30

Analysis & Storage 17 / 30

Point clouds are often 2.5D surface LiDAR datasets are formed by scattered points in 3D space, which are the samples of a surface that can be projected on the horizontal plan. 18 / 30

Reconstruction of the surface Original LiDAR points 19 / 30

Reconstruction of the surface Raster representation 19 / 30

Reconstruction of the surface Raster representation 19 / 30

Reconstruction of the surface Original LiDAR points 19 / 30

Reconstruction of the surface TIN (with Delaunay triangles) 19 / 30

Reconstruction of the surface p TIN (with Delaunay triangles) 19 / 30

Reconstruction of the surface a f b c p e d TIN (with Delaunay triangles) 19 / 30

A star-based data structure Goes beyond the usual store points and edges/triangles Ideas come from data structures for compression of graphs p 20 / 30

A star-based data structure Goes beyond the usual store points and edges/triangles Ideas come from data structures for compression of graphs a f b c p e d 20 / 30

A star-based data structure Goes beyond the usual store points and edges/triangles Ideas come from data structures for compression of graphs a f b c p e d 20 / 30

A star-based data structure Goes beyond the usual store points and edges/triangles Ideas come from data structures for compression of graphs a f b c p e star(p) = abcdef d 20 / 30

Every star(v) is stored implicit triangles 21 / 30

Every star(v) is stored implicit triangles 21 / 30

Every star(v) is stored implicit triangles 21 / 30

Every star(v) is stored implicit triangles 21 / 30

Stars in a DBMS ID x y z star 1 3.21 5.23 2.11 2 44 55 61 23 2 5.19 29.01 4.55 7 98 111 233 222 3 22.43 15.99 8.19 99 101 73 23............... 5674 221.19 15.23 37.81 309 802 793 1111 Advantages: 1 Only one table with id x y z star 2 No spatial index needed: fetching of triangles based on walking 3 Star column need not be filled ( Simple Features) 4 Local updates are possible (insertion and removals) 5 Ideas are readily extensible to 3D for storing manipulating tetrahedra 22 / 30

Point Location = Walking in the triangulation starting triangle p (Can be made efficient with some tricks [MSZ99]) 23 / 30

Range Queries: also uses the triangulation 24 / 30

One problem: how to create that DT in the first place? Figure from Martin Isenburg s presentation at GIScience 2006 [ILSS06] 25 / 30

Distribution of the Data 26 / 30

Velas3D: An online AHN 2 selector http://gw.vrlab.tudelft.nl/3dve/client 27 / 30

Velas3D: An online AHN 2 selector http://gw.vrlab.tudelft.nl/3dve/client 27 / 30

Velas3D: An online AHN 2 selector 28 / 30

Thanks for your attention Hugo Ledoux h.ledoux@tudelft.nl Gerwin de Haan g.dehaan@tudelft.nl 29 / 30

References Martin Isenburg, Yuanxin Liu, Jonathan Richard Shewchuk, and Jack Snoeyink. Streaming computation of Delaunay triangulations. ACM Transactions on Graphics, 25(3):1049 1056, 2006. Ernst P. Mücke, Isaac Saias, and Binhai Zhu. Fast randomized point location without preprocessing in two- and three-dimensional Delaunay triangulations. Computational Geometry Theory and Applications, 12:63 83, 1999. 30 / 30