GRASS GIS news GEOSTAT 2012 Münster, Germany

Transcription

1 GRASS GIS news GEOSTAT 2012 Münster, Germany Markus Neteler & Markus Metz Fondazione E. Mach CRI, Italy

2 PGIS Fondazione Edmund Mach, Trento Gridded Meteo data (PAT ACE-SAP, FEM Isotopi) Eco-Health (EDEN FP6, PAT RISKTIGER, EDENext FP7,...) Landscape Genetics (PAT ACE-SAP) OGC Web Services (with ZOO project) Research Topics GIS and Remote Sensing Unit (PGIS) Grape maturation (FEM) future SensorWeb and GIS New GIS methods (with OSGeo) New Remote Sensing methods ongoing Trento

3 GRASS: a portable GIS GRASS 6-6/2011 MacOSX MS-Windows GNU/Linu x

4 DE JA PL New GRASS GIS User interface

5 From GeoTIFF or SHAPE or... Now directly Imported then. GRASS: Project database (Location) wizard

6 GRASS GIS: Interoperability LAS

7 Extra bonus: export to Python scripts GRASS: New Geospatial Modeller

8 Raster and 3D vector Trento, Italy Optional: KML export for virtual globes Elevation model combined with extruded 3D buildings; also true 3D vector supported

9 GRASS Topological 2D/3D Vector model Vector geometry types g Se m t en Node Vertex Area Node Boundary u Bo ar nd Boundary Centroid Vertex Centroid y Face s Vertex Node Use of Spatial Index Vertex Vertex Vertex S eg me t n nt e m Vertex Vertex Geometry is true 3D when: x, y, z g Se not in all GIS! Point Centroid Line Boundary Area (boundary + centroid) face (3D area) [kernel (3D centroid)] [volumes (faces + kernel)] Node Line

10 GRASS Topological Vector Digitizer

11 GRASS Addons: User contributed extensions The Addons repository is SVN based: User can easily obtain write access to develop new functionality Installation with extension manager Increasing inflow of Python scripts

12 in GRASS GIS Support for massive spatial datasets

13 GRASS 7 raster processing Standard nearest neighbour, linear, cubic, lanczos Spline based Regularized Spline Tension (RST), bspline Statistical average, median, mode, min, max, sum, variance, stddev, quantile Filtering window Bartlett, gauss, hermite, sinc, lanczos1, lanczos2, lanczos3, hann, hamming, blackman and any combination thereof Raster resampling

14 GRASS 7 raster processing Inverse Distance Weighing (IDW) Regularized Spline Tension (RST) Bspline (Tykhonov regularization) Ordinary kriging Filtering window Raster surface interpolation from raster or vector points

15 Processing of LiDAR data: laser scanning of the terrain Lidar First pulse Last pulse Digital Situation Model (DSM) Digital Terrain Model (DTM) Processing 500 Million points... M. Brovelli and R. Antolín H. Mitasova

16 Processing of LiDAR data: laser scanning of the terrain Output as vector points: Output as raster map: v.in.lidar r.in.lidar Lidar First pulse Last pulse Digital Surface Model (DSM) Digital Terrain Model (DTM) New in GRASS 7: direct import of LiDAR LAS files

17 Lidar data analysis in GRASS GIS Available Methods: - cell based statistics - binning - spatial approximation - smoothing Use cases: - topographic analysis - Feature extraction (Separation DEM/DSM) H. Mitasova, NCSU M. Brovelli, PdM, Como Multi-return Lidar data

18 Lidar based DTM/DSM with orthophoto draped over it (GRASS: r.sun JRC) and NVIZ) N Lidar data in action: Visualization and solar energy

19 GRASS 7: Support for massive datasets Massive is relative to Hardware resources Software capabilities Operating system capabilities Limiting factors RAM Processing time Disk space Largest supported file size What is massive?

20 GRASS 7: Support for massive datasets Massive is relative to Hardware resources Software capabilities Operating system capabilities Limiting factors RAM Processing time Disk space Largest supported file size What is massive?

21 GRASS 7: Support for massive datasets 600 seconds GRASS GRASS million points Cost surfaces: r.cost

22 Example: Hydrological modelling (think massive data) Distance to the outlet Metz et al. 2011, Hydrology and Earth System Sciences Stream network extraction around the Panama channel (250 million pixel)

23 Main basins Distance to the outlet New tools for hydrological modelling

24 News in Image processing Georectification Orthorectification Atmospheric correction Terrain correction Landsat cloud detection Rocchini, D., Metz, M., Frigeri, A., Delucchi, L., Marcantonio, M., Neteler, M. (2011). Robust rectification of aerial photographs in an Open Source environment. (in press) Improved modules:

25 News in GRASS 7's Vector Topology Spatial query example GUI: click on vector map, what is there? CLI: v.what east_north=east,north 600 seconds GRASS GRASS million points Query of vector point maps

26 News in GRASS 7's Vector Topology Size reduction most prominent for 3D points E.g with ~ points GRASS 6.4: 5.5 MB GRASS 7.0: 0.5 MB Slimmed down topology format

27 News in GRASS 7's Vector Topology Topological cleaning, vector import example Global Administrative Database (GADM), all three levels, global Example:

28 Connecting to other software packages GRASS GIS as Open Source GIS backbone:

29 Doxygen generated programmer's manual

30 GRASS and Python Script part: Parser part (for GUI autocreation and command line support):

31 New GRASS-Python API since 2012

32 source/browse/trunk/modules/java/v_sample_rast.java GRASS and Java

33 Web Processing Service Geostatistics Predictive modeling View Interact Teach raster External data Database engine: Tables, attributes vector GRASS GIS Spatial Analysis Modeling Visualize DBF What you can do with Open Source GIS...

34 GRASS and QGIS Integration: GRASS Toolbox

35 New GRASS and QGIS Integration: Sextante

36 Note: Partially functional in gvsig OADE 2010, more to come in (near) future... SEXTANTE GRASS Integration: Modeller

37 Server Client Web Current Server implementations PyWPS: Python 52N WPS: Java vtkgrassbridge: VTK, C, C++, Py, Java ZOO project - various languages... J Cepicky, Controlling an analytical GIS from Web Ch. Schwartze, Geoinformatics FCE CTU 2008 Web Processing Service WPS

38 GRASS 7 WPS Support

39 GRASS and R Integration R version ( )... > library(spgrass6) Loading required package: sp Loading required package: rgdal Geospatial Data Abstraction Library extensions to R successfully loaded Loaded GDAL runtime: GDAL 1.7.3, released 2010/11/10 Path to GDAL shared files: /usr/local/share/gdal Loaded PROJ.4 runtime: Rel , 23 September 2009, [PJ_VERSION: 470] Path to PROJ.4 shared files: (autodetected) Loading required package: XML GRASS GIS interface loaded with GRASS version: 6.4.2svn and location: nc_spm_08 > myrast <- readrast6(c("geology", "elevation"), cat=c(true, FALSE)) > myvect <- readvect6("roads") > writerast6(myrast, "elev_filt", zcol="elev")... GRASS 6.4.2svn (patutm32):~/papers > R

40 Povray rendering ( adding clouds and haze Furthermore: OpenSceneGraph, Ratman,... Visualization: GRASS data export to Paraview and Povray

41 GRASS GIS, Paraview, and ARToolkit Visualization: GRASS data export to for Augmented Reality

42 A researcher's brain... From MRT scan to Voxels Our FEM colleague --> Personal comm.

43 A researcher's brain... From MRT scan to Voxels

44 A researcher's brain... From MRT scan to Voxels

45 A researcher's brain... From MRT scan to Voxels

46 New Space-Time functionality in GRASS 7 Developed by Sören Gebbert --> Enjoy on Friday!

47 public health and eco-epidemiology GRASS GIS applications in

48 West Nile Chikungunya Saint Louis encephalitis Yellow fever Roiz, Neteler et al Tiger mosquito: Disease vector Spreads in Europe and elsewhere Small containers, used tires and lucky bamboo plants are relevant breeding sites >200 cases of Chikungunya in northern Italy in 2007 (CHIKv imported by India traveler and was then spread by Ae. Albopictus) Dengue Spread of the tiger mosquito (Aedes albopictus): infectious disease vector De Llamballerie et al., 2008: Chikungunya

49 Neteler et al., 2011: Int J Health Geogr, 10:49, Roiz, D., Neteler, M., et al., 2011: Climatic factors... tiger mosquito. Plos ONE, 6(4): e14800

50 Parallelised GIS Processing 19 single-blades and 2 double-blades In total 300 nodes with 600 Gb RAM Circa 2 Tflops/s Linux operating system, blades headless with onesis GRASS GIS and R-stats Queue system for job management (Grid Engine) Processing of all 14,000 maps in parallel: one map per node Computational time: 3 weeks with LST-algorithm V1.1 GRASS GIS Infrastructure: FEM-GIS Cluster

51 Roiz D., Neteler M., Castellani C., Arnoldi D., Rizzoli A., 2011: Climatic Factors Driving Invasion of the Tiger Mosquito (Aedes albopictus) into New Areas of Trentino, Northern Italy. PLoS ONE. 6(4): e14800 LST Applications: Tiger mosquito survival today...

52 Pixel-wise time series (meteo versus MODIS LST): European LST mosaic... usable as virtual meteorologic stations for temperature 250m resolution, 4 maps per day, data since 2000 Metz & Neteler, in prep. Neteler, M., 2010: Estimating daily LST... Remote Sensing 2(1), [PDF] The new European daily MODIS LST time series

53 Further MODIS LST Applications Viticulture classification based on MODIS LST derived Winkler Index Zorer et al., Use of multi-annual MODIS land surface temperature data for the characterization of the heat requirements for grapevine varieties. Proc. Multitemp 2011, Trento, Agriculture examples: Wine production: Winkler index in order to classify climate Growing degree day (GDD) maps: plant- and insect phenology

54 Why we are here... Open science wants Open Source!

55 Almost unlimited possibilities with GRASS GIS and other FOSS4G software thanks to the contributing communities Use GRASS GIS yourself on Tuesday! Enjoy! Markus Neteler & Markus Metz Fondazione E. Mach (FEM) Centro Ricerca e Innovazione GIS and Remote Sensing Unit S. Michele all'adige (Trento), Italy Conclusions

56 Open Source Geospatial Foundation A gentle introduction to OSGeo:

57 GRASS GIS FDO metacrs the OSGeo community: more than 19,000 unique subscribers in 150 topic oriented mailing lists Open Source GIS brought to you by...

58 Open Source Geospatial Foundation OSGeo supports: Software Data Education Community

59 OSGeo Geodata Committee & Data

60 OSGeo Education: Courses Gallery enable people to teach 2012: >60 Tutorials and courses

61 FOSS4G bookshelf: read more!