2 Using 3D city models in Augmented Reality Giovanni Landi, Darts Engineering, Genoa Workshop 3D -Stadtmodelle 19. und 20. November 2013, Bonn Veranstalter: die gemeinsame Kommission 3D- Stadtmodelle der Deutschen Gesellschaft für Kartographie e.v. und der Deutschen Gesellschaft für Photogrammetrie, Fernerkundung und Geoinformati on e.v.
3 Augmented Reality with Unity
4 Company ICT SME: Since 1995, in Genoa - Italy Consulting, SW Design & Development, System Integration Customized hi-quality solutions, based on SoA technologies Quality certified system ISO 9001 ITS, BSS, New Media Mission: Technological excellence, passion for innovation and professional growth Advanced technologies to improve business processes and provide added value Vision: Entrepreneurship, passion and continuous training To meet the challenges posed by an increasingly competitive and global market
5 Company Intelligent Transportation Systems: Traffic management systems EFC (also for the multilane free flow version) ALPR, Video Monitoring (streaming over IP) Business Support Systems: Billing & Revenue Management solutions Consulting & SW Engineering for Telco operators Oracle Communications OBRM platform New Media: Innovative applications for dynamic user-experiences m-tourism, Marketing, Industrial Design, Educational NFC, BLE4.0, QRCode, GPS and Augmented Reality
6 New Media Business Unit «New Media» innovative solutions: Immersive experiences, interactive and multimedia AR, GPS, Qr-Code, NFC Belvedere: AR geo-localised information on POI 3d reproduction of the territory City Maps: AR 3d models of city centres POIs organization in categories Natural parks and marine reserves: User GPS position retrieving AR reproduction of the sea floor, the flora and the fauna Local products: Automatic recognition of the products Commercial and techniques information in AR
7 New Media Business Unit icharance : Geo-localised information on the POI visible from the terrace 3d reproduction, in AR, of the POI out of the visible zone Territory observation from a bird s eye perspective Gallinara 3d : 3d reconstruction of the sea floor around the Gallinara Island (Savona) User point of view (GPS position retrieving) Exploration of the sea floor (gyroscope and accelerometer) Florence AR : Interactive Map of Florence with a 3d model of the city centre Bird s eye perspective and exploration of the city centre Paper touristic map + AR in-depth information Capezzana AR : Automatic recognition of the label AR menu around the bottle Multimedia in-depth info about the product
8 Augmented Reality with Unity Augmented Reality App developed with Unity for product presentation and for the visualization of inner components.
9 Augmented Reality with Unity
10 Augmented Reality with Unity
11 Augmented Reality with Unity Blender Model and animate 3d objects or charachters Qualcomm Vuforia: Choose the image for tracking, tracking configuration calculated from Quallcomm s web service, download the tracking configuration as a.unitypackage containing an XML file. Once in Unity: Set up the scene, Set ImageTarget and ARCamera prefabs; Build for XCode or Eclipse
13 Florence AR interactive tourist map (Bird s eye AR map) Giovanni Landi, Giacomo Chegia, Nicola Pireddu demo presented at:
14 Florence AR Florence Bird s Eye view aka Del Catena
15 Florence AR In many tourist maps, Bird s Eye view perspective survives assisted by other useful graphical elements. Florence Bird s Eye view tourist pictorial map
16 Florence AR
17 CitiesAR CitiesAR Giovanni Landi (UBICAsrl), Giacomo Chegia, 2012
18 CitiesAR CitiesAR Giovanni Landi (UBICAsrl), Giacomo Chegia, 2012
19 Florence AR
20 Florence AR The city was modeled with the open source 3d software Blender 2.6. Some textured models where downloaded from this site for courtesy of the authors  a n d t h e n e d i t e d a n d optimized for real time rendering on mobile devices. Unity can import only models under the faces so complex models had to be splitted and simplified to be used in the editor.
21 Florence AR The city was modeled with the open source 3d software Blender 2.6. Some textured models where downloaded from this site for courtesy of the authors  a n d t h e n e d i t e d a n d optimized for real time rendering on mobile devices. Unity can import only models under the faces so complex models had to be splitted and simplified to be used in the editor.
22 Florence AR A normal 1:5000 tourist map of Florence was used as marker for the image based tracking of the test application. The map was chosen for the complexity of its graphics. The image was processed through t h e Q u a l c o m m V u f o r i a developement portal and resulted to provide good image tracking performances
23 Florence AR The traditional tourist city map could be distributed together with a specific AR app that uses the paper map as AR marker, adding a new layer of extra tourist infos (updated regularly), a 3d model of the city and its monuments plus all the location based services available with the GPS support.
24 Florence AR
25 Florence AR
26 Florence AR DEMO
27 AR applied to 3d city visualization Applications with this level of graphic richness and interactivity are now possible and relatively easy to develop with devices and development tools becoming more powerful and user friendly (and free).
28 AR applied to 3d city visualization Away from the touristic field Apps of this kind could be used for a variety of GeoSpatial data visualization and presentations, with all the benefits in terms of interactivity given by AR and realtime 3d on a mobile platform.
29 AR applied to 3d city visualization Unity (built for videogames) has strong and optimized network capabilities and allows to easily create multiplayer experiences (client/server) These presentations could be e.g. collectively participated (multiplayer).
30 Florence AR With AI Algorithms (pathfinding), already optimized by the Game developer Community, its easy e.g. to test pedestrian navigation through the historic centers.
31 AR applied to 3d city visualization AR and tools like Unity combined with rich and optimized geospatial datas could be used to create engaging data visualization user-experiences allowing e.g.: Presentations to the general public of architectural and urban planning projects, Interactive visualizations of simulations running on a 3d city model Advanced Scientific Outreach, Edutainment, Gamification, etc.
32 AR applied to 3d city visualization What Unity is doing with programming and application development is similar to what Arduino did with electronics: expanding and connecting different user communities, with different skills, uses and contributions, making application development easier even without a programming background.
33 AR applied to 3d city visualization Some examples of AR applied to 3d city visualization
34 AR applied to 3d city visualization UCL - Live Campus AR App Created by Masters Students at CASA
35 AR applied to 3d city visualization An augmented reality interactive table for Cityscape, Jeddah
36 AR applied to 3d city visualization An augmented reality interactive table for Cityscape, Jeddah
37 AR applied to 3d city visualization
38 AR applied to 3d city visualization
39 AR applied to 3d city visualization Augmented Reality 3d city for the new cover of Metropolis Magazine (10/2012)
40 AR applied to 3d city visualization
41 AR applied to 3d city visualization As the value of AR is in integration with many other visualization systems and interaction paradigms.
42 AR applied to 3d city visualization Ge ArchiWorld App
44 3d City physical models All the visualizations that are now done with physical models still receive the public s highest levels of acceptance.
45 3d City physical models Shanghai Urban Planning Exhibition Hall
46 3d City physical models
47 3d City physical models
48 3d City physical models Image taken from Archined/ Parquette, a project game employing the herringbone pattern as a principle of reorganisation. The games reveilles the positive side of c o n f l i c t s i n t h e u r b a n planning processes. (http://www.archined.nl)
49 3d City physical models
50 Cities as metaphor of complexity
51 Cities as metaphor of complexity
52 AR applied to 3d city visualization AR could bring all the interactivity offered by the digital world (and the possibility layering information) to all then tangible portrayals of geospatial datas (e.g. the 2d Map or even 3d printed models). AR visualizations can compete (and combine) with this kind of user experiences in terms of interactivity and as eye catcher. AR visualization can learn a lot from the long history of 3d physical modeling, in terms of visual communication.
53 AR applied to 3d city visualization Future developments: Integration with CityGML From Image Based Tracking to SLAM 3d tracking Combination with tangible 3d City Models Further products development Outdoor User Experiences
54 As the data visualization community has been historically very creative and multidisciplinary, the best results will come from the combination of different visualization approaches.
55 Testo inition.co.uk
56 10 LOVE TOKYO - Roppongi Hills