DEEP. Data Exploration with Physical Metaphors using Elastic Displays. xcoax 2015 Computation, Communication, Aesthetics & X JUNE 25, 2015

Transcription

1 xcoax 2015 Computation, Communication, Aesthetics & X DEEP Data Exploration with Physical Metaphors using Elastic Displays JUNE 25, 2015 Chair of Media Design Technische Universität Dresden Mathias Müller, Thomas Gründer, Rainer Groh

2 Agenda Introduction...3 Interaction with Layered Data...5 DelViz...6 Concept...7 Lessons Learned...13

3 Introduction DepthTouch [Peschke et al., 2012] simple simulation of forces based on the deformation of the surface reality-based metaphors [Jacob et al, 2010], [Agarawala & Balakrishnan, 2006] playful interaction responsive ephemeral xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 3 14

4 Technological Overview Herot & Weinzapfel touch-input vector information MIT 1978 Minsky force sensitive screen Atari 1984 Sinclair Haptic Lens Microsoft Research 1997 Cassinelli Ishikawa Khronos Projector University of Tokyo 2005 Follmer at al. deform MIT 2011 Yun et al. ElaScreen Seoul University 2013 KoalaPad KoalaTechnologies 1984 PL-500 Wacom 2000 Flexible Display Plastic Logic 2013 Force Touch Apple 2015 LG Flex LG Electronics 2014 xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 4 14

5 Interaction with Layered Data Concept: multi-touch with haptic feedback tangibles [Gründer et al., 2013] spatial gestures [Troiano et al, 2014] maps (historical, thematic) photography (depth-of-field, high dynamic range) [Franke et al., 2014] video, image sequences [Casinelly & Ishikawa, 2005]

6 DelViz [Keck et al. 2011] visualization browser find appropriate visualizations based on different criteria: data (structure, type, domain) visualization (update behaviour, dimension, composition) interaction (modality, interface element, functionality) xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 6 14

7 Concept DATA VISUALIZATION INTERACTION DATA STRUCTURE DOMAIN DATA TYPE UPDATE BEHAVIOR ELEMENTS COMPOSITION TYPE FUNCTIONALITY MODALITY INTERFACE ELEMENT Order Information Retrieval Map Periodic Free-Form 2D Panning Mouse Multilevel Selection Network Social Software Symbol Static Circle 3D Rotation Motion Capture Context Menu Hierarchy News Image Continuosly Triangle Overview/Detail Eye Tracking Dialog Collection Technology Text Rectangle Scrolling Touch Text Input Science Number Linking Speech Toolbar Economy Composite Zoom Keyboard Entertainment Bus structure 2am-2pm is a three-dimensional map of the Sunday Minneapolis / St. Paul public transit system, where the horizontal axes represent directional movement and the vertical represents time. The piece is constructed of 47 horizontal layers, each forming a map of the bus routes that run during a given interval of time. xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 7 14

8 Concept - Interaction Concept forces between tags and associated visualization items forces between tags arbitrary forces to create dynamic behaviour Lorem ipsum dolor sit amet, con setetur sadipscing elitr, sed diam nonumy eirmod tempor invidunt ut labore et dolore. Title Title xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 8 14

9 Concept - Initial Design visualizations diffuse in the background until activated visualizations have color of the associated dimension semantic zoom: pressing a visualization reveals information - title -> image -> description Montag, 15. November 2010 Mapping the Web Infome' is a net art endeavor developed in conjunction with the exhibition LifeLike at New Langton Arts gallery in San Francisco. A group of artists were invited to use software developed for the exhibition. The Infome software enables the creation of web crawlers - automatic processes that access web sites and collect data from them - and the creation of visualizations/mappings of the collected data. connections to other related tags mapping the web infome

10 Concept - Design Iterations Overview Detail Overview & Detail FUNCTIONALITY Overview & Detail FUNCTIONALITY Overview Detail Overview Detail FUNCTIONALITY FUNCTIONALITY Static UPDATE BEHAIVIOR xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 10 14

11 IT Y RE TU Mapping the Web Infome' is a net art endeavor developed in conjunction with the exhibition LifeLike at New Langton Arts gallery in San Francisco. A group of artists were invited to use software developed for the exhibition. The Infome software enables the creation of web crawlers - automatic processes that access web sites and collect data from them - and the creation of visualizations/mappings of the collected data. AL DATA STR UC Montag, 15. November 2010 FUNC TI O N mapping the web infome Concept - Final Design OR xcoax 2015 DATE BEHAIV UP I Static June 25, 2015 M. Müller, T. Gründer, R. Groh 11 14

12 Prototype xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 12 14

13 Lessons Learned technical considerations expressiveness exploration - and then? xcoax 2015 June 25, 2015 M. Müller, T. Gründer, R. Groh 13 14

14 References Agarawala, A., Balakrishnan, R.. Keepin it real: pushing the desktop metaphor with physics, piles and the pen. In Proc. CHI 06, ACM, New York, Cassinelli, A., Ishikawa, M. Khronos projector. In SIGGRAPH 2005 Emerging technologies, ACM, New York, Franke, I. S., Müller, M., Gründer, T., Groh, R. FlexiWall: Interaction in-between 2D and 3D Interfaces. In Proc. HCII 2014, Springer, Berlin Gründer, T., Kammer, D., Brade, M., Groh, R. Towards a Design Space for Elastic Displays. In CHI 2013 Workshop: Displays Take New Shape, ACM, New York, Jacob, R.J.K., Girouard, A.,Hirshfield, L.M., Horn, M.S., Shaer, O., Solovey, E.T., Zigelbaum, J. Reality-based interaction: a framework for post-wimp interfaces. In Proc. CHI 08, ACM, New York, USA, Keck, M., Kammer, D., Iwan, R., Taranko, S., Groh, R. DelViz: Exploration of Tagged Information Visualizations. Berlin, 2011: Informatik Interaktion und Visualisierung im Daten-Web. Peschke, J., Göbel, F., Gründer, T., Keck, M., Kammer, D., Groh, R. DepthTouch: An Elastic Surface for Tangible Computing. In Proc. AVI 2012, ACM, New York, Troiano, G. M., Pedersen, E. W., Hornbæk, K. User-defined gestures for elastic, deformable displays. In Proc. AVI 2014, ACM, New York, Watanabe, Y., Cassinelli, A., Komuro, T., Ishikawa, M. The deformable workspace: A membrane between real and virtual space. In Proc TABLETOP 2008, IEEE, New York, xcoax June 25, 2015 M. Müller, T. Gründer, R. Groh