BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality

Save this PDF as:
 WORD  PNG  TXT  JPG

Size: px
Start display at page:

Download "BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality"

Transcription

1 BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality Henry Fuchs University of North Carolina at Chapel Hill (USA) and NSF Science and Technology Center for Computer Graphics and Scientific Visualization Major support is gratefully acknowledged from the U.S. National Science Foundation and from the U.S. Defense Advanced Research Projects Agency

2 Introduction The dominant grand challenge of graphics in the past 30 years has been realism, esp. photorealism Briefly, in the past decade, being in a virtual world, captured the public imagination Next, to be immersed (at least partly), in a far-away place/ with far-away people Driving examples: telemedicine, telecollaboration (MCAD) and laparoscopic surgery

3 Initial Concepts:Visual Telepresence (1993) Local MD & Patient Remote Consultant

4 Medical Consultants Together with Local MD & Patient

5 Problem: Too Difficult (for now) Real-time 3D scene capture at each of the sites Presentation of local plus remote scenes on head-mounted displays to each of the participants Other tasks: image generation, head and hand tracking, etc. are easy by comparison

6 Solution: Work on an easier problem first Eliminate need for head-mounted display Reduce need of scene capture to smaller regions of the rooms to reconstruction (and viewing) from fewer places New, easier problem: Advancing teleconference-based TELECOLLABORATIONS toward TELEPRESENCE

7 Our Vision of Telecollaboration: A Normal Office

8 Our Vision of Telecollaboration: Overlapped Projected Displays

9 Our Vision of Telecollaboration: Seeing and Manipulating Objects Stereo via shutter / prescription glasses Displays can light up and cover the entire room

10 Our Vision of Telecollaboration: Being There Together

11 What Will It Take: major areas Displays: fixed, not head-mounted 3D scene capture Image generation system Tracking system

12 Displays: New opportunities with Micromirror-based displays Physical micro-mirrors on custom IC 800 x 600 pixel resolution typical Commercial product from Texas Instruments One bit of memory behind each mirror Consider it as part of the memory-space of the graphics system, not as a separate projector Use for both display and for (lighting to aid) scene capture

13 Displays: Fixed, large visual area Adapt to user s own environment Large area High resolution Bright / High contrast (Increased demand on image generation) Lot more pixels Adapt to custom screen geometries

14 Video of 3D Talking Heads Rapid depth extraction via structured light reduces problem of finding corresponding points in multiple camera images Light patterns made nearly imperceptible by projecting complementary patterns very rapidly

15 From Images to Geometry: A New Paradigm for 3D Computer Graphics Geometry Images Light-Field Rendering geometric models Lumigraph texture mapping depth maps ( 3D fax ) 3D talking heads Talisman QuickTime VR (not 3D)

16 Image-Based Rendering, Inverse Rendering (from J.Arvo) Inverse Rendering Images New images Interpolation New images can be obtained by interpolating

17 Post-Rendering Warp Past Viewpoint Warp Current Viewpoint Warp Predicted Future Viewpoint

18 Video of Post Rendering Warp.

19 Image Generation: High-performance Graphics Computers Now: screen subdivision (~SGI RE, UNC Pixel-Planes 5) Next: z-compositing final images (UNC PixelFlow) G G G G G G G G Geometry Processors R R R R R R R R Rasterization Processors C C C C Z-priority Compositors

20 Object Parallel by Image Composition Renderer Multiple Independent Primitive Streams Geometry Processor Geometry Processor Rasterizer Rasterizer Frame Buffer Frame Buffer C C Image Composition Network: C's do visibility test on pixels between top and left. Geometry Processor Rasterizer Frame Buffer C Geometry Processor Rasterizer Frame Buffer C Renderers send visibility & color data into network

21 ImageFlow Departure from polygon-based rendering History of rendering: lines, polygons, texture, depth (our belief) Warp images based on depth value at each image sample Input from cameras Preliminary design begun

22 Tracking user s head Difficulty with commercial trackers Image-based tracking / hybrid tracking new difficulty: keeping tracking targets in view Predictive tracking (Ron Azuma: possible for 50-60ms)

23 The HiBall Tracker Second generation ceiling tracker Ceiling tiles completed and installed simple drop-in acoustical tiles enabled by Brown, Caltech, UNC collaboration Design and fabrication at UNC and Utah System functioning 2KHz estimates (0.5 ms latency) 0.1 mm RMS position noise 0.02 degree RMS orientation noise

24 HiBall: photo

25 SCAAT Autocalibration: ceiling photo & LED calibrations

26 Video of UNC HiBall Tracker

27 Being There : in 5-10 years Key: Acquire and Display EVERY mm EVERY sec ( end )

28 Video of Walking around Leonard s Yard Illustrated photographic feel of rendering from image input For each pixel in 360-degree panorama gets a depth/disparity value

29 New Custom Head-mounted Display (D D Colucci, K Keller, R Video see-through to correctly merge real & synthetic parts of the scene (esp. occlusion) Video cameras optically at user s eye positions Unobstructed view except for display Flip-up / flip-down David Casalino, MD

30 Displays (2 of 2): Head-mounted Comfortable See-through (usually) Optical: cheap, easy; can t combine real and virtual Video: bulky, esp. for wide field of view Field of view Brightness / Resolution

31 Laparoscopic Visualization (with Anthony Meyer, MD, PhD) Goal: view from surgeon s normal point of view -. - as with open surgery Key challenge: extract 3D range image from. laparoscopic camera. Initial experiment. Pre-experiment:. mechanically. scanned 3D surface. of. medical model During. experiment:. mapped.. live laparoscopic camera video onto the 3D surface

32 Our Vision of Telecollaboration: Being There Together Shared CAD & Visualization Modeling Interaction Rendering Image Generation Scene Acquisition Displays Tracking Networking

33 Needing to Know Depth within Video Images Needed to extract 3D remote environment Postrendering warp: widely applicable to speed-up image generation frame rate

Introduction to Computer Graphics

Introduction to Computer Graphics Introduction to Computer Graphics Torsten Möller TASC 8021 778-782-2215 torsten@sfu.ca www.cs.sfu.ca/~torsten Today What is computer graphics? Contents of this course Syllabus Overview of course topics

More information

3D U ser I t er aces and Augmented Reality

3D U ser I t er aces and Augmented Reality 3D User Interfaces and Augmented Reality Applications Mechanical CAD 3D Animation Virtual Environments Scientific Visualization Mechanical CAD Component design Assembly testingti Mechanical properties

More information

Virtual Environments - Basics -

Virtual Environments - Basics - Virtual Environments - Basics - What Is Virtual Reality? A Web-Based Introduction Version 4 Draft 1, September, 1998 Jerry Isdale http://www.isdale.com/jerry/vr/whatisvr.html Virtual Environments allow

More information

Immersive Medien und 3D-Video

Immersive Medien und 3D-Video Fraunhofer-Institut für Nachrichtentechnik Heinrich-Hertz-Institut Ralf Schäfer schaefer@hhi.de http://ip.hhi.de Immersive Medien und 3D-Video page 1 Outline Immersive Media Examples Interactive Media

More information

The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays

The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs University of North Carolina

More information

A Short Introduction to Computer Graphics

A Short Introduction to Computer Graphics A Short Introduction to Computer Graphics Frédo Durand MIT Laboratory for Computer Science 1 Introduction Chapter I: Basics Although computer graphics is a vast field that encompasses almost any graphical

More information

Spatially Augmented Reality

Spatially Augmented Reality Spatially Augmented Reality Ramesh Raskar, Greg Welch, Henry Fuchs {raskar, welch, fuchs}@cs.unc.edu, (919)-962-1761 Department of Computer Science, University of North Carolina at Chapel Hill, Chapel

More information

Online Model Reconstruction for Interactive Virtual Environments

Online Model Reconstruction for Interactive Virtual Environments Online Model Reconstruction for Interactive Virtual Environments Benjamin Lok University of North Carolina at Chapel Hill Department of Computer Science ABSTRACT We present a system for generating real-time

More information

High speed 3D capture for Configuration Management DOE SBIR Phase II Paul Banks Paul.banks@tetravue.com

High speed 3D capture for Configuration Management DOE SBIR Phase II Paul Banks Paul.banks@tetravue.com High speed 3D capture for Configuration Management DOE SBIR Phase II Paul Banks Paul.banks@tetravue.com Advanced Methods for Manufacturing Workshop September 29, 2015 1 TetraVue does high resolution 3D

More information

Augmented Architectural Environments

Augmented Architectural Environments Laser Pointer Tracking in Projector- Augmented Architectural Environments Daniel Kurz, Ferry Häntsch, Max Große, Alexander Schiewe, Oliver Bimber Bauhaus-University Weimar, ARGroup What is this about?

More information

REPRESENTATION, CODING AND INTERACTIVE RENDERING OF HIGH- RESOLUTION PANORAMIC IMAGES AND VIDEO USING MPEG-4

REPRESENTATION, CODING AND INTERACTIVE RENDERING OF HIGH- RESOLUTION PANORAMIC IMAGES AND VIDEO USING MPEG-4 REPRESENTATION, CODING AND INTERACTIVE RENDERING OF HIGH- RESOLUTION PANORAMIC IMAGES AND VIDEO USING MPEG-4 S. Heymann, A. Smolic, K. Mueller, Y. Guo, J. Rurainsky, P. Eisert, T. Wiegand Fraunhofer Institute

More information

Virtual Reality in Medicine and Surgery

Virtual Reality in Medicine and Surgery Virtual Reality in Medicine and Surgery Duncan Gillies Department of Computing, Imperial College London Virtual Reality in Medicine and Surgery Lecture 1 Slide 1 A Brief History of Virtual Reality Techniques

More information

Virtuelle Realität. Overview. Teil 5: Visual Displays. Prof. Bernhard Jung. Virtuelle Realität

Virtuelle Realität. Overview. Teil 5: Visual Displays. Prof. Bernhard Jung. Virtuelle Realität Teil 5: Visual Displays Virtuelle Realität Wintersemester 2007/08 Prof. Bernhard Jung Overview Stereoscopy and other visual depth cues Properties of visual displays visual presentation qualities logistic

More information

Image Processing and Computer Graphics. Rendering Pipeline. Matthias Teschner. Computer Science Department University of Freiburg

Image Processing and Computer Graphics. Rendering Pipeline. Matthias Teschner. Computer Science Department University of Freiburg Image Processing and Computer Graphics Rendering Pipeline Matthias Teschner Computer Science Department University of Freiburg Outline introduction rendering pipeline vertex processing primitive processing

More information

Efficient Image Generation for Multiprojector and Multisurface Displays

Efficient Image Generation for Multiprojector and Multisurface Displays Efficient Image Generation for Multiprojector and Multisurface Displays Ramesh Raskar, Matt Cutts, Greg Welch, Wolfgang Stürzlinger Department of Computer Science, University of North Carolina at Chapel

More information

A technical overview of the Fuel3D system.

A technical overview of the Fuel3D system. A technical overview of the Fuel3D system. Contents Introduction 3 How does Fuel3D actually work? 4 Photometric imaging for high-resolution surface detail 4 Optical localization to track movement during

More information

A technical overview of the Fuel3D system.

A technical overview of the Fuel3D system. A technical overview of the Fuel3D system. Contents Introduction 3 How does Fuel3D actually work? 4 Photometric imaging for high-resolution surface detail 4 Optical localization to track movement during

More information

3D Image Warping in Architectural Walkthroughs

3D Image Warping in Architectural Walkthroughs 3D Image Warping in Architectural Walkthroughs Matthew M. Rafferty, Daniel G. Aliaga, Anselmo A. Lastra Department of Computer Science University of North Carolina at Chapel Hill { rafferty aliaga lastra

More information

Practical Data Visualization and Virtual Reality. Virtual Reality VR Interaction and Navigation. Karljohan Lundin Palmerius

Practical Data Visualization and Virtual Reality. Virtual Reality VR Interaction and Navigation. Karljohan Lundin Palmerius Practical Data Visualization and Virtual Reality Virtual Reality VR Interaction and Navigation Karljohan Lundin Palmerius Synopsis Tracking Navigation Interaction Mixing real and virtual (AR) Tracking

More information

Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Sample Exam Questions 2007

Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Sample Exam Questions 2007 Monash University Clayton s School of Information Technology CSE3313 Computer Graphics Questions 2007 INSTRUCTIONS: Answer all questions. Spend approximately 1 minute per mark. Question 1 30 Marks Total

More information

Computer Graphics. Lecture 1:

Computer Graphics. Lecture 1: Computer Graphics Thilo Kielmann Lecture 1: 1 Introduction (basic administrative information) Course Overview + Examples (a.o. Pixar, Blender, ) Graphics Systems Hands-on Session General Introduction http://www.cs.vu.nl/~graphics/

More information

Comp 410/510. Computer Graphics Spring 2016. Introduction to Graphics Systems

Comp 410/510. Computer Graphics Spring 2016. Introduction to Graphics Systems Comp 410/510 Computer Graphics Spring 2016 Introduction to Graphics Systems Computer Graphics Computer graphics deals with all aspects of creating images with a computer Hardware (PC with graphics card)

More information

Using Photorealistic RenderMan for High-Quality Direct Volume Rendering

Using Photorealistic RenderMan for High-Quality Direct Volume Rendering Using Photorealistic RenderMan for High-Quality Direct Volume Rendering Cyrus Jam cjam@sdsc.edu Mike Bailey mjb@sdsc.edu San Diego Supercomputer Center University of California San Diego Abstract With

More information

Consolidated Visualization of Enormous 3D Scan Point Clouds with Scanopy

Consolidated Visualization of Enormous 3D Scan Point Clouds with Scanopy Consolidated Visualization of Enormous 3D Scan Point Clouds with Scanopy Claus SCHEIBLAUER 1 / Michael PREGESBAUER 2 1 Institute of Computer Graphics and Algorithms, Vienna University of Technology, Austria

More information

Image Synthesis. Transparency. computer graphics & visualization

Image Synthesis. Transparency. computer graphics & visualization Image Synthesis Transparency Inter-Object realism Covers different kinds of interactions between objects Increasing realism in the scene Relationships between objects easier to understand Shadows, Reflections,

More information

Wednesdays 09:30-11:30 Room 3305

Wednesdays 09:30-11:30 Room 3305 Wednesdays 09:30-11:30 Room 3305 Ioannis Stamos istamos@hunter.cuny.edu Office: 1090G, Hunter North (Entrance at 69 th bw/ Park and Lexington Avenues) Class website: http://www.cs.hunter.cuny.edu/~ioannis/3d_f11.html

More information

Visualization and Simulation for Research and Collaboration. An AVI-SPL Tech Paper. www.avispl.com (+01).866.559.8197

Visualization and Simulation for Research and Collaboration. An AVI-SPL Tech Paper. www.avispl.com (+01).866.559.8197 Visualization and Simulation for Research and Collaboration An AVI-SPL Tech Paper www.avispl.com (+01).866.559.8197 1 Tech Paper: Visualization and Simulation for Research and Collaboration (+01).866.559.8197

More information

Data Visualization and Data Mining

Data Visualization and Data Mining Data Visualization and Data Mining Jürgen Symanzik Utah State University, Logan, UT *e-mail: symanzik@sunfs sunfs.math..math.usu.edu WWW: http://www.math.usu usu.edu/~ /~symanzik Contents Data Visualization

More information

3D Scanner using Line Laser. 1. Introduction. 2. Theory

3D Scanner using Line Laser. 1. Introduction. 2. Theory . Introduction 3D Scanner using Line Laser Di Lu Electrical, Computer, and Systems Engineering Rensselaer Polytechnic Institute The goal of 3D reconstruction is to recover the 3D properties of a geometric

More information

INTRODUCTION TO RENDERING TECHNIQUES

INTRODUCTION TO RENDERING TECHNIQUES INTRODUCTION TO RENDERING TECHNIQUES 22 Mar. 212 Yanir Kleiman What is 3D Graphics? Why 3D? Draw one frame at a time Model only once X 24 frames per second Color / texture only once 15, frames for a feature

More information

Computer Graphics Hardware An Overview

Computer Graphics Hardware An Overview Computer Graphics Hardware An Overview Graphics System Monitor Input devices CPU/Memory GPU Raster Graphics System Raster: An array of picture elements Based on raster-scan TV technology The screen (and

More information

COMP 790-096: 096: Computational Photography

COMP 790-096: 096: Computational Photography COMP 790-096: 096: Computational Photography Basic Info Instructor: Svetlana Lazebnik (lazebnik@cs.unc.edu) Office hours: By appointment, FB 244 Class webpage: http://www.cs.unc.edu/~lazebnik/fall08 Today

More information

Touchstone -A Fresh Approach to Multimedia for the PC

Touchstone -A Fresh Approach to Multimedia for the PC Touchstone -A Fresh Approach to Multimedia for the PC Emmett Kilgariff Martin Randall Silicon Engineering, Inc Presentation Outline Touchstone Background Chipset Overview Sprite Chip Tiler Chip Compressed

More information

REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS

REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS Tommy Jensen, Mikkel S. Andersen, Claus B. Madsen Laboratory for Computer Vision and Media

More information

Remote Graphical Visualization of Large Interactive Spatial Data

Remote Graphical Visualization of Large Interactive Spatial Data Remote Graphical Visualization of Large Interactive Spatial Data ComplexHPC Spring School 2011 International ComplexHPC Challenge Cristinel Mihai Mocan Computer Science Department Technical University

More information

DESKTOP CARTOGRAPHIC AUGMENTED REALITY: 3D MAPPING AND INVERSE PHOTOGRAMMETRY IN CONVERGENCE

DESKTOP CARTOGRAPHIC AUGMENTED REALITY: 3D MAPPING AND INVERSE PHOTOGRAMMETRY IN CONVERGENCE DESKTOP CARTOGRAPHIC AUGMENTED REALITY: 3D MAPPING AND INVERSE PHOTOGRAMMETRY IN CONVERGENCE Alexandra Koussoulakou (1), Petros Patias (2), Lazaros Sechidis (3) and Efstratios. Stylianidis (4) (1) Assistant

More information

VisWall 4K. High Resolution PowerWall Display. VisWall 4K Datasheet

VisWall 4K. High Resolution PowerWall Display. VisWall 4K Datasheet VisWall 4K - Extra large 14.25 wide screen - 4K (4096x2160) resolution projector - Laser light source stable color, no lamp changes The VisWall 4K is a high resolution PowerWall display wall. The VisWall-4K

More information

Computer science Case study: CGI

Computer science Case study: CGI Computer science Case study: CGI For use in May 2016 and November 2016 Instructions to candidates ycase study booklet required for higher level paper 3. 6 pages International Baccalaureate Organization

More information

1. INTRODUCTION Graphics 2

1. INTRODUCTION Graphics 2 1. INTRODUCTION Graphics 2 06-02408 Level 3 10 credits in Semester 2 Professor Aleš Leonardis Slides by Professor Ela Claridge What is computer graphics? The art of 3D graphics is the art of fooling the

More information

Architecture of a Graphics Pipeline. 6 February 2007 CMPT370 Dr. Sean Ho Trinity Western University

Architecture of a Graphics Pipeline. 6 February 2007 CMPT370 Dr. Sean Ho Trinity Western University Architecture of a Graphics Pipeline 6 February 2007 CMPT370 Dr. Sean Ho Trinity Western University Review last time Visual computing: Computer graphics and image analysis Objectives of visual computing

More information

Optimized bandwidth usage for real-time remote surveillance system

Optimized bandwidth usage for real-time remote surveillance system University of Edinburgh College of Science and Engineering School of Informatics Informatics Research Proposal supervised by Dr. Sethu Vijayakumar Optimized bandwidth usage for real-time remote surveillance

More information

Homographies and Panoramas. Slides from Steve Seitz, Rick Szeliski, Alexei Efros, Fredo Durand, and Kristin Grauman

Homographies and Panoramas. Slides from Steve Seitz, Rick Szeliski, Alexei Efros, Fredo Durand, and Kristin Grauman Homographies and Panoramas Slides from Steve Seitz, Rick Szeliski, Alexei Efros, Fredo Durand, and Kristin Grauman cs129: Computational Photography James Hays, Brown, Fall 2012 Why Mosaic? Are you getting

More information

A Sensor for Simultaneously Capturing Texture and Shape by Projecting Structured Infrared Light

A Sensor for Simultaneously Capturing Texture and Shape by Projecting Structured Infrared Light A Sensor for Simultaneously Capturing Texture and Shape by Projecting Structured Infrared Light Kiyotaka Akasaka,Ryusuke Sagawa, Yasushi Yagi Institute of Scientific and Industrial Research, Osaka University,

More information

Realtime 3D Computer Graphics Virtual Reality. Graphics

Realtime 3D Computer Graphics Virtual Reality. Graphics Realtime 3D Computer Graphics Virtual Reality Graphics Computer graphics 3D-Computer graphics (3D-CG) currently used for Simulators, VR, Games (real-time) Design (CAD) Entertainment (Movies), Art Education

More information

A method of generating free-route walk-through animation using vehicle-borne video image

A method of generating free-route walk-through animation using vehicle-borne video image A method of generating free-route walk-through animation using vehicle-borne video image Jun KUMAGAI* Ryosuke SHIBASAKI* *Graduate School of Frontier Sciences, Shibasaki lab. University of Tokyo 4-6-1

More information

Fundamentals of Computer Graphics

Fundamentals of Computer Graphics Fundamentals of Computer Graphics INTRODUCTION! Sergio Benini! Department of Information Engineering Faculty of Engineering University of Brescia Via Branze, 38 25231 Brescia - ITALY 1 Overview Here you

More information

The Limits of Human Vision

The Limits of Human Vision The Limits of Human Vision Michael F. Deering Sun Microsystems ABSTRACT A model of the perception s of the human visual system is presented, resulting in an estimate of approximately 15 million variable

More information

CS130 - Intro to computer graphics. Dr. Victor B. Zordan vbz@cs.ucr.edu www.cs.ucr.edu/~vbz. Objectives

CS130 - Intro to computer graphics. Dr. Victor B. Zordan vbz@cs.ucr.edu www.cs.ucr.edu/~vbz. Objectives CS130 - Intro to computer graphics Dr. Victor B. Zordan vbz@cs.ucr.edu www.cs.ucr.edu/~vbz Objectives Explore basics of computer graphics Survey application areas Today, brief introduction to graphics

More information

For more than two decades, individually and. Immersive 3D Telepresence

For more than two decades, individually and. Immersive 3D Telepresence Immersive 3D Telepresence Henry Fuchs and Andrei State, University of North Carolina at Chapel Hill Jean-Charles Bazin, ETH Zürich Cutting-edge work on 3D telepresence at a multinational research center

More information

Interactive 3D Medical Visualization: A Parallel Approach to Surface Rendering 3D Medical Data

Interactive 3D Medical Visualization: A Parallel Approach to Surface Rendering 3D Medical Data Interactive 3D Medical Visualization: A Parallel Approach to Surface Rendering 3D Medical Data Terry S. Yoo and David T. Chen Department of Computer Science University of North Carolina Chapel Hill, NC

More information

Introduction to Computer Graphics

Introduction to Computer Graphics Chapter 1 Objectives Introduction to Computer Graphics To understand the basic objectives and scope of computer graphics To identify computer graphics applications To understand the basic structures of

More information

Books. CS155b Computer Graphics. Homework. Additional References. Syllabus. Goals

Books. CS155b Computer Graphics. Homework. Additional References. Syllabus. Goals CS155b Computer Graphics Instructor: Giovanni Motta (gim@ieee.org) Volen, Room #255. Phone: x62718 Class: Mon. and Wed. from 5 to 6:30pm Abelson #131 Teaching Assistants: Anthony Bucci (abucci@cs) John

More information

Self-Positioning Handheld 3D Scanner

Self-Positioning Handheld 3D Scanner Self-Positioning Handheld 3D Scanner Method Sheet: How to scan in Color and prep for Post Processing ZScan: Version 3.0 Last modified: 03/13/2009 POWERED BY Background theory The ZScanner 700CX was built

More information

Virtual and Augmented Reality Applications

Virtual and Augmented Reality Applications Department of Engineering for Innovation University of Salento Lecce, Italy Virtual and Augmented Reality Applications Lucio Tommaso De Paolis Augmented and Virtual Reality Laboratory (AVR Lab) : Graphics,

More information

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry.

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry. Image-Based Photo Hulls Greg Slabaugh, Ron Schafer Georgia Institute of Technology Center for Signal and Image Processing Atlanta, GA 30332 {slabaugh, rws}@ece.gatech.edu Mat Hans Hewlett-Packard Laboratories

More information

CHAPTER FIVE RESULT ANALYSIS

CHAPTER FIVE RESULT ANALYSIS CHAPTER FIVE RESULT ANALYSIS 5.1 Chapter Introduction 5.2 Discussion of Results 5.3 Performance Comparisons 5.4 Chapter Summary 61 5.1 Chapter Introduction This chapter outlines the results obtained from

More information

Structured Light + Range Imaging. Lecture #17. (Thanks to Content from Levoy, Rusinkiewicz, Bouguet, Perona, Hendrik Lensch)

Structured Light + Range Imaging. Lecture #17. (Thanks to Content from Levoy, Rusinkiewicz, Bouguet, Perona, Hendrik Lensch) Structured Light + Range Imaging Lecture #17 (Thanks to Content from Levoy, Rusinkiewicz, Bouguet, Perona, Hendrik Lensch) 3D Scanning Stereo Triangulation I J Correspondence is hard! Structured Light

More information

3D Image Warping in Architectural Walkthroughs

3D Image Warping in Architectural Walkthroughs Appeared: VRAIS '98, pp. 228-233, March 14-18, 1998. 3D Image Warping in Architectural Walkthroughs Matthew M. Rafferty, Daniel G. Aliaga, Anselmo A. Lastra Department of Computer Science University of

More information

Go to contents 18 3D Visualization of Building Services in Virtual Environment

Go to contents 18 3D Visualization of Building Services in Virtual Environment 3D Visualization of Building Services in Virtual Environment GRÖHN, Matti Gröhn; MANTERE, Markku; SAVIOJA, Lauri; TAKALA, Tapio Telecommunications Software and Multimedia Laboratory Department of Computer

More information

Lecture Notes, CEng 477

Lecture Notes, CEng 477 Computer Graphics Hardware and Software Lecture Notes, CEng 477 What is Computer Graphics? Different things in different contexts: pictures, scenes that are generated by a computer. tools used to make

More information

real time in real space TM connectivity... SOLUTIONS GUIDE

real time in real space TM connectivity... SOLUTIONS GUIDE real time in real space TM connectivity... SOLUTIONS GUIDE Ultimate Experience The DVE Immersion Room TM is the most realistic telepresence meeting system ever developed. It was conceived as an entirely

More information

B2.53-R3: COMPUTER GRAPHICS. NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions.

B2.53-R3: COMPUTER GRAPHICS. NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions. B2.53-R3: COMPUTER GRAPHICS NOTE: 1. There are TWO PARTS in this Module/Paper. PART ONE contains FOUR questions and PART TWO contains FIVE questions. 2. PART ONE is to be answered in the TEAR-OFF ANSWER

More information

Advanced Rendering for Engineering & Styling

Advanced Rendering for Engineering & Styling Advanced Rendering for Engineering & Styling Prof. B.Brüderlin Brüderlin,, M Heyer 3Dinteractive GmbH & TU-Ilmenau, Germany SGI VizDays 2005, Rüsselsheim Demands in Engineering & Styling Engineering: :

More information

PROPOSED SYSTEM FOR MID-AIR HOLOGRAPHY PROJECTION USING CONVERSION OF 2D TO 3D VISUALIZATION

PROPOSED SYSTEM FOR MID-AIR HOLOGRAPHY PROJECTION USING CONVERSION OF 2D TO 3D VISUALIZATION International Journal of Advanced Research in Engineering and Technology (IJARET) Volume 7, Issue 2, March-April 2016, pp. 159 167, Article ID: IJARET_07_02_015 Available online at http://www.iaeme.com/ijaret/issues.asp?jtype=ijaret&vtype=7&itype=2

More information

Eye Contact in Leisure Video Conferencing. Annick Van der Hoest & Dr. Simon McCallum Gjøvik University College, Norway.

Eye Contact in Leisure Video Conferencing. Annick Van der Hoest & Dr. Simon McCallum Gjøvik University College, Norway. Eye Contact in Leisure Video Conferencing Annick Van der Hoest & Dr. Simon McCallum Gjøvik University College, Norway 19 November 2012 Abstract This paper presents systems which enable eye contact in leisure

More information

Character Animation from 2D Pictures and 3D Motion Data ALEXANDER HORNUNG, ELLEN DEKKERS, and LEIF KOBBELT RWTH-Aachen University

Character Animation from 2D Pictures and 3D Motion Data ALEXANDER HORNUNG, ELLEN DEKKERS, and LEIF KOBBELT RWTH-Aachen University Character Animation from 2D Pictures and 3D Motion Data ALEXANDER HORNUNG, ELLEN DEKKERS, and LEIF KOBBELT RWTH-Aachen University Presented by: Harish CS-525 First presentation Abstract This article presents

More information

Introduction. C 2009 John Wiley & Sons, Ltd

Introduction. C 2009 John Wiley & Sons, Ltd 1 Introduction The purpose of this text on stereo-based imaging is twofold: it is to give students of computer vision a thorough grounding in the image analysis and projective geometry techniques relevant

More information

A Study on M2M-based AR Multiple Objects Loading Technology using PPHT

A Study on M2M-based AR Multiple Objects Loading Technology using PPHT A Study on M2M-based AR Multiple Objects Loading Technology using PPHT Sungmo Jung, Seoksoo Kim * Department of Multimedia Hannam University 133, Ojeong-dong, Daedeok-gu, Daejeon-city Korea sungmoj@gmail.com,

More information

Opportunities for the generation of high resolution digital elevation models based on small format aerial photography

Opportunities for the generation of high resolution digital elevation models based on small format aerial photography Opportunities for the generation of high resolution digital elevation models based on small format aerial photography Boudewijn van Leeuwen 1, József Szatmári 1, Zalán Tobak 1, Csaba Németh 1, Gábor Hauberger

More information

D animation. Advantages of 2-D2. Advantages of 3-D3. Related work. Key idea. Applications of Computer Graphics in Cel Animation.

D animation. Advantages of 2-D2. Advantages of 3-D3. Related work. Key idea. Applications of Computer Graphics in Cel Animation. Page 1 Applications of Computer Graphics in Cel Animation 3-D D and 2-D 2 D animation Adam Finkelstein Princeton University COS 426 Spring 2003 Homer 3-D3 Homer 2-D2 Advantages of 3-D3 Complex lighting

More information

A Prototype For Eye-Gaze Corrected

A Prototype For Eye-Gaze Corrected A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive

More information

Shadow Algorithms. Image Processing and Computer Graphics. Matthias Teschner. Computer Science Department University of Freiburg

Shadow Algorithms. Image Processing and Computer Graphics. Matthias Teschner. Computer Science Department University of Freiburg Image Processing and Computer Graphics Shadow Algorithms Matthias Teschner Computer Science Department University of Freiburg University of Freiburg Computer Science Department Computer Graphics - 1 Outline

More information

3D Modeling and Animation

3D Modeling and Animation 3D Modeling and Animation An Introduction ( Stephanie O Malley ) University of Michigan 3D Lab Digital Media Commons, Library http://um3d.dc.umich.edu What does CGI Mean? CGI Stands for Computer Generated

More information

Automatic 2D-to-3D Video Conversion Techniques for 3DTV

Automatic 2D-to-3D Video Conversion Techniques for 3DTV Automatic 2D-to-3D Video Conversion Techniques for 3DTV Dr. Lai-Man Po Email: eelmpo@cityu.edu.hk Department of Electronic Engineering City University of Hong Kong Date: 13 April 2010 Content Why 2D-to-3D

More information

Graphical displays are generally of two types: vector displays and raster displays. Vector displays

Graphical displays are generally of two types: vector displays and raster displays. Vector displays Display technology Graphical displays are generally of two types: vector displays and raster displays. Vector displays Vector displays generally display lines, specified by their endpoints. Vector display

More information

A Realistic Video Avatar System for Networked Virtual Environments

A Realistic Video Avatar System for Networked Virtual Environments A Realistic Video Avatar System for Networked Virtual Environments Vivek Rajan, Satheesh Subramanian, Damin Keenan Andrew Johnson, Daniel Sandin, Thomas DeFanti Electronic Visualization Laboratory University

More information

An Immersive Surgery Training System With Live Streaming Capability

An Immersive Surgery Training System With Live Streaming Capability An Immersive Surgery Training System With Live Streaming Capability Yang YANG a, Xinqing GUO a, Zhan YU a, Karl V. STEINER a,c, Kenneth E. BARNER a, Thomas L. BAUER b and Jingyi YU a a University of Delaware

More information

Real World Teleconferencing

Real World Teleconferencing Real World Teleconferencing Mark Billinghurst a, Adrian Cheok b, Hirokazu Kato c, Simon Prince b a HIT Lab New Zealand b National University of Singapore c Hiroshima City University If, as it is said to

More information

Omni-focus Video Camera

Omni-focus Video Camera Omni-focus Video Camera University of Toronto Based on an entirely new principle, the Omni-focus Video Camera was invented by Professor Keigo Iizuka of the Department of Electrical and Computer Engineering

More information

HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAYS AND TUNNEL LININGS. HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAY AND ROAD TUNNEL LININGS.

HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAYS AND TUNNEL LININGS. HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAY AND ROAD TUNNEL LININGS. HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAYS AND TUNNEL LININGS. HIGH-PERFORMANCE INSPECTION VEHICLE FOR RAILWAY AND ROAD TUNNEL LININGS. The vehicle developed by Euroconsult and Pavemetrics and described

More information

Develop Computer Animation

Develop Computer Animation Name: Block: A. Introduction 1. Animation simulation of movement created by rapidly displaying images or frames. Relies on persistence of vision the way our eyes retain images for a split second longer

More information

MMGD0203 Multimedia Design MMGD0203 MULTIMEDIA DESIGN. Chapter 3 Graphics and Animations

MMGD0203 Multimedia Design MMGD0203 MULTIMEDIA DESIGN. Chapter 3 Graphics and Animations MMGD0203 MULTIMEDIA DESIGN Chapter 3 Graphics and Animations 1 Topics: Definition of Graphics Why use Graphics? Graphics Categories Graphics Qualities File Formats Types of Graphics Graphic File Size Introduction

More information

Differentiation of 3D scanners and their positioning method when applied to pipeline integrity

Differentiation of 3D scanners and their positioning method when applied to pipeline integrity 11th European Conference on Non-Destructive Testing (ECNDT 2014), October 6-10, 2014, Prague, Czech Republic More Info at Open Access Database www.ndt.net/?id=16317 Differentiation of 3D scanners and their

More information

C4 Computer Vision. 4 Lectures Michaelmas Term Tutorial Sheet Prof A. Zisserman. fundamental matrix, recovering ego-motion, applications.

C4 Computer Vision. 4 Lectures Michaelmas Term Tutorial Sheet Prof A. Zisserman. fundamental matrix, recovering ego-motion, applications. C4 Computer Vision 4 Lectures Michaelmas Term 2004 1 Tutorial Sheet Prof A. Zisserman Overview Lecture 1: Stereo Reconstruction I: epipolar geometry, fundamental matrix. Lecture 2: Stereo Reconstruction

More information

Introduction Week 1, Lecture 1

Introduction Week 1, Lecture 1 CS 430/536 Computer Graphics I Introduction Week 1, Lecture 1 David Breen, William Regli and Maxim Peysakhov Geometric and Intelligent Computing Laboratory Department of Computer Science Drexel University

More information

Stereo Display. Cross Polarized glasses - Passive stereo. Stereo Rendering. Shutter glasses - Active stereo. Polarized glasses

Stereo Display. Cross Polarized glasses - Passive stereo. Stereo Rendering. Shutter glasses - Active stereo. Polarized glasses Stereo Display Virtual Reality Technology and Programming TNM053: Lecture 3: Virtual Reality Displays Most common method used in virtual reality technology Made most use of in depth perception Requires

More information

SAGE: Scalable Adaptive Graphics Environment. Electronic Visualization Laboratory, University of Illinois at Chicago

SAGE: Scalable Adaptive Graphics Environment. Electronic Visualization Laboratory, University of Illinois at Chicago SAGE: Scalable Adaptive Graphics Environment High-Resolution Visualization over Optical Networks Luc Renambot renambot@uic.edu Electronic Visualization Laboratory, University of Illinois at Chicago Scientific

More information

CS 4204 Computer Graphics

CS 4204 Computer Graphics CS 4204 Computer Graphics 3D views and projection Adapted from notes by Yong Cao 1 Overview of 3D rendering Modeling: *Define object in local coordinates *Place object in world coordinates (modeling transformation)

More information

Part 21: Augmented Reality

Part 21: Augmented Reality Part 21: Augmented Reality Virtuelle Realität Wintersemester 2006/07 Prof. Bernhard Jung Overview Introduction to Augmented Reality Augmented Reality Displays Examples AR Toolkit an open source software

More information

Computer Graphics. Computer graphics deals with all aspects of creating images with a computer

Computer Graphics. Computer graphics deals with all aspects of creating images with a computer Computer Graphics Computer graphics deals with all aspects of creating images with a computer Hardware Software Applications Computer graphics is using computers to generate and display images based on

More information

CITRIS Founding Corporate Members Meeting

CITRIS Founding Corporate Members Meeting Massive Data Exploration Virtual Reality and Visualization Oliver Staadt, Bernd Hamann CIPIC and CS Department, UC Davis CITRIS Founding Corporate Members Meeting Thursday, February 27, 2003 University

More information

ISSCC 2003 / SESSION 9 / TD: DIGITAL ARCHITECTURE AND SYSTEMS / PAPER 9.3

ISSCC 2003 / SESSION 9 / TD: DIGITAL ARCHITECTURE AND SYSTEMS / PAPER 9.3 ISSCC 2003 / SESSION 9 / TD: DIGITAL ARCHITECTURE AND SYSTEMS / PAPER 9.3 9.3 Ultra-High Resolution Image Capturing and Processing for Digital Cinematography Albert Theuwissen 1, John Coghill, Lucian Ion,

More information

POSE-SPACE IMAGE-BASED RENDERING

POSE-SPACE IMAGE-BASED RENDERING POSE-SPACE IMAGE-BASED RENDERING Anna Hilsmann 1,2 Philipp Fechteler 2 Peter Eisert 1,2 1 Humboldt University of Berlin 2 Fraunhofer HHI The work presented in this paper is funded by the German Science

More information

3D Scanning for Virtual Shopping. Dr. Jürgen Sturm Group Leader RGB-D

3D Scanning for Virtual Shopping. Dr. Jürgen Sturm Group Leader RGB-D 3D Scanning for Virtual Shopping Dr. Jürgen Sturm Group Leader RGB-D metaio GmbH Augmented Reality with the Metaio SDK 2 Metaio SDK SDK for developers to create augmented reality apps Supports ios, Android,

More information

Computer Graphics: Visualisation Lecture 3. Taku Komura Institute for Perception, Action & Behaviour

Computer Graphics: Visualisation Lecture 3. Taku Komura Institute for Perception, Action & Behaviour Computer Graphics: Visualisation Lecture 3 Taku Komura tkomura@inf.ed.ac.uk Institute for Perception, Action & Behaviour Taku Komura Computer Graphics & VTK 1 Last lecture... Visualisation can be greatly

More information

Light-Field Displays: Technology and Representation of 3D visual information. Péter Tamás Kovács Holografika

Light-Field Displays: Technology and Representation of 3D visual information. Péter Tamás Kovács Holografika Light-Field Displays: Technology and Representation of 3D visual information Péter Tamás Kovács Holografika JPEG PLENO Workshop Warsaw, Poland 23 June, 2015 Holografika Hungarian company, active in the

More information

3D Object Digitalization Project: Digital Langweil s model of Prague. Visual Connection, a.s. www.visual.cz 8.7.2008

3D Object Digitalization Project: Digital Langweil s model of Prague. Visual Connection, a.s. www.visual.cz 8.7.2008 3D Object Digitalization 8.7.2008 Langweil s model of Prague This realistic, 1826-37 paper model of Prague, named after its creator, shows more than two thousand buildings in the city's historic centre

More information

Colorado School of Mines Computer Vision Professor William Hoff

Colorado School of Mines Computer Vision Professor William Hoff Professor William Hoff Dept of Electrical Engineering &Computer Science http://inside.mines.edu/~whoff/ 1 Introduction to 2 What is? A process that produces from images of the external world a description

More information

Equalizer. Parallel OpenGL Application Framework. Stefan Eilemann, Eyescale Software GmbH

Equalizer. Parallel OpenGL Application Framework. Stefan Eilemann, Eyescale Software GmbH Equalizer Parallel OpenGL Application Framework Stefan Eilemann, Eyescale Software GmbH Outline Overview High-Performance Visualization Equalizer Competitive Environment Equalizer Features Scalability

More information