Radiometric Compensation through Inverse Light Transport Gordon Wetzstein and Oliver Bimber

Size: px
Start display at page:

Download "Radiometric Compensation through Inverse Light Transport Gordon Wetzstein and Oliver Bimber"

Transcription

1 Radiometric Compensation through Inverse Light Transport Gordon Wetzstein and Oliver Bimber Pacific Graphics 2007 contact: Radiometric Compensation through Inverse Light Transport 1 30

2 SmartProjector - no Screens required! original image observed projection Radiometric Compensation through Inverse Light Transport 2 30

3 SmartProjector - Applications museums live-stage performances architectural visualization cultural heritage sites outdoor advertisement air plane cabin car interior Radiometric Compensation through Inverse Light Transport 3 30

4 SmartProjector - Limitations no direct mapping: refractions no direct mapping: inter-reflections Radiometric Compensation through Inverse Light Transport 4 30

5 Related Work tiled screen calibration [geometric correction and luminance matching] book: Majumder and Brown Practical Multi-Projector Display Design, AK Peters 2007 [Yang et al. 2005] unconventional projections [no screens, HDR, high-speed, super-resolution] state-of-the-art report: Bimber et al. The Visual Computing of Projector-Camera Systems, EG 2007 image-based relighting, environment matting and dual photography [forward light transport acquisition and relighting] [Debevec et al. 2000], [Masselus et al. 2003], [Sen et al. 2005], [Zonker et al. 1999] inverse illumination [indirect light removal for photography and projection] focus related projector-camera techniques [Seitz et al. 2005], [Bimber et al. 2006] [image sharpening for defocused projections] [Bimber and Emmerling 2006], [Zhang and Nayar 2006], [Brown et al. 2006] Radiometric Compensation through Inverse Light Transport 5 30

6 The 8D Reflectance Field LF = f ( u, v, ϕ, φ)? Radiometric Compensation through Inverse Light Transport 6 30

7 Forward Light Transport L o ( ) ( ) ~ ( ) ( ) x, w = L x, w + T x, w, w' L x, w' d w' o e Ω ( xi ) = Le ( xi ) + T ( xi w j ) Li ( w j ) L, j i L i o, e, incoming, outgoing, emissive light field ~ T transport function T x, w points in space / discrete samples w, w' discrete transport function directions c = T p + e 0 ( pq 1) c 0 t0 L t 0 p 0 e 0 M = M O M M + M 0 ( pq 1) c ( mn 1) t ( mn 1) t ( mn 1) p ( pq 1) e L ( mn 1) p mn camera resolution pq projector resolution c camera image T e light transport matrix projected light environment light color channel radiometric compensation? in camera space Radiometric Compensation through Inverse Light Transport 7 30

8 Light Transport Acquisition p m q mn x 1 C n pq pq x 1 P c = Tp mn Radiometric Compensation through Inverse Light Transport 8 30

9 Light Transport Acquisition p m q mn x 1 C n pq pq x 1 P c = Tp mn Radiometric Compensation through Inverse Light Transport 9 30

10 Light Transport Acquisition p m q mn x 1 C n pq pq x 1 P c = Tp mn Radiometric Compensation through Inverse Light Transport 10 30

11 Light Transport Acquisition p m q mn x 1 C n pq pq x 1 P c = Tp mn Radiometric Compensation through Inverse Light Transport 11 30

12 Light Transport Acquisition p m q mn x 1 C n pq pq x 1 P c = Tp mn Radiometric Compensation through Inverse Light Transport 12 30

13 Light Transport Acquisition video clip projected patterns camera image Radiometric Compensation through Inverse Light Transport 13 30

14 Dual Photography interchange camera and projector by transposing the light transport matrix p m q n pq x 1 C mn x 1 P pq mn c = Tp mn T pq c = T T p [Sen et al. 2005] Radiometric Compensation through Inverse Light Transport 14 30

15 Dual Photography c = Tp composition illuminated composition illumination pattern T p' = T c' dual light transport matrix T illuminated dual Radiometric Compensation through Inverse Light Transport 15 30

16 Generalized Radiometric Compensation c = Tp + e c = T p + T p + T p + e R G B R R R R G R B R c = T p + T p + T p + e R G B G G R G G G B G c = T p + T p + T p + e R G B B B R B G B B B single camera, single projector R G B cr er TR TR T R pr R G B cg e G TG TG T G p = G R G B cb e B TB TB T B p B solve with iterative non-negative least squares general setup with r cameras and k projectors c e T T T L T p = M M M M O M M 0 R 0 G 0 B ( k 1) B ( r 1) cb ( r 1) e B ( r 1) TB ( r 1) TB ( r 1) TB ( r 1) T ( k 1) L B 0 R 0 G 0 B ( k 1) B 0 0 R 0 R 0 R 0 R 0 R 0 R R 0 R 0 G 0 B ( k 1) B 0 0cG 0 e G 0TG 0TG 0TG L 0TG pg 0 R 0 G 0 B ( k 1) B 0 0cB 0 e B 0TB 0TB 0TB L 0T B pb p B Radiometric Compensation through Inverse Light Transport 16 30

17 Diffuse Scattering and Inter-Reflections Radiometric Compensation through Inverse Light Transport 17 30

18 Diffuse Scattering and Inter-Reflections [ The Chubb Chubbs, Pixar] shadows cannot be compensated with single projector Radiometric Compensation through Inverse Light Transport 18 30

19 Defocus Compensation original uncompensated compensation compensated Radiometric Compensation through Inverse Light Transport 19 30

20 Multi-projector compensation left left + right right Radiometric Compensation through Inverse Light Transport 20 30

21 Radiometric Compensation through Inverse Light Transport Interactive Compensation on the GPU reformulate problem for GPU optimized implementation pre-processing: compute inverse light transport on-line matrix-vector multiplication SVD: e p T c + = ( ) = = + + 1) ( 0 1) ( 1) ( 0 0 1) ( 1) ( 1) ( 0 0 1) ( 0 0 pq mn mn pq mn pq mn p p e c e c t t t t p e c T Μ Μ Λ Μ Ο Μ Λ, T T T U V T V U + + = Σ = Σ

22 Sample Light Transport composition dual Radiometric Compensation through Inverse Light Transport 22 30

23 Cluster Decomposition Radiometric Compensation through Inverse Light Transport 23 30

24 Compensation Results [ 9, Focus Features and 9, LLC] Radiometric Compensation through Inverse Light Transport 24 30

25 Projecting on Refractive Material Radiometric Compensation through Inverse Light Transport 25 30

26 Projecting on Refractive Material pseudo-inverse light transport matrix Radiometric Compensation through Inverse Light Transport 26 30

27 Projecting on Refractive Material [ Mike s New Car, Pixar] Radiometric Compensation through Inverse Light Transport 27 30

28 Interactive Compensation on GPU video clip 30 fps, GeForce 7900 GTX [ Mike s New Car, Pixar] Radiometric Compensation through Inverse Light Transport 28 30

29 Summary generalized theory of radiometric compensation using inverse light transport proof-of-concept: diffuse scattering and inter-reflections reflecting statuette refracting glass defocus compensation multiple overlapping projector interactive compensation on the GPU Radiometric Compensation through Inverse Light Transport 29 30

30 Limitations projection hardware resolution black level brightness contrast depth of focus physical setup environment light projection surface computational resources matrix sparsity Radiometric Compensation through Inverse Light Transport 30 30

31 Outlook view-dependent compensation [Bimber et al. 2005] incremental inverse light transport acquisition (possibly direct-indirect separation) [Nayar et al. 2006] novel transport acquisition storage processing schemes [Garg et al. 2006] Radiometric Compensation through Inverse Light Transport 31 30

32 Thank you! Questions? Radiometric Compensation through Inverse Light Transport 32 30

33 Related Work Seamless Multi-Projections Yang, R., Majumder, A, Brown, M. Camera Based Calibration Techniques for Seamless Multi-Projector Displays. ACM TOGS Majumder, A, Brown, M. Practical Multi-Projector Display Design. AK Peters 2007 Nayar, S. Peri, H., Grossberg, M., Belhumeur, P. A Projection System with Radiometric Compensation for Screen Imperfections. ProCams 2003 Bimber, O., Emmerling, A., Klemmer, T. Embedded Entertainment with Smart Projectors. IEEE Computer, 2005 Bimber, O., Iwai, D., Wetzstein, G., Grundhöfer, A. The Visual Computing of Projector-Camera Systems. EuroGraphics (STAR) 2007 Fuji, K., Grossberg, M., Nayar, S. A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments. IEEE CVPR 2005 Bimber, O., Wetzstein, G., Emmerling, A., Nitschke, C. Enabling View-Dependent Stereoscopic Projection in Real Environments. ISMAR 05 Grossberg, M., Peri, H., Nayar, S. Making one Object Look Like Another: Controlling Appearance using a Projector-Camera System. IEEE CVPR 2004 Ashdown, M., Okabe, T., Sato, I., Sato, Y. Robust Content-Dependent Photometric Projector Compensation, ProCams 2006 Grundhöfer, A., Bimber, O. Real-Time Adaptive Radiometric Compensation. IEEE Transactions on Visualization and Computer Graphics, to appear Bimber, O., Iwai, D., Wetzstein, G., Grundhöfer, A., The Visual Computing of Projector-Camera Systems. EuroGraphics state-of-the-art report 2007 Forward Light Transport, BRDF Acquisition and Relighting Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., Sagar, M. Acquiring the Reflectance Field of a Human Face. SIGGRAPH 00 Masselus, V., Peers, P., Dutré, P, Willems, Y. Relighting with 4D incident Light Fields. ACM TOGS 2003 Goesele, M., Lensch. H., Lang, J., Fuchs, C., Seidel, H. DISCO: Acquisition of Translucent Objects. SIGGRAPH 04 Peers, P., vom Berge, K., Matusik, W., Ramamoorthi, R., Lawrence, J., Rusinkiewicz, S., Dutré, P. A Compact Factored Representation of Heterogeneous Subsurface Scattering. SIGGRAPH 2006 Sen, P., Chen, B., Garg, G, Marschner, S, Horowitz, M., Levoy, M., Lensch, H. Dual Photography. SIGGRAPH 05 Focus Related Projector-Camera Techniques Bimber, O., Emmerling, A. Multi-Focal Projection: A Multi-Projector Technique for Increased Focal Depth. IEEE TVCG, 2006 Levoy, M., Chen, B., Vaish, V., Horowitz, M., McDowall, I., Bolas, M. Synthetic Aperture Confocal Imaging. SIGGRAPH 04 Zhang, L., Nayar, S. Projection Defocus Analysis for Scene Capture and Image Display. SIGGRAPH 06 Brown, M., Song, P., Cham, T. Image Pre-Conditioning for Out-of-Focus Projector Blur. CVPR 06 Inverse Illumination Seitz, S., Matsushita, Y., Kutulakos, K. A Theory of Inverse Light Transport. ICCV, 2005 Bimber, O., Grundhöfer, A., Zeidler, T., Danch, D., Kapakos, P. Compensating Indirect Scattering for Immersive and Semi-Immersive Projection Displays. IEEE VR, 2006 Radiometric Compensation through Inverse Light Transport 33 30

34 Comparison CPU - GPU pseudo-inverse is less stable than solving explicitly however, no visible difference Radiometric Compensation through Inverse Light Transport 34 30

35 Error Analysis Radiometric Compensation through Inverse Light Transport 35 30

An Efficient Plugin for Representing Heterogeneous Translucent Materials

An Efficient Plugin for Representing Heterogeneous Translucent Materials An Efficient Plugin for Representing Heterogeneous Translucent Materials Sermet Önel Department of Computer Engineering Yaşar University Email: sermet.onel@yasar.edu.tr Murat Kurt International Computer

More information

Fast High-Resolution Appearance Editing Using Superimposed Projections

Fast High-Resolution Appearance Editing Using Superimposed Projections Fast High-Resolution Appearance Editing Using Superimposed Projections DANIEL G. ALIAGA, YU HONG YEUNG, and ALVIN LAW Purdue University BEHZAD SAJADI and ADITI MAJUMDER University of California Irvine

More information

Projection Center Calibration for a Co-located Projector Camera System

Projection Center Calibration for a Co-located Projector Camera System Projection Center Calibration for a Co-located Camera System Toshiyuki Amano Department of Computer and Communication Science Faculty of Systems Engineering, Wakayama University Sakaedani 930, Wakayama,

More information

REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS

REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS REAL-TIME IMAGE BASED LIGHTING FOR OUTDOOR AUGMENTED REALITY UNDER DYNAMICALLY CHANGING ILLUMINATION CONDITIONS Tommy Jensen, Mikkel S. Andersen, Claus B. Madsen Laboratory for Computer Vision and Media

More information

Augmented Architectural Environments

Augmented Architectural Environments Laser Pointer Tracking in Projector- Augmented Architectural Environments Daniel Kurz, Ferry Häntsch, Max Große, Alexander Schiewe, Oliver Bimber Bauhaus-University Weimar, ARGroup What is this about?

More information

Adaptive Coded Aperture Photography

Adaptive Coded Aperture Photography Adaptive Coded Aperture Photography Oliver Bimber, Haroon Qureshi, Daniel Danch Institute of Johannes Kepler University, Linz Anselm Grundhoefer Disney Research Zurich Max Grosse Bauhaus University Weimar

More information

Getting Started with iray in 3ds Max 2014

Getting Started with iray in 3ds Max 2014 Getting Started with iray in 3ds Max 2014 Iray is an intuitive, interactive, physically based, progressive, path tracing 3D renderer Iray balances ease of use and interactivity with high quality photorealistic

More information

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry.

3 Image-Based Photo Hulls. 2 Image-Based Visual Hulls. 3.1 Approach. 3.2 Photo-Consistency. Figure 1. View-dependent geometry. Image-Based Photo Hulls Greg Slabaugh, Ron Schafer Georgia Institute of Technology Center for Signal and Image Processing Atlanta, GA 30332 {slabaugh, rws}@ece.gatech.edu Mat Hans Hewlett-Packard Laboratories

More information

A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments

A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments A Projector-Camera System with eal-time Photometric Adaptation for Dynamic Environments Kensaku Fujii NTT Cyber Space Laboratories NTT Corporation Yokosuka, JAPAN fujii.kensaku@lab.ntt.co.jp Michael D.

More information

CUBE-MAP DATA STRUCTURE FOR INTERACTIVE GLOBAL ILLUMINATION COMPUTATION IN DYNAMIC DIFFUSE ENVIRONMENTS

CUBE-MAP DATA STRUCTURE FOR INTERACTIVE GLOBAL ILLUMINATION COMPUTATION IN DYNAMIC DIFFUSE ENVIRONMENTS ICCVG 2002 Zakopane, 25-29 Sept. 2002 Rafal Mantiuk (1,2), Sumanta Pattanaik (1), Karol Myszkowski (3) (1) University of Central Florida, USA, (2) Technical University of Szczecin, Poland, (3) Max- Planck-Institut

More information

CS635 Spring 2010. Department of Computer Science Purdue University

CS635 Spring 2010. Department of Computer Science Purdue University Structured Light Based Acquisition (Part 1) CS635 Spring 2010 Daniel G Aliaga Daniel G. Aliaga Department of Computer Science Purdue University Passive vs. Active Acquisition Passive + Just take pictures

More information

Thea Omni Light. Thea Spot Light. Light setup & Optimization

Thea Omni Light. Thea Spot Light. Light setup & Optimization Light setup In this tutorial we will learn how to setup lights inside Thea Studio and how to create mesh lights and optimize them for faster rendering with less noise. Let us have a look at the different

More information

BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality

BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality Henry Fuchs University of North Carolina at Chapel Hill (USA) and NSF Science and Technology Center for Computer Graphics and

More information

High Dynamic Range and other Fun Shader Tricks. Simon Green

High Dynamic Range and other Fun Shader Tricks. Simon Green High Dynamic Range and other Fun Shader Tricks Simon Green Demo Group Motto If you can t make it good, make it big. If you can t make it big, make it shiny. Overview The OpenGL vertex program and texture

More information

Fast Image Synthesis of Virtual Objects in a Real Scene with Natural Shadings

Fast Image Synthesis of Virtual Objects in a Real Scene with Natural Shadings Systems and Computers in Japan, Vol. 36, No. 14, 2005 Translated from Denshi Joho Tsushin Gakkai Ronbunshi, Vol. J84-D-II, No. 8, August 2001, pp. 1864 1872 Fast Image Synthesis of Virtual Objects in a

More information

Video Relighting Using Infrared Illumination

Video Relighting Using Infrared Illumination EUROGRAPHICS 2008 / G. Drettakis and R. Scopigno (Guest Editors) Volume 27 (2008), Number 2 Video Relighting Using Infrared Illumination Oliver Wang and James Davis and Erika Chuang and Ian Rickard and

More information

Announcements. Active stereo with structured light. Project structured light patterns onto the object

Announcements. Active stereo with structured light. Project structured light patterns onto the object Announcements Active stereo with structured light Project 3 extension: Wednesday at noon Final project proposal extension: Friday at noon > consult with Steve, Rick, and/or Ian now! Project 2 artifact

More information

Capturing Appearance

Capturing Appearance Invited Paper Capturing Appearance Holly E. Rushmeier Department of Computer Science, Yale University, New Haven, Connecticut ABSTRACT For computer graphics applications, capturing the appearance parameters

More information

Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination

Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination Fast Separation of Direct and Global Components of a Scene using High Frequency Illumination Shree K. Nayar Columbia University Gurunandan Krishnan Columbia University Michael D. Grossberg City University

More information

A Prototype For Eye-Gaze Corrected

A Prototype For Eye-Gaze Corrected A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive

More information

Image-Based 3D Photography using Opacity Hulls

Image-Based 3D Photography using Opacity Hulls Image-Based 3D Photography using Opacity Hulls Wojciech Matusik Hanspeter Pfister Addy Ngan Paul Beardsley Remo Ziegler Leonard McMillan Figure 1: Renditions of acquired objects with a mixture of highly

More information

Motivation. Motivation

Motivation. Motivation Preserving Preserving Realism Realism in in real-time real-time Rendering Rendering of of Bidirectional Bidirectional Texture Texture Functions Functions Reinhard Klein Bonn University Computer Graphics

More information

A Markerless Augmented Reality Environment for On-Patient Medical Data Visualization

A Markerless Augmented Reality Environment for On-Patient Medical Data Visualization A Markerless Augmented Reality Environment for On-Patient Medical Data Visualization Márcio Macedo, Antonio Apolinário Department of Computer Science Federal University of Bahia Salvador, BA, Brazil Email:

More information

Advanced Rendering for Engineering & Styling

Advanced Rendering for Engineering & Styling Advanced Rendering for Engineering & Styling Prof. B.Brüderlin Brüderlin,, M Heyer 3Dinteractive GmbH & TU-Ilmenau, Germany SGI VizDays 2005, Rüsselsheim Demands in Engineering & Styling Engineering: :

More information

Material Classification using BRDF Slices

Material Classification using BRDF Slices Material Classification using BRDF Slices Oliver Wang Prabath Gunawardane Steve Scher James Davis University of California, Santa Cruz {owang,prabath,sscher,davis}@soe.ucsc.edu Figure 1: Capturing a BRDF

More information

ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/

ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/ ENGN 2502 3D Photography / Winter 2012 / SYLLABUS http://mesh.brown.edu/3dp/ Description of the proposed course Over the last decade digital photography has entered the mainstream with inexpensive, miniaturized

More information

COMP175: Computer Graphics. Lecture 1 Introduction and Display Technologies

COMP175: Computer Graphics. Lecture 1 Introduction and Display Technologies COMP175: Computer Graphics Lecture 1 Introduction and Display Technologies Course mechanics Number: COMP 175-01, Fall 2009 Meetings: TR 1:30-2:45pm Instructor: Sara Su (sarasu@cs.tufts.edu) TA: Matt Menke

More information

Acquisition and Rendering of Transparent and Refractive Objects

Acquisition and Rendering of Transparent and Refractive Objects Thirteenth Eurographics Workshop on Rendering (2002) P. Debevec and S. Gibson (Editors) Acquisition and Rendering of Transparent and Refractive Objects Wojciech Matusik Hanspeter Pfister Remo Ziegler Addy

More information

On-line Estimation of Diffuse Materials

On-line Estimation of Diffuse Materials On-line Estimation of Diffuse Materials Tobias Ritschel and Thorsten Grosch Universitätsstrasse 1 University of Koblenz-Landau 56070 Koblenz Tel.: +49 (0)261 287 2734 Fax: +49 (0)261 287 2735 E-Mail: {ritschel

More information

An introduction to Global Illumination. Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology

An introduction to Global Illumination. Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology An introduction to Global Illumination Tomas Akenine-Möller Department of Computer Engineering Chalmers University of Technology Isn t ray tracing enough? Effects to note in Global Illumination image:

More information

ABS 731 Lighting Design & Technology. Spring 2006

ABS 731 Lighting Design & Technology. Spring 2006 ABS 731 Lighting Design & Technology Spring 2006 AGI32 is used to predict the photometric performance of selected luminaires or daylight penetration in a simulated environment. The environments that can

More information

Image Processing and Computer Graphics. Rendering Pipeline. Matthias Teschner. Computer Science Department University of Freiburg

Image Processing and Computer Graphics. Rendering Pipeline. Matthias Teschner. Computer Science Department University of Freiburg Image Processing and Computer Graphics Rendering Pipeline Matthias Teschner Computer Science Department University of Freiburg Outline introduction rendering pipeline vertex processing primitive processing

More information

A Short Introduction to Computer Graphics

A Short Introduction to Computer Graphics A Short Introduction to Computer Graphics Frédo Durand MIT Laboratory for Computer Science 1 Introduction Chapter I: Basics Although computer graphics is a vast field that encompasses almost any graphical

More information

Lighting Estimation in Indoor Environments from Low-Quality Images

Lighting Estimation in Indoor Environments from Low-Quality Images Lighting Estimation in Indoor Environments from Low-Quality Images Natalia Neverova, Damien Muselet, Alain Trémeau Laboratoire Hubert Curien UMR CNRS 5516, University Jean Monnet, Rue du Professeur Benoît

More information

SkillsUSA 2014 Contest Projects 3-D Visualization and Animation

SkillsUSA 2014 Contest Projects 3-D Visualization and Animation SkillsUSA Contest Projects 3-D Visualization and Animation Click the Print this Section button above to automatically print the specifications for this contest. Make sure your printer is turned on before

More information

Lecture Notes, CEng 477

Lecture Notes, CEng 477 Computer Graphics Hardware and Software Lecture Notes, CEng 477 What is Computer Graphics? Different things in different contexts: pictures, scenes that are generated by a computer. tools used to make

More information

Computer Graphics. Introduction. Computer graphics. What is computer graphics? Yung-Yu Chuang

Computer Graphics. Introduction. Computer graphics. What is computer graphics? Yung-Yu Chuang Introduction Computer Graphics Instructor: Yung-Yu Chuang ( 莊 永 裕 ) E-mail: c@csie.ntu.edu.tw Office: CSIE 527 Grading: a MatchMove project Computer Science ce & Information o Technolog og Yung-Yu Chuang

More information

Real-Time Realistic Rendering. Michael Doggett Docent Department of Computer Science Lund university

Real-Time Realistic Rendering. Michael Doggett Docent Department of Computer Science Lund university Real-Time Realistic Rendering Michael Doggett Docent Department of Computer Science Lund university 30-5-2011 Visually realistic goal force[d] us to completely rethink the entire rendering process. Cook

More information

Lighting Sensitive Display

Lighting Sensitive Display Lighting Sensitive Display SHREE K. NAYAR and PETER N. BELHUMEUR Columbia University and TERRY E. BOULT University of Colorado Although display devices have been used for decades, they have functioned

More information

Introduction to Computer Graphics. Reading: Angel ch.1 or Hill Ch1.

Introduction to Computer Graphics. Reading: Angel ch.1 or Hill Ch1. Introduction to Computer Graphics Reading: Angel ch.1 or Hill Ch1. What is Computer Graphics? Synthesis of images User Computer Image Applications 2D Display Text User Interfaces (GUI) - web - draw/paint

More information

Visualization Using Flexible Displays

Visualization Using Flexible Displays Visualization Using Flexible Displays Jesus Caban W. Brent Seales University of Kentucky Department of Computer Science jesus, seales @netlab.uky.edu Abstract The resolution, degree of complexity, and

More information

False alarm in outdoor environments

False alarm in outdoor environments Accepted 1.0 Savantic letter 1(6) False alarm in outdoor environments Accepted 1.0 Savantic letter 2(6) Table of contents Revision history 3 References 3 1 Introduction 4 2 Pre-processing 4 3 Detection,

More information

Structured Light 3D Scanning in the Presence of Global Illumination

Structured Light 3D Scanning in the Presence of Global Illumination Structured Light 3D Scanning in the Presence of Global Illumination Mohit Gupta, Amit Agrawal, Ashok Veeraraghavan and Srinivasa G. Narasimhan Robotics Institute, Carnegie Mellon University, Pittsburgh,

More information

Theory and Methods of Lightfield Photography SIGGRAPH 2009

Theory and Methods of Lightfield Photography SIGGRAPH 2009 Theory and Methods of Lightfield Photography SIGGRAPH 2009 Todor Georgiev Adobe Systems tgeorgie@adobe.com Andrew Lumsdaine Indiana University lums@cs.indiana.edu 1 Web Page http://www.tgeorgiev.net/asia2009/

More information

NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect

NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect SIGGRAPH 2013 Shaping the Future of Visual Computing NVIDIA IndeX Enabling Interactive and Scalable Visualization for Large Data Marc Nienhaus, NVIDIA IndeX Engineering Manager and Chief Architect NVIDIA

More information

Computer Graphics Global Illumination (2): Monte-Carlo Ray Tracing and Photon Mapping. Lecture 15 Taku Komura

Computer Graphics Global Illumination (2): Monte-Carlo Ray Tracing and Photon Mapping. Lecture 15 Taku Komura Computer Graphics Global Illumination (2): Monte-Carlo Ray Tracing and Photon Mapping Lecture 15 Taku Komura In the previous lectures We did ray tracing and radiosity Ray tracing is good to render specular

More information

Course Overview. CSCI 480 Computer Graphics Lecture 1. Administrative Issues Modeling Animation Rendering OpenGL Programming [Angel Ch.

Course Overview. CSCI 480 Computer Graphics Lecture 1. Administrative Issues Modeling Animation Rendering OpenGL Programming [Angel Ch. CSCI 480 Computer Graphics Lecture 1 Course Overview January 14, 2013 Jernej Barbic University of Southern California http://www-bcf.usc.edu/~jbarbic/cs480-s13/ Administrative Issues Modeling Animation

More information

Disney Research Zurich Voice: +41.78.616.1026. 8006 Zürich Website: zurich.disneyresearch.com/ owang Switzerland

Disney Research Zurich Voice: +41.78.616.1026. 8006 Zürich Website: zurich.disneyresearch.com/ owang Switzerland Oliver Wang Contact Information Disney Research Zurich Voice: +41.78.616.1026 Stampfenbachstrasse 48 E-mail: owang@disneyresearch.com 8006 Zürich Website: zurich.disneyresearch.com/ owang Switzerland Current

More information

Potential of face area data for predicting sharpness of natural images

Potential of face area data for predicting sharpness of natural images Potential of face area data for predicting sharpness of natural images Mikko Nuutinen a, Olli Orenius b, Timo Säämänen b, Pirkko Oittinen a a Dept. of Media Technology, Aalto University School of Science

More information

CS 431/636 Advanced Rendering Techniques"

CS 431/636 Advanced Rendering Techniques CS 431/636 Advanced Rendering Techniques" Dr. David Breen" Korman 105D" Wednesday 6PM 8:50PM" Photon Mapping" 5/2/12" Slide Credits - UC San Diego Goal Efficiently create global illumination images with

More information

CS 4810 Introduction to Computer Graphics

CS 4810 Introduction to Computer Graphics CS 4810 Introduction to Computer Graphics Connelly Barnes University of Virginia Acknowledgement: slides by Jason Lawrence, Misha Kazhdan, Allison Klein, Tom Funkhouser, Adam Finkelstein and David Dobkin

More information

LED Lighting and Skin Tone Model

LED Lighting and Skin Tone Model SUBMISSION TO TCSVT: ACTIVE LIGHTING Active lighting for video conferencing Mingxuan Sun, Zicheng Liu, Senior Member, IEEE, Jingyu Qiu, Zhengyou Zhang, Fellow, IEEE, and Mike Sinclair Abstract In consumer

More information

INTRODUCTION TO RENDERING TECHNIQUES

INTRODUCTION TO RENDERING TECHNIQUES INTRODUCTION TO RENDERING TECHNIQUES 22 Mar. 212 Yanir Kleiman What is 3D Graphics? Why 3D? Draw one frame at a time Model only once X 24 frames per second Color / texture only once 15, frames for a feature

More information

Using Photorealistic RenderMan for High-Quality Direct Volume Rendering

Using Photorealistic RenderMan for High-Quality Direct Volume Rendering Using Photorealistic RenderMan for High-Quality Direct Volume Rendering Cyrus Jam cjam@sdsc.edu Mike Bailey mjb@sdsc.edu San Diego Supercomputer Center University of California San Diego Abstract With

More information

How To Teach Computer Graphics

How To Teach Computer Graphics Computer Graphics Thilo Kielmann Lecture 1: 1 Introduction (basic administrative information) Course Overview + Examples (a.o. Pixar, Blender, ) Graphics Systems Hands-on Session General Introduction http://www.cs.vu.nl/~graphics/

More information

Advanced Computer Graphics. Rendering Equation. Matthias Teschner. Computer Science Department University of Freiburg

Advanced Computer Graphics. Rendering Equation. Matthias Teschner. Computer Science Department University of Freiburg Advanced Computer Graphics Rendering Equation Matthias Teschner Computer Science Department University of Freiburg Outline rendering equation Monte Carlo integration sampling of random variables University

More information

ADVANCED THEORIES FOR CG LIGHTING

ADVANCED THEORIES FOR CG LIGHTING ADVANCED THEORIES FOR CG LIGHTING 0.1 INTRODUCTION To become skilled at 3D lighting, one must have an understanding of how light works. CG lighting has been established based on rules from cinematography,

More information

The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays

The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays The Office of the Future: A Unified Approach to Image-Based Modeling and Spatially Immersive Displays Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, and Henry Fuchs University of North Carolina

More information

Endoscope Optics. Chapter 8. 8.1 Introduction

Endoscope Optics. Chapter 8. 8.1 Introduction Chapter 8 Endoscope Optics Endoscopes are used to observe otherwise inaccessible areas within the human body either noninvasively or minimally invasively. Endoscopes have unparalleled ability to visualize

More information

Digital Image Fundamentals. Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr

Digital Image Fundamentals. Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Digital Image Fundamentals Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Imaging process Light reaches surfaces in 3D. Surfaces reflect. Sensor element receives

More information

GPGPU Computing. Yong Cao

GPGPU Computing. Yong Cao GPGPU Computing Yong Cao Why Graphics Card? It s powerful! A quiet trend Copyright 2009 by Yong Cao Why Graphics Card? It s powerful! Processor Processing Units FLOPs per Unit Clock Speed Processing Power

More information

Spatially Augmented Reality

Spatially Augmented Reality Spatially Augmented Reality Ramesh Raskar, Greg Welch, Henry Fuchs {raskar, welch, fuchs}@cs.unc.edu, (919)-962-1761 Department of Computer Science, University of North Carolina at Chapel Hill, Chapel

More information

Camera Technology Guide. Factors to consider when selecting your video surveillance cameras

Camera Technology Guide. Factors to consider when selecting your video surveillance cameras Camera Technology Guide Factors to consider when selecting your video surveillance cameras Introduction Investing in a video surveillance system is a smart move. You have many assets to protect so you

More information

Realization of a UV fisheye hyperspectral camera

Realization of a UV fisheye hyperspectral camera Realization of a UV fisheye hyperspectral camera Valentina Caricato, Andrea Egidi, Marco Pisani and Massimo Zucco, INRIM Outline Purpose of the instrument Required specs Hyperspectral technique Optical

More information

Wii Remote Calibration Using the Sensor Bar

Wii Remote Calibration Using the Sensor Bar Wii Remote Calibration Using the Sensor Bar Alparslan Yildiz Abdullah Akay Yusuf Sinan Akgul GIT Vision Lab - http://vision.gyte.edu.tr Gebze Institute of Technology Kocaeli, Turkey {yildiz, akay, akgul}@bilmuh.gyte.edu.tr

More information

CSE452 Computer Graphics

CSE452 Computer Graphics CSE452 Computer Graphics Spring 2015 CSE452 Introduction Slide 1 Welcome to CSE452!! What is computer graphics? About the class CSE452 Introduction Slide 2 What is Computer Graphics? Modeling Rendering

More information

Video Camera Image Quality in Physical Electronic Security Systems

Video Camera Image Quality in Physical Electronic Security Systems Video Camera Image Quality in Physical Electronic Security Systems Video Camera Image Quality in Physical Electronic Security Systems In the second decade of the 21st century, annual revenue for the global

More information

Computer Applications in Textile Engineering. Computer Applications in Textile Engineering

Computer Applications in Textile Engineering. Computer Applications in Textile Engineering 3. Computer Graphics Sungmin Kim http://latam.jnu.ac.kr Computer Graphics Definition Introduction Research field related to the activities that includes graphics as input and output Importance Interactive

More information

Introduction to Computer Graphics

Introduction to Computer Graphics Introduction to Computer Graphics Torsten Möller TASC 8021 778-782-2215 torsten@sfu.ca www.cs.sfu.ca/~torsten Today What is computer graphics? Contents of this course Syllabus Overview of course topics

More information

Simultaneous Gamma Correction and Registration in the Frequency Domain

Simultaneous Gamma Correction and Registration in the Frequency Domain Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University

More information

The acquisition of appearance properties of real objects: state of the art, challenges, perspectives

The acquisition of appearance properties of real objects: state of the art, challenges, perspectives The acquisition of appearance properties of real objects: state of the art, challenges, perspectives Matteo Dellepiane Visual Computing Lab, ISTI-CNR Pisa 26th February 2015 The research leading to these

More information

High Dynamic Range Video Using Split Aperture Camera

High Dynamic Range Video Using Split Aperture Camera High Dynamic Range Video Using Split Aperture Camera Hongcheng Wang, Ramesh Raskar, Narendra Ahuja Beckman Institute, University of Illinois at Urbana-Champaign (UIUC), IL, USA Mitsubishi Electric Research

More information

A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA. Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo. University of Padova, Italy

A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA. Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo. University of Padova, Italy A NEW SUPER RESOLUTION TECHNIQUE FOR RANGE DATA Valeria Garro, Pietro Zanuttigh, Guido M. Cortelazzo University of Padova, Italy ABSTRACT Current Time-of-Flight matrix sensors allow for the acquisition

More information

The RADIANCE Lighting Simulation and Rendering System

The RADIANCE Lighting Simulation and Rendering System The RADIANCE Lighting Simulation and Rendering System Written by Gregory J. Ward Lighting Group Building Technologies Program Lawrence Berkeley Laboratory COMPUTER GRAPHICS Proceedings, Annual Conference

More information

Image-Based Model Acquisition and Interactive Rendering for Building 3D Digital Archives

Image-Based Model Acquisition and Interactive Rendering for Building 3D Digital Archives Image-Based Model Acquisition and Interactive Rendering for Building 3D Digital Archives Ying-Chieh Chen 1, Chun-Fa Chang 1, Zong-Nan Shen 1, Yong-Min Chen 1, Hong-Long Chou 2 1 Department of Computer

More information

Path Tracing. Michael Doggett Department of Computer Science Lund university. 2012 Michael Doggett

Path Tracing. Michael Doggett Department of Computer Science Lund university. 2012 Michael Doggett Path Tracing Michael Doggett Department of Computer Science Lund university 2012 Michael Doggett Outline Light transport notation Radiometry - Measuring light Illumination Rendering Equation Monte Carlo

More information

Computational Optical Imaging - Optique Numerique. -- Deconvolution --

Computational Optical Imaging - Optique Numerique. -- Deconvolution -- Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method

More information

PRODUCT SHEET. info@biopac.com support@biopac.com www.biopac.com

PRODUCT SHEET. info@biopac.com support@biopac.com www.biopac.com EYE TRACKING SYSTEMS BIOPAC offers an array of monocular and binocular eye tracking systems that are easily integrated with stimulus presentations, VR environments and other media. Systems Monocular Part

More information

Advances in Real-Time Skin Rendering

Advances in Real-Time Skin Rendering Advances in Real-Time Skin Rendering Natalya Tatarchuk ATI Research Overview Subsurface scattering simulation Texture Space Lighting Irradiance Gradients Precomputed Radiance Transfer Additional tricks

More information

AUDIO. 1. An audio signal is an representation of a sound. a. Acoustical b. Environmental c. Aesthetic d. Electrical

AUDIO. 1. An audio signal is an representation of a sound. a. Acoustical b. Environmental c. Aesthetic d. Electrical Essentials of the AV Industry Pretest Not sure if you need to take Essentials? Do you think you know the basics of Audio Visual? Take this quick assessment test on Audio, Visual, and Systems to find out!

More information

What Makes a Great Picture?

What Makes a Great Picture? What Makes a Great Picture? Robert Doisneau, 1955 With many slides from Yan Ke, as annotated by Tamara Berg 15-463: Computational Photography Alexei Efros, CMU, Fall 2011 Photography 101 Composition Framing

More information

Visualizing a 3D scalar function is an

Visualizing a 3D scalar function is an A NATOMIC R ENDERING AND V ISUALIZATION Fast Global Illumination for Visualizing Isosurfaces with a 3D Illumination Grid Users who examine isosurfaces of their 3D data sets generally view them with local

More information

Cees Snoek. Machine. Humans. Multimedia Archives. Euvision Technologies The Netherlands. University of Amsterdam The Netherlands. Tree.

Cees Snoek. Machine. Humans. Multimedia Archives. Euvision Technologies The Netherlands. University of Amsterdam The Netherlands. Tree. Visual search: what's next? Cees Snoek University of Amsterdam The Netherlands Euvision Technologies The Netherlands Problem statement US flag Tree Aircraft Humans Dog Smoking Building Basketball Table

More information

COMP 790-096: 096: Computational Photography

COMP 790-096: 096: Computational Photography COMP 790-096: 096: Computational Photography Basic Info Instructor: Svetlana Lazebnik (lazebnik@cs.unc.edu) Office hours: By appointment, FB 244 Class webpage: http://www.cs.unc.edu/~lazebnik/fall08 Today

More information

OpenEXR Image Viewing Software

OpenEXR Image Viewing Software OpenEXR Image Viewing Software Florian Kainz, Industrial Light & Magic updated 07/26/2007 This document describes two OpenEXR image viewing software programs, exrdisplay and playexr. It briefly explains

More information

Skills Inventory: Art/Media Communications. 1. Pre-employment Training/Career Development. A. Formal; e.g., certificates. Date Description Location

Skills Inventory: Art/Media Communications. 1. Pre-employment Training/Career Development. A. Formal; e.g., certificates. Date Description Location Skills Inventory: Art/Media Communications 1. Pre-employment Training/Career Development A. Formal; e.g., certificates Date Description Location Art/Design and Communication Skills Inventory: Art/Media

More information

GPU(Graphics Processing Unit) with a Focus on Nvidia GeForce 6 Series. By: Binesh Tuladhar Clay Smith

GPU(Graphics Processing Unit) with a Focus on Nvidia GeForce 6 Series. By: Binesh Tuladhar Clay Smith GPU(Graphics Processing Unit) with a Focus on Nvidia GeForce 6 Series By: Binesh Tuladhar Clay Smith Overview History of GPU s GPU Definition Classical Graphics Pipeline Geforce 6 Series Architecture Vertex

More information

The Data-as-a-Service Framework for Cyber-Physical-Social Big Data

The Data-as-a-Service Framework for Cyber-Physical-Social Big Data The Data-as-a-Service Framework for Cyber-Physical-Social Big Data Laurence Tianruo Yang ( 杨 天 若 ) Huazhong University of Science and Technology, China St Francis Xavier University, Canada 1 Outline 1.

More information

Instructor. Goals. Image Synthesis Examples. Applications. Computer Graphics. Why Study 3D Computer Graphics?

Instructor. Goals. Image Synthesis Examples. Applications. Computer Graphics. Why Study 3D Computer Graphics? Computer Graphics Motivation: Why do we study 3D Graphics? http://www.cs.ucsd.edu/~ravir Instructor http://www.cs.ucsd.edu/~ravir PhD Stanford, 2002. PhD thesis developed Spherical Harmonic Lighting widely

More information

An Interactive Dynamic Tiled Display System

An Interactive Dynamic Tiled Display System An Interactive Dynamic Tiled Display System Juliano Franz, Gelson Reinaldo, Anderson Maciel and Luciana Nedel Instituto de Informática Universidade Federal do Rio Grande do Sul Porto Alegre, Brazil {jmfranz@inf.ufrgs.br,

More information

Go to contents 18 3D Visualization of Building Services in Virtual Environment

Go to contents 18 3D Visualization of Building Services in Virtual Environment 3D Visualization of Building Services in Virtual Environment GRÖHN, Matti Gröhn; MANTERE, Markku; SAVIOJA, Lauri; TAKALA, Tapio Telecommunications Software and Multimedia Laboratory Department of Computer

More information

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R. Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).

More information

Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling

Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling , March 13-15, 2013, Hong Kong Spatio-Temporally Coherent 3D Animation Reconstruction from Multi-view RGB-D Images using Landmark Sampling Naveed Ahmed Abstract We present a system for spatio-temporally

More information

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA N. Zarrinpanjeh a, F. Dadrassjavan b, H. Fattahi c * a Islamic Azad University of Qazvin - nzarrin@qiau.ac.ir

More information

Flat-Field IR Mega-Pixel Lens

Flat-Field IR Mega-Pixel Lens Flat-Field Mega-Pixel Lens Series Flat-Field Mega-Pixel Lens Flat-Field Mega-Pixel Lens 20.ver.02 E Specifications and Lineup Full MP Image Model Imager Size Mount Focal Length Aperture Range Zoom Ratio

More information

Real-Time Atmospheric Cloud Visualization Framework for Urban Simulation System

Real-Time Atmospheric Cloud Visualization Framework for Urban Simulation System Real-Time Atmospheric Cloud Visualization Framework for Urban Simulation System Muhamad Najib Zamri and Mohd Shahrizal Sunar Abstract Clouds are important aspects of any natural outdoor scene especially

More information

The Design and Implement of Ultra-scale Data Parallel. In-situ Visualization System

The Design and Implement of Ultra-scale Data Parallel. In-situ Visualization System The Design and Implement of Ultra-scale Data Parallel In-situ Visualization System Liu Ning liuning01@ict.ac.cn Gao Guoxian gaoguoxian@ict.ac.cn Zhang Yingping zhangyingping@ict.ac.cn Zhu Dengming mdzhu@ict.ac.cn

More information

Virtual Fitting by Single-shot Body Shape Estimation

Virtual Fitting by Single-shot Body Shape Estimation Virtual Fitting by Single-shot Body Shape Estimation Masahiro Sekine* 1 Kaoru Sugita 1 Frank Perbet 2 Björn Stenger 2 Masashi Nishiyama 1 1 Corporate Research & Development Center, Toshiba Corporation,

More information

A Practical Model for Subsurface Light Transport

A Practical Model for Subsurface Light Transport A Practical Model for Subsurface Light Transport Henrik Wann Jensen Stephen R. Marschner Marc Levoy Pat Hanrahan Stanford University Abstract This paper introduces a simple model for subsurface light transport

More information

Speed Performance Improvement of Vehicle Blob Tracking System

Speed Performance Improvement of Vehicle Blob Tracking System Speed Performance Improvement of Vehicle Blob Tracking System Sung Chun Lee and Ram Nevatia University of Southern California, Los Angeles, CA 90089, USA sungchun@usc.edu, nevatia@usc.edu Abstract. A speed

More information