A Haptic Surgical Simulator for Operative Setup and Exposure in Laparoscopic Cholecystectomy.



Similar documents
Computer Graphics in Medicine

Virtual Training. Proven Results.

Development of Simulation Tools Software

Integration of a Robotic Arm with the Surgical Assistant Workstation Software Framework

Effectiveness of Haptic Feedback in Open Surgery Simulation and Training Systems

SOFA an Open Source Framework for Medical Simulation

Advances in Robotic Technology

1. INTRODUCTION Graphics 2

Virtual Reality in Medicine and Surgery

PATIENT CONSENT TO PROCEDURE - ROUX-EN-Y GASTRIC BYPASS

Interactive Level-Set Deformation On the GPU

Bile Leaks After Laparoscopic Cholecystectomy. Kings County Hospital Center Eliana A. Soto, MD

UCLA Asian Liver Program

Computer Aided Liver Surgery Planning Based on Augmented Reality Techniques

DOCTORS HOSPITAL AT RENAISSANCE CANCER CENTER Sarada Gummadi, M.D. Medical Oncology/Hematology

Interactive Level-Set Segmentation on the GPU

Introduction to Computer Graphics

Gallbladder - gallstones and surgery

Approaching VR 2.0: Creating and Sharing Open Source Virtual Environments for Health Care and Research

Multimedia Technology and Design Courses at a Glance

Laparoscopic Gallbladder Removal (Cholecystectomy) Patient Information from SAGES

Bachelor of Games and Virtual Worlds (Programming) Subject and Course Summaries

Computer Graphics. Computer graphics deals with all aspects of creating images with a computer

Robotic Surgery 12 years of robotic assisted surgery vs. conventional laparoscopic surgery

Laparoscopic Cholecystectomy

Biliary Stone Disease

The Laparoscopic Surgical Skills programme: setting the European standard

Robot Task-Level Programming Language and Simulation

For designers and engineers, Autodesk Product Design Suite Standard provides a foundational 3D design and drafting solution.

Gallbladder Diseases and Problems

Laparoscopic Trainer Product Catalog

s y s t e m r e q u i r e m e n t s

NEC Projector User Supportware 2 Software Utility Installation Guide

Introduction to Computer Graphics. Jürgen P. Schulze, Ph.D. University of California, San Diego Fall Quarter 2012

Five Really Easy Steps to Build a Homemade Low-Cost Simulator

Laparoscopic Cholecystectomy

Facing Pancreatic Surgery? Learn about minimally invasive da Vinci Surgery

-Bowling Green State University, Bachelor of Arts and Bachelor of Science, The Ohio State University College of Medicine, graduated 1959.

Video Tracking Software User s Manual. Version 1.0

Virtual Reality in Chemical Engineering Education

How to choose a suitable computer

MEDMONT STUDIO 5 BASE REQUIRMENTS

FES TEST CENTER GUIDELINES For applicants within the U.S. and Canada

CS130 - Intro to computer graphics. Dr. Victor B. Zordan vbz@cs.ucr.edu Objectives

Chapter 02: Computer Organization. Lesson 04: Functional units and components in a computer organization Part 3 Bus Structures

NORTHERN VALLEY SCHOOLS Office of Curriculum and Instruction Technology Education Department Demarest and Old Tappan HYPERMEDIA II GRADES 10 12

Sleeve Gastrectomy Surgery & Follow Up Care

Weight Loss before Hernia Repair Surgery

Desktop PC Buying Guide

System requirements for Autodesk Building Design Suite 2017

LBP-1210 Laser Printer

Development of Infrared-Based Positioning Simulator for Endoscopic Carpal Tunnel Release Surgery

USB Security Key Instructions

The Digital Design Studio, Glasgow School of Art

TEACHING INTRODUCTORY COMPUTER GRAPHICS WITH THE PROCESSING LANGUAGE

IBM Tivoli Monitoring V6.2.3, how to debug issues with Windows performance objects issues - overview and tools.

Course Overview. CSCI 480 Computer Graphics Lecture 1. Administrative Issues Modeling Animation Rendering OpenGL Programming [Angel Ch.

Several tips on how to choose a suitable computer

SIGGRAPH ASIA 2015 KOBE

COMMUNICATION SERVER 1000 COMMUNICATION SERVER 1000 TELEPHONY MANAGER

Informed Consent for Laparoscopic Vertical Sleeve Gastrectomy. Patient Name

A Remote Maintenance System with the use of Virtual Reality.

DAQ in MATLAB HANS-PETTER HALVORSEN,

The Evolution of Computer Graphics. SVP, Content & Technology, NVIDIA

IN THE CIRCUIT COURT OF THE STATE OF OREGON FOR THE COUNTY OF [COUNTY]

Scientific Examples of Virtual Reality and Visualization Applications

Gallbladder Surgery with an Incision (Cholecystectomy)

Scooter, 3 wheeled cobot North Western University. PERCRO Exoskeleton

NVIDIA Jetson TK1 Development Kit

CLINICAL SIMULATION SECTION NEWS Volume 2, Issue 1 February 2013

Development of a Dental Skills Training Simulator Using Virtual Reality and Haptic Device

GiPSi: An Open Source/Open Architecture Software Development Framework for Surgical Simulation

Intelligent Monitoring Software

A New Approach to Cutting Tetrahedral Meshes

How To Use Movi On A Pc Or Mac Or Ipad (For A Powerpoint) With A Mouse Or Touchpad (For An Ipad) With Your Computer Or Ipo (For Mac Or Powerpoint (For Pc Or Ipro

BUILDING TELEPRESENCE SYSTEMS: Translating Science Fiction Ideas into Reality

Certified Game Developer

The Whipple Procedure. Sally Hodges, Ph.D.(c) Given the length and difficulty of the procedure, regardless of the diagnosis, certain

3D Modeling and Animation in a Virtual World

Intuitive Navigation in an Enormous Virtual Environment

Volume Visualization Tools for Geant4 Simulation

Computer Based Training Proposal for Design Solutions, Inc. Created by: Karen Looney EME 6930 Flash PLE

The Design and Implement of Ultra-scale Data Parallel. In-situ Visualization System

Transcription:

Poster presentation at the Annual Medicine Meets Virtual Reality Conference (MMVR 2003), Newport Beach, California, January 21-25, 2003 A Haptic Surgical Simulator for Operative Setup and Exposure in Laparoscopic Cholecystectomy. Roger Webster, Ph.D. 2, 3, Randy S. Haluck, M.D. 1, 3, Betty Mohler 2, Josh Boyd 2, Jon Reeser 2, Aaron Benson 2, David DeSanto 2. 1 Department of Surgery, Penn State College of Medicine, Milton S. Hershey Medical Center, Hershey, PA USA 17033 2 Department of Computer Science, D&E Communications Inc. Wing, H. Justin Roddy Science and Technology Complex, Millersville University, Millersville, PA. USA 17551 3 Verefi Technologies Incorporated, www.verefi.com, Hershey, PA, USA 17033 Abstract. This paper describes a laparoscopic cholecystectomy surgical training software system we have developed using the Immersion Laparoscopic Surgical Workstation and the Verefi Technologies Inc USB 30 degree Endoscopic Ecamera system hardware. The trainer is designed to train and test for many laparoscopic skills such as: manipulation of the laparoscope, grasping and stretching the gallbladder to expose the cystic duct, clip application to the cystic duct, cutting the cystic duct, and removing the gallbladder from the abdomen. Simulated patient breathing is accomplished by using a texture motion algorithm. The gallbladder, cystic duct and bile ducts are stretched and compressed using Hookes law of F=-kx within a mass-springs model. The intent is to provide an effective method to learn the laparoscopic cholecystectomy procedure using a haptic surgical simulator. 1. Introduction. Laparoscopic cholecystectomy (LC) is a common surgical procedure that is often the first laparoscopic operation learned by surgeons. While LC may be considered an entry level laparoscopic operation, there is the potential for disastrous complications, including bile duct leak or injury. A need exists for training in skills pertinent for LC prior to a surgeon s first case in the operating room. Some researchers have developed subtasks or modules in the simulation of the laparoscopic cholecystectomy procedure [1-5]. Our current system is designed with the intent of practice for the majority of the LC operation. 2. Tools: Hardware and Software. The laparoscopic simulator hardware is the commercially available Laparoscopic Surgical Workstation (LSW) by Immersion, Inc. The LSW is a human-computer interface tool designed for VR simulations of laparoscopic and endoscopic surgical

procedures. We have developed a low-cost 30 degree prototype camera hardware unit which attaches easily onto the Immersion VLI handle tube and plugs into the computer via the USB port. The VLI tracks the motion of a pair of laparoscopic surgical instruments, each moving in 5 degrees of freedom. The VLI system provides an effective, low cost, means of tracking laparoscopic and endoscopic surgical procedures. The training software runs on a conventional Windows XP workstation with a 1.0 GHz Pentium processor (or higher) and an OpenGL graphics accelerator such as the Nvidia Geforce board. The training software will run under the Windows 2000/NT, or XP operating systems. Figure 1. The Immersion VLI device is used in conjunction with the Verefi Technologies Inc USB 30 Degree Endoscopic Ecamera system Figure 2. The Immersion Laparoscopic Surgical Workstation is used as the haptics device.

Figure 3. Screen shot of laparoscopic cholecystectomy surgical simulator showing the user exposing the cystic duct. Figure 4. Screen shot showing cystic duct clipped with staples.

3. Modeling and Software. The storyboard for the laparoscopic cholecystectomy surgical training session entails navigating the virtual surgical field with the 30-degree endoscopic camera, locating the gallbladder, then grasping and stretching the gallbladder to expose, staple, and sever the cystic duct. After the user has correctly located the desired camera orientation and position to show the proper workspace, the user then grasps and stretches the gallbladder to expose the cystic duct. A mass-springs model is used to model duct and gallbladder stretching. The lesson includes placing two staples around the cystic duct near the bile duct, and one staple close to the gallbladder. The cystic duct should then be severed in between the staples. The three dimensional (3D) models of the virtual laparoscopic tool and all organs in the abdomen were built in 3D Studio Max and are stored as 3ds files. These models are loaded into the graphics simulation. The application software makes calls to our virtual haptic medical toolkit (VHMT) API that calls OpenGL graphics routines. The training system has a data collection module that collects various metrics such as: time spent on each sub-procedure and time spent on the whole procedure, tissue tears (over stretching), stapling errors and cutting errors. Another software module records the motions of the user. This is accomplished by recording the positions and orientations of all 3D graphics objects. Thus, the 3D graphics are used to replay the technique, showing the medical student or mentor what the user did during the training session. 4. Conclusions and Future Work. The goal of this software training module is to provide an effective method to learn key elements of laparoscopic cholecystectomy using a haptic surgical simulator. The simulator is designed to train and test many laparoscopic skills such as: navigation with a rigid laparoscope, locating the gallbladder in the abdomen, grasping and exposing the gallbladder properly for safe dissection of cystic duct, application of clips to the cystic duct, cutting the cystic duct, and removing the gallbladder from the abdomen. This software runs on the Immersion haptic Laparoscopic Surgical Workstation utilizing our virtual haptic medical toolkit (VHMT) API for graphics and haptics. The system also uses the Verefi Technologies Inc USB 30 degree Endoscopic Ecamera system hardware. System validation is currently underway. 5. Acknowledgments. This project was funded, in part, by the National Science Foundation under grant numbers DUE-9950472 and EIA-0116616, the Neimeyer-Hodgson Grants Program, the Havemeier-Gibson Endowment for Computer Science, Millersville University Noonan Fund, and by the Faculty Grants Committee of Millersville University. References/Literature. [1] Roger W. Webster, R. Haluck, B. Mohler, R. Ravenscroft, E. Crouthamel, T. Frack, S. Terlecki, J. Sheaffer, "Elastically Deformable 3D Organs for Haptic Surgical Simulators", Proceedings of the Medicine Meets Virtual Reality Conference, MMVR '2002, Newport Beach, California, January 23-26, 2002, IOS Press, pps. 570-572.

[2] Michael Downes, M. Cavusoglu, W. Gantert, L. Way, F. Tendick, "Virtual Environments for Training Critical Skills in Laparoscopic Surgery", Medicine Meets Virtual Reality 1998, San Deigo, California, January 28-31, 1998, IOS Press, pps. 316-322. [3] Peter Oppenheimer, S. Weghorst, L. Williams, A. Ali, J. Cain, M. MacFarlane, M. Sinanan, "Laparoscopic Surgical Simulator and Port Placement", Medicine Meets Virtual Reality 2000, Newport Beach, California, January 20-24, 2000, IOS Press, 2000, pps. 233-235. [4] Lennart Thurfjell, A. Lundin, J. McLaughlin, "A Medical Platform for the Simulation of Surgical Procedures", Medicine Meets Virtual Reality 2001, Newport Beach, California, January 23-27, 2001, IOS Press, 2001, pps. 509-514. [5] Goran Rolfsson, A. Nordgren, S. Bindzau, J. Hagstrom, J, McLaughlin, L. Thurfjell, "Training and Assessment of Laparoscopic Skills using a Haptic Simulator", Medicine Meets Virtual Reality 2002, Newport Beach, California, January 24-26, 2002, IOS Press, 2002, pps. 409-411.