Force and Visual Control for Safe Human Robot Interaction

Size: px
Start display at page:

Download "Force and Visual Control for Safe Human Robot Interaction"

Transcription

1 Force and Visual Control for Safe Human Robot Interaction Bruno SICILIANO

2 PRISMA Team Force and Visual Control for Safe Human Robot Interaction 2/35 Bruno Siciliano Luigi Villani Vincenzo Lippiello Alberto Finzi Silvia Rossi Franco Cutugno Fanny Ficuciello Fabio Ruggiero Agostino De Santis Rafik Mebarki Antoine Petit Jun Nishiyama Alejandro Donaire Aykut Satıcı Francesca Cordella Mariacarla Staffa Daniela D'Auria Luca Buonocore Jonathan Cacace Diana Serra Mahdi Momeni Andrea Fontanelli Valeria Federico Jonathan van der Meer

3 Aerial Robotics Assistive Robotics Cognitive Control of Robotic Systems Dual-Arm/Hand Manipulation Force Control Human Robot Interaction Inspection Robotics Lightweight Flexible Arms Mobile Dynamic Non-prehensile Manipulation Motion Generation and Biomechanical Analysis for Human Figures Redundant Manipulators Robotic Surgery Technology Sensory-Motor Synergies of Anthropomorphic Hands Service Robotics Visual Servoing Funding of 8.5 M Our Research Portfolio Force and Visual Control for Safe Human Robot Interaction 3/35

4 Outline Force and Visual Control for Safe Human Robot Interaction 4/35 Physical human-robot interaction Force control Impedance control Force control Visual control Position-based visual servoing Pose estimation using vision Interaction control using vision and force Position-based visual impedance control Pose estimation using vision and force Experiments

5 Human Robot Interaction Force and Visual Control for Safe Human Robot Interaction 5/35 Traditional industrial robotics Segmented workspace for machines and humans Intelligent machines working in contact with humans Haptic interfaces and teleoperators Cooperative material handling Power extenders Rehabilitation and physical training Entertainment Human robot interaction (HRI) Cognitive issues [chri]: perception, awareness, mental models Physical issues [phri]: safety, dependability Ethical issues: motivations and critics about HRI, acceptability

6 Physical Human Robot Interaction Force and Visual Control for Safe Human Robot Interaction 6/35 Risks for robots interacting with humans Heavy moving parts and objects transported Sensory data reliability Level of autonomy/unpredictable behaviours Solutions for collaborative human robot operation Design of non-conventional actuators (passive safety) Interaction control (active safety) Dependable algorithms for supervision and planning Fault tolerance Need for quantitative metrics

7 Force Control Force and Visual Control for Safe Human Robot Interaction 7/35 Motion control vs. force control Advanced industrial robotics and service robotics demand for control of interaction between robot manipulator and humans Use of purely motion control strategy is candidate to fail (task planning accuracy) Control of contact force (compliant behaviour) Use of force/torque sensor (interfaced with robot control unit)

8 Taxonomy Force and Visual Control for Safe Human Robot Interaction 8/35 Indirect vs. direct force control Indirect force control: force control via motion control (w/out explicit closure of force feedback loop) Direct force control: force controlled to desired value (w/ closure of force feedback loop)

9 Indirect Force Control Force and Visual Control for Safe Human Robot Interaction 9/35 Impedance control with inner motion control loop Force/torque measurements for linear and decoupled impedance Compliant frame between desired and EE frame (disturbance rejection)

10 Experiments Force and Visual Control for Safe Human Robot Interaction 10/35 Set-up COMAU Smart 3-S robot Open control architecture ATI force/torque sensor 6-DOF spatial impedance surface contact low compliance high damping high compliance low damping high compliance high damping

11 Extension to Cooperating Robots Force and Visual Control for Safe Human Robot Interaction 11/35 Dual-arm set-up 6ax robot 7ax robot peg-in-hole assembly 6-DOF impedance control of absolute motion and internal forces absolute & relative impedance absolute impedance human-object interaction

12 Service Tasks Force and Visual Control for Safe Human Robot Interaction 12/35 ARTS Lab, SSSA Pisa DEXTER cable-actuated robot arm Compliance control Tasks of assisting disabled people

13 Visual Control Force and Visual Control for Safe Human Robot Interaction 13/35 Artificial intelligence vs. automatic control Vision capabilities bring robots nearer to human skills The information that can be extracted form images is very rich and can be used at different levels of a hierarchical architecture Highest level (Artificial Intelligence) Visual information used to understand the world and decide how to act Bandwidth Data complexity Lowest level (Automatic Control) Visual measurements used in the control law Visual servoing

14 Taxonomy Force and Visual Control for Safe Human Robot Interaction 14/35 Direct visual servoing Vision-based control Robot Visual feedback Camera 100 Hz Indirect visual servoing Vision-based control Motion control Robot Visual feedback 20 Hz Camera Joint feedback 100 Hz dynamic look-and-move

15 Indirect Visual Servoing Force and Visual Control for Safe Human Robot Interaction 15/35 Vision system BUS Computer Estimated pose 3D object MOVE Control unit

16 Position-based (3D) visual servoing scheme Position-based Visual Servoing (PBVS) Force and Visual Control for Safe Human Robot Interaction 16/35 Desired pose Pose control Robot + motion control Camera Features extraction Pose estimation Calibration dependent

17 PBVS Force and Visual Control for Safe Human Robot Interaction 17/35 Pose control and pose estimation Calibrated cameras Target objects of known geometry

18 Pose Estimation Force and Visual Control for Safe Human Robot Interaction 18/35 Reconstruction of object pose from observed workspace Selection of image regions Observed workspace Image acquisition Image region segmentation Image features extraction Pose reconstruction

19 Dynamic Image Features Force and Visual Control for Safe Human Robot Interaction 19/35 Pose estimation with dynamic image features selection Extended Kalman Filter (EKF) based on approximate object models

20 EKF Force and Visual Control for Safe Human Robot Interaction 20/35 Extended Kalman Filter State-space model of the object motion = object pose = input disturbance Output equation = image features parameters = measurement noise Jacobian of the output equation ~ image Jacobian

21 Pose Reconstruction Force and Visual Control for Safe Human Robot Interaction 21/35 Dynamic mode (interposing parts) A single BSP tree is generated online, describing all the objects with respect to a common reference frame For each camera, the visit algorithm is applied to the BSP tree A Kalman filter is used for each object

22 Preselection Algorithm Force and Visual Control for Safe Human Robot Interaction 22/35 ~ ~ Out of sight The preselection algorithm estimates the position of the projections of the object visible corners on the image planes of each camera

23 Selection Algorithm Force and Visual Control for Safe Human Robot Interaction 23/35 A selection algorithm based on suitable quality indexes is employed to find the (sub)optimal set of (6 to 8) feature points Some quality indexes for the cost function Spatial distribution ( avoiding points concentration) Angular distribution ( avoiding alignments) Camera distribution ( triangulation) Anti-chattering ( estimate noise reduction) Extraction reliability ( robustness)

24 Features Extraction Force and Visual Control for Safe Human Robot Interaction 24/35 Out of sight extracted corners

25 Visual Servoing Architecture Force and Visual Control for Safe Human Robot Interaction 25/35 COMAU C3G 9000 open Robot CPU Servo CPU Power amplifiers Robot COMAU SMART 3S FOLLOWER Robot COMAU SMART 3S LEADER (PDL2) BUS VME User interface modules Board BIT 3 Vision PC (VESPRO) Board BIT 3 BUS AT Control PC RS232 Vision PC BUS AT MATROX GENESIS MATROX GENESIS SONY XC 8500 CE SONY XC 8500 CE Control PC (RePLiCS)

26 Experiments Force and Visual Control for Safe Human Robot Interaction 26/35 FOLLOWER LEADER L-Camera Object R-Camera

27 Extension to Grasping Force and Visual Control for Safe Human Robot Interaction 27/35 Visually guided grasping Object in unstructured environment Visual servoing Tracking of object motion Good reaction to uncertainties

28 Interaction Control Force and Visual Control for Safe Human Robot Interaction 28/35 Interaction control using vision and force Vision provides global information on surrounding environment to be used for motion planning and obstacle avoidance Force allows adjusting robot motion so that local constraints imposed by environment are satisfied

29 Force and Visual Control Force and Visual Control for Safe Human Robot Interaction 29/35 DLR KUKA robot with force sensor and camera embedded in the gripper Integration of vision and force Visual feedback in gross motion Force feedback in fine motion

30 Control Strategy Force and Visual Control for Safe Human Robot Interaction 30/35 Problem Control interaction of a robot manipulator with a rigid object of known geometry but unknown position and orientation Solution When robot is far from object Position-based visual servoing is adopted The relative pose of the robot with respect to the object is estimated recursively using only vision When robot is in contact with object Any kind of interaction control strategy can be adopted (impedance control, parallel force/position control) The relative pose of the robot with respect to the object is estimated recursively using vision, force and joint position measurements

31 Visual Impedance Force and Visual Control for Safe Human Robot Interaction 31/35 Position-based visual impedance servoing Impedance Force feedback

32 Pose Estimation Using Vision and Force Force and Visual Control for Safe Human Robot Interaction 32/35 Modified EKF State-space model unchanged Modified output equation (when ) Modified Jacobian

33 Experiments Force and Visual Control for Safe Human Robot Interaction 33/35 Pose estimation errors X vision vision & force

34 Conclusion Force and Visual Control for Safe Human Robot Interaction 34/35 Interaction control of robot manipulators Indirect and direct force control Position-based visual servoing Position-based visual impedance control Current and future work Interaction control in unstructured environments (presence of humans) Integration of new sensors (proximity sensors, joint torque sensors, ) Extension to dynamic manipulation (nonprehensile, deformable objects)

35 Force and Visual Control for Safe Human Robot Interaction 35/35 Thank You very much indeed for Your kind attention Questions?

Véronique PERDEREAU ISIR UPMC 6 mars 2013

Véronique PERDEREAU ISIR UPMC 6 mars 2013 Véronique PERDEREAU ISIR UPMC mars 2013 Conventional methods applied to rehabilitation robotics Véronique Perdereau 2 Reference Robot force control by Bruno Siciliano & Luigi Villani Kluwer Academic Publishers

More information

Limitations of Human Vision. What is computer vision? What is computer vision (cont d)?

Limitations of Human Vision. What is computer vision? What is computer vision (cont d)? What is computer vision? Limitations of Human Vision Slide 1 Computer vision (image understanding) is a discipline that studies how to reconstruct, interpret and understand a 3D scene from its 2D images

More information

Force/position control of a robotic system for transcranial magnetic stimulation

Force/position control of a robotic system for transcranial magnetic stimulation Force/position control of a robotic system for transcranial magnetic stimulation W.N. Wan Zakaria School of Mechanical and System Engineering Newcastle University Abstract To develop a force control scheme

More information

Visual Servoing Methodology for Selective Tree Pruning by Human-Robot Collaborative System

Visual Servoing Methodology for Selective Tree Pruning by Human-Robot Collaborative System Ref: C0287 Visual Servoing Methodology for Selective Tree Pruning by Human-Robot Collaborative System Avital Bechar, Victor Bloch, Roee Finkelshtain, Sivan Levi, Aharon Hoffman, Haim Egozi and Ze ev Schmilovitch,

More information

Sensory-motor control scheme based on Kohonen Maps and AVITE model

Sensory-motor control scheme based on Kohonen Maps and AVITE model Sensory-motor control scheme based on Kohonen Maps and AVITE model Juan L. Pedreño-Molina, Antonio Guerrero-González, Oscar A. Florez-Giraldo, J. Molina-Vilaplana Technical University of Cartagena Department

More information

Graduate Co-op Students Information Manual. Department of Computer Science. Faculty of Science. University of Regina

Graduate Co-op Students Information Manual. Department of Computer Science. Faculty of Science. University of Regina Graduate Co-op Students Information Manual Department of Computer Science Faculty of Science University of Regina 2014 1 Table of Contents 1. Department Description..3 2. Program Requirements and Procedures

More information

Epipolar Geometry and Visual Servoing

Epipolar Geometry and Visual Servoing Epipolar Geometry and Visual Servoing Domenico Prattichizzo joint with with Gian Luca Mariottini and Jacopo Piazzi www.dii.unisi.it/prattichizzo Robotics & Systems Lab University of Siena, Italy Scuoladi

More information

Human Motion Mapping to a Robot Arm with Redundancy Resolution

Human Motion Mapping to a Robot Arm with Redundancy Resolution Human Motion Mapping to a Robot Arm with Redundancy Resolution F. Ficuciello, A. Romano, V. Lippiello, L. Villani and B. Siciliano Abstract In this paper the problem of mapping human arm motion to an anthropomorphic

More information

An inertial haptic interface for robotic applications

An inertial haptic interface for robotic applications An inertial haptic interface for robotic applications Students: Andrea Cirillo Pasquale Cirillo Advisor: Ing. Salvatore Pirozzi Altera Innovate Italy Design Contest 2012 Objective Build a Low Cost Interface

More information

FUNDAMENTALS OF ROBOTICS

FUNDAMENTALS OF ROBOTICS FUNDAMENTALS OF ROBOTICS Lab exercise Stäubli AULINAS Josep (u1043469) GARCIA Frederic (u1038431) Introduction The aim of this tutorial is to give a brief overview on the Stäubli Robot System describing

More information

Robot Sensors. Outline. The Robot Structure. Robots and Sensors. Henrik I Christensen

Robot Sensors. Outline. The Robot Structure. Robots and Sensors. Henrik I Christensen Robot Sensors Henrik I Christensen Robotics & Intelligent Machines @ GT Georgia Institute of Technology, Atlanta, GA 30332-0760 hic@cc.gatech.edu Henrik I Christensen (RIM@GT) Sensors 1 / 38 Outline 1

More information

Design-Simulation-Optimization Package for a Generic 6-DOF Manipulator with a Spherical Wrist

Design-Simulation-Optimization Package for a Generic 6-DOF Manipulator with a Spherical Wrist Design-Simulation-Optimization Package for a Generic 6-DOF Manipulator with a Spherical Wrist MHER GRIGORIAN, TAREK SOBH Department of Computer Science and Engineering, U. of Bridgeport, USA ABSTRACT Robot

More information

Artificial Intelligence and Robotics @ Politecnico di Milano. Presented by Matteo Matteucci

Artificial Intelligence and Robotics @ Politecnico di Milano. Presented by Matteo Matteucci 1 Artificial Intelligence and Robotics @ Politecnico di Milano Presented by Matteo Matteucci What is Artificial Intelligence «The field of theory & development of computer systems able to perform tasks

More information

Industrial Robotics. Training Objective

Industrial Robotics. Training Objective Training Objective After watching the program and reviewing this printed material, the viewer will learn the basics of industrial robot technology and how robots are used in a variety of manufacturing

More information

Internet based manipulator telepresence

Internet based manipulator telepresence Internet based manipulator telepresence T ten Kate, P Zizola, B Driessen, K van Woerden TNO Institute of Applied Physics, Stieltjesweg 1, 2628 CK DELFT, The NETHERLANDS {tenkate, zizola, driessen, vwoerden}@tpd.tno.nl

More information

Robotic Apple Harvesting in Washington State

Robotic Apple Harvesting in Washington State Robotic Apple Harvesting in Washington State Joe Davidson b & Abhisesh Silwal a IEEE Agricultural Robotics & Automation Webinar December 15 th, 2015 a Center for Precision and Automated Agricultural Systems

More information

Scooter, 3 wheeled cobot North Western University. PERCRO Exoskeleton

Scooter, 3 wheeled cobot North Western University. PERCRO Exoskeleton Scooter, 3 wheeled cobot North Western University A cobot is a robot for direct physical interaction with a human operator, within a shared workspace PERCRO Exoskeleton Unicycle cobot the simplest possible

More information

- 2.12 Lecture Notes - H. Harry Asada Ford Professor of Mechanical Engineering

- 2.12 Lecture Notes - H. Harry Asada Ford Professor of Mechanical Engineering - 2.12 Lecture Notes - H. Harry Asada Ford Professor of Mechanical Engineering Fall 2005 1 Chapter 1 Introduction Many definitions have been suggested for what we call a robot. The word may conjure up

More information

A Cognitive Approach to Vision for a Mobile Robot

A Cognitive Approach to Vision for a Mobile Robot A Cognitive Approach to Vision for a Mobile Robot D. Paul Benjamin Christopher Funk Pace University, 1 Pace Plaza, New York, New York 10038, 212-346-1012 benjamin@pace.edu Damian Lyons Fordham University,

More information

Integration Services

Integration Services Integration Services EXPERIENCED TEAM ADVANCED TECHNOLOGY PROVEN SOLUTIONS Integrations for large scale metrology applications Metris metrology to streamline your CAPABILITIES Advanced systems design Engineering

More information

THE problem of visual servoing guiding a robot using

THE problem of visual servoing guiding a robot using 582 IEEE TRANSACTIONS ON ROBOTICS AND AUTOMATION, VOL. 13, NO. 4, AUGUST 1997 A Modular System for Robust Positioning Using Feedback from Stereo Vision Gregory D. Hager, Member, IEEE Abstract This paper

More information

UOM Robotics and Industrial Automation Laboratory

UOM Robotics and Industrial Automation Laboratory UOM Robotics and Industrial Automation Laboratory Department of Industrial and Manufacturing Engineering, RIAL Mission o to be a Centre of Excellence in Malta for research, development, teaching and outreach

More information

Europass Curriculum Vitae

Europass Curriculum Vitae Europass Curriculum Vitae Personal information Surname(s) / First name(s) Address(es) 1700 Benjamin Franklin parkway 19103 Philadelphia Telephone(s) +12155000910 USA 3296352044 Italian +46765830733 Swedish

More information

Pneumatically Driven Robot System with Force Perception for Minimally Invasive Surgery

Pneumatically Driven Robot System with Force Perception for Minimally Invasive Surgery Pneumatically Driven Robot System with Force Perception for Minimally Invasive Surgery Tokyo Institute of Technology Kotaro Tadano Daisuke Haraguchi Kenji Kawashima Research Overview on Surgical Robots

More information

Robot coined by Karel Capek in a 1921 science-fiction Czech play

Robot coined by Karel Capek in a 1921 science-fiction Czech play Robotics Robot coined by Karel Capek in a 1921 science-fiction Czech play Definition: A robot is a reprogrammable, multifunctional manipulator designed to move material, parts, tools, or specialized devices

More information

CE801: Intelligent Systems and Robotics Lecture 3: Actuators and Localisation. Prof. Dr. Hani Hagras

CE801: Intelligent Systems and Robotics Lecture 3: Actuators and Localisation. Prof. Dr. Hani Hagras 1 CE801: Intelligent Systems and Robotics Lecture 3: Actuators and Localisation Prof. Dr. Hani Hagras Robot Locomotion Robots might want to move in water, in the air, on land, in space.. 2 Most of the

More information

Taking Inverse Graphics Seriously

Taking Inverse Graphics Seriously CSC2535: 2013 Advanced Machine Learning Taking Inverse Graphics Seriously Geoffrey Hinton Department of Computer Science University of Toronto The representation used by the neural nets that work best

More information

RealTime Tracking Meets Online Grasp Planning

RealTime Tracking Meets Online Grasp Planning RealTime Tracking Meets Online Grasp Planning Danica Kragić, Computer Vision and Active Perception Numerical Analysis and Computer Science Royal Institute of Technology SE 100 44 Stockholm, Sweden Andrew

More information

Fostering Students' Spatial Skills through Practice in Operating and Programming Robotic Cells

Fostering Students' Spatial Skills through Practice in Operating and Programming Robotic Cells Fostering Students' Spatial Skills through Practice in Operating and Programming Robotic Cells Igor M. Verner 1, Sergei Gamer 2, Avraham Shtub 2 1 Dept. of Education in Technology and Science, Technion

More information

APPLICATION DESIGN ISSUES

APPLICATION DESIGN ISSUES 10 APPLICATION DESIGN ISSUES In this chapter we discuss some important issues related to the design and the development of complex real-time applications requiring sensory acquisition, control, and actuation

More information

Industrial Vision Days 2012 Making Cameras Smarter: FPGA Based Image Pre-processing Unleashed

Industrial Vision Days 2012 Making Cameras Smarter: FPGA Based Image Pre-processing Unleashed Industrial Vision Days 2012 Making Cameras Smarter: FPGA Based Image Pre-processing Unleashed Announcement of Partnership Seite: 3 High Quality Digital Cameras and Vision Sensors Visual FPGA Programming

More information

Robotics. Chapter 25. Chapter 25 1

Robotics. Chapter 25. Chapter 25 1 Robotics Chapter 25 Chapter 25 1 Outline Robots, Effectors, and Sensors Localization and Mapping Motion Planning Motor Control Chapter 25 2 Mobile Robots Chapter 25 3 Manipulators P R R R R R Configuration

More information

Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia

Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia As of today, the issue of Big Data processing is still of high importance. Data flow is increasingly growing. Processing methods

More information

Digital Image Increase

Digital Image Increase Exploiting redundancy for reliable aerial computer vision 1 Digital Image Increase 2 Images Worldwide 3 Terrestrial Image Acquisition 4 Aerial Photogrammetry 5 New Sensor Platforms Towards Fully Automatic

More information

High Accuracy Articulated Robots with CNC Control Systems

High Accuracy Articulated Robots with CNC Control Systems Copyright 2012 SAE International 2013-01-2292 High Accuracy Articulated Robots with CNC Control Systems Bradley Saund, Russell DeVlieg Electroimpact Inc. ABSTRACT A robotic arm manipulator is often an

More information

INSTRUCTOR WORKBOOK Quanser Robotics Package for Education for MATLAB /Simulink Users

INSTRUCTOR WORKBOOK Quanser Robotics Package for Education for MATLAB /Simulink Users INSTRUCTOR WORKBOOK for MATLAB /Simulink Users Developed by: Amir Haddadi, Ph.D., Quanser Peter Martin, M.A.SC., Quanser Quanser educational solutions are powered by: CAPTIVATE. MOTIVATE. GRADUATE. PREFACE

More information

MoveInspect HF HR. 3D measurement of dynamic processes MEASURE THE ADVANTAGE. MoveInspect TECHNOLOGY

MoveInspect HF HR. 3D measurement of dynamic processes MEASURE THE ADVANTAGE. MoveInspect TECHNOLOGY MoveInspect HF HR 3D measurement of dynamic processes MEASURE THE ADVANTAGE MoveInspect TECHNOLOGY MoveInspect HF HR 3D measurement of dynamic processes Areas of application In order to sustain its own

More information

Professional Organization Checklist for the Computer Science Curriculum Updates. Association of Computing Machinery Computing Curricula 2008

Professional Organization Checklist for the Computer Science Curriculum Updates. Association of Computing Machinery Computing Curricula 2008 Professional Organization Checklist for the Computer Science Curriculum Updates Association of Computing Machinery Computing Curricula 2008 The curriculum guidelines can be found in Appendix C of the report

More information

Tracking and integrated navigation Konrad Schindler

Tracking and integrated navigation Konrad Schindler Tracking and integrated navigation Konrad Schindler Institute of Geodesy and Photogrammetry Tracking Navigation needs predictions for dynamic objects estimate trajectories in 3D world coordinates and extrapolate

More information

Tracking in flussi video 3D. Ing. Samuele Salti

Tracking in flussi video 3D. Ing. Samuele Salti Seminari XXIII ciclo Tracking in flussi video 3D Ing. Tutors: Prof. Tullio Salmon Cinotti Prof. Luigi Di Stefano The Tracking problem Detection Object model, Track initiation, Track termination, Tracking

More information

Design of Intelligent Robotics. René van de Molengraft December, 6th, 2010

Design of Intelligent Robotics. René van de Molengraft December, 6th, 2010 Design of Intelligent Robotics René van de Molengraft December, 6th, 2010 Theme Health: Care and Cure 11-12-2009 PAGE 2 Mission Help elderly people to stay in their homes Improve quality of surgery for

More information

CIM Computer Integrated Manufacturing

CIM Computer Integrated Manufacturing INDEX CIM IN BASIC CONFIGURATION CIM IN ADVANCED CONFIGURATION CIM IN COMPLETE CONFIGURATION DL CIM A DL CIM B DL CIM C DL CIM C DL CIM B DL CIM A Computer Integrated Manufacturing (CIM) is a method of

More information

Advances in the Design of the icub Humanoid Robot: Force Control and Tactile Sensing

Advances in the Design of the icub Humanoid Robot: Force Control and Tactile Sensing Advances in the Design of the icub Humanoid Robot: Force Control and Tactile Sensing Bled, Slovenia October 26 th, 2011 Giorgio Metta, Ugo Pattacini, Andrea Del Prete, Marco Randazzo, Alberto Parmiggiani,

More information

Medical Robotics. Control Modalities

Medical Robotics. Control Modalities Università di Roma La Sapienza Medical Robotics Control Modalities The Hands-On Acrobot Robot Marilena Vendittelli Dipartimento di Ingegneria Informatica, Automatica e Gestionale Control modalities differ

More information

Robotic motion planning for 8- DOF motion stage

Robotic motion planning for 8- DOF motion stage Robotic motion planning for 8- DOF motion stage 12 November Mark Geelen Simon Jansen Alten Mechatronics www.alten.nl rosindustrial@alten.nl Introduction Introduction Alten FEI Motion planning MoveIt! Proof

More information

Performing Assembly Task Under Constraints Using 3D Sensor-Based Control

Performing Assembly Task Under Constraints Using 3D Sensor-Based Control Performing Assembly Task Under Constraints Using 3D Sensor-Based Control Sylvain Vandernotte 1, Abdelhamid Chriette 2, Adolfo Suarez Roos 3, and Philippe Martinet 2 1 IRT Jules Verne, Chemin du Chaffaut,

More information

Advantages of Auto-tuning for Servo-motors

Advantages of Auto-tuning for Servo-motors Advantages of for Servo-motors Executive summary The same way that 2 years ago computer science introduced plug and play, where devices would selfadjust to existing system hardware, industrial motion control

More information

Degree programme in Automation Engineering

Degree programme in Automation Engineering Degree programme in Automation Engineering Course descriptions of the courses for exchange students, 2014-2015 Autumn 2014 21727630 Application Programming Students know the basis of systems application

More information

Diagnosis and Fault-Tolerant Control

Diagnosis and Fault-Tolerant Control Mogens Blanke Michel Kinnaert Jan Lunze Marcel Staroswiecki Diagnosis and Fault-Tolerant Control With contributions by Jochen Schroder With 228 Figures Springer 1. Introduction to diagnosis and fault-tolerant

More information

Robot Perception Continued

Robot Perception Continued Robot Perception Continued 1 Visual Perception Visual Odometry Reconstruction Recognition CS 685 11 Range Sensing strategies Active range sensors Ultrasound Laser range sensor Slides adopted from Siegwart

More information

Intelligent Flexible Automation

Intelligent Flexible Automation Intelligent Flexible Automation David Peters Chief Executive Officer Universal Robotics February 20-22, 2013 Orlando World Marriott Center Orlando, Florida USA Trends in AI and Computing Power Convergence

More information

Online Tuning of Artificial Neural Networks for Induction Motor Control

Online Tuning of Artificial Neural Networks for Induction Motor Control Online Tuning of Artificial Neural Networks for Induction Motor Control A THESIS Submitted by RAMA KRISHNA MAYIRI (M060156EE) In partial fulfillment of the requirements for the award of the Degree of MASTER

More information

Masters in Information Technology

Masters in Information Technology Computer - Information Technology MSc & MPhil - 2015/6 - July 2015 Masters in Information Technology Programme Requirements Taught Element, and PG Diploma in Information Technology: 120 credits: IS5101

More information

Constraint satisfaction and global optimization in robotics

Constraint satisfaction and global optimization in robotics Constraint satisfaction and global optimization in robotics Arnold Neumaier Universität Wien and Jean-Pierre Merlet INRIA Sophia Antipolis 1 The design, validation, and use of robots poses a number of

More information

Introduction to Robotics Analysis, systems, Applications Saeed B. Niku

Introduction to Robotics Analysis, systems, Applications Saeed B. Niku Saeed B. Niku 1. Introduction Fig. 1.1 (a) A Kuhnezug truck-mounted crane Reprinted with permission from Kuhnezug Fordertechnik GmbH. Fig. 1.1 (b) Fanuc S-500 robots performing seam-sealing on a truck.

More information

A Prototype For Eye-Gaze Corrected

A Prototype For Eye-Gaze Corrected A Prototype For Eye-Gaze Corrected Video Chat on Graphics Hardware Maarten Dumont, Steven Maesen, Sammy Rogmans and Philippe Bekaert Introduction Traditional webcam video chat: No eye contact. No extensive

More information

Vibrations can have an adverse effect on the accuracy of the end effector of a

Vibrations can have an adverse effect on the accuracy of the end effector of a EGR 315 Design Project - 1 - Executive Summary Vibrations can have an adverse effect on the accuracy of the end effector of a multiple-link robot. The ability of the machine to move to precise points scattered

More information

Leghe a memoria di forma come tecnologia di attuazione per la biorobotica

Leghe a memoria di forma come tecnologia di attuazione per la biorobotica Leghe a memoria di forma come tecnologia di attuazione per la biorobotica Milano, 7 novembre, 2013 Maurizio Follador maurizio.follador@sssup.it Advanced Education, Frontier Interdisciplinary Research and

More information

A Robust And Efficient Face Tracking Kernel For Driver Inattention Monitoring System

A Robust And Efficient Face Tracking Kernel For Driver Inattention Monitoring System ICT 7 th, 2010, Tokyo A Robust And Efficient Face Tracking Kernel For Driver Inattention Monitoring System Yanchao Dong, Zhencheng Hu, Keiichi Uchimura and Nobuki Murayama Kumamoto University, Japan Kumamoto,

More information

Microcontrollers, Actuators and Sensors in Mobile Robots

Microcontrollers, Actuators and Sensors in Mobile Robots SISY 2006 4 th Serbian-Hungarian Joint Symposium on Intelligent Systems Microcontrollers, Actuators and Sensors in Mobile Robots István Matijevics Polytechnical Engineering College, Subotica, Serbia mistvan@vts.su.ac.yu

More information

UAV Pose Estimation using POSIT Algorithm

UAV Pose Estimation using POSIT Algorithm International Journal of Digital ontent Technology and its Applications. Volume 5, Number 4, April 211 UAV Pose Estimation using POSIT Algorithm *1 M. He, 2. Ratanasawanya, 3 M. Mehrandezh, 4 R. Paranjape

More information

Robotics. Lecture 3: Sensors. See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information.

Robotics. Lecture 3: Sensors. See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Robotics Lecture 3: Sensors See course website http://www.doc.ic.ac.uk/~ajd/robotics/ for up to date information. Andrew Davison Department of Computing Imperial College London Review: Locomotion Practical

More information

T-REDSPEED White paper

T-REDSPEED White paper T-REDSPEED White paper Index Index...2 Introduction...3 Specifications...4 Innovation...6 Technology added values...7 Introduction T-REDSPEED is an international patent pending technology for traffic violation

More information

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Thomas Reilly Data Physics Corporation 1741 Technology Drive, Suite 260 San Jose, CA 95110 (408) 216-8440 This paper

More information

Basler. Line Scan Cameras

Basler. Line Scan Cameras Basler Line Scan Cameras High-quality line scan technology meets a cost-effective GigE interface Real color support in a compact housing size Shading correction compensates for difficult lighting conditions

More information

How To Compress Video For Real Time Transmission

How To Compress Video For Real Time Transmission University of Edinburgh College of Science and Engineering School of Informatics Informatics Research Proposal supervised by Dr. Sethu Vijayakumar Optimized bandwidth usage for real-time remote surveillance

More information

White Paper. How Streaming Data Analytics Enables Real-Time Decisions

White Paper. How Streaming Data Analytics Enables Real-Time Decisions White Paper How Streaming Data Analytics Enables Real-Time Decisions Contents Introduction... 1 What Is Streaming Analytics?... 1 How Does SAS Event Stream Processing Work?... 2 Overview...2 Event Stream

More information

Tracking of Small Unmanned Aerial Vehicles

Tracking of Small Unmanned Aerial Vehicles Tracking of Small Unmanned Aerial Vehicles Steven Krukowski Adrien Perkins Aeronautics and Astronautics Stanford University Stanford, CA 94305 Email: spk170@stanford.edu Aeronautics and Astronautics Stanford

More information

Effectiveness of Haptic Feedback in Open Surgery Simulation and Training Systems

Effectiveness of Haptic Feedback in Open Surgery Simulation and Training Systems Effectiveness of Haptic Feedback in Open Surgery Simulation and Training Systems John HU a 1, Chu-Yin CHANG a, Neil TARDELLA a, James ENGLISH b, Janey PRATT b a Energid Technologies Corporation b Massachusetts

More information

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA

A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA A PHOTOGRAMMETRIC APPRAOCH FOR AUTOMATIC TRAFFIC ASSESSMENT USING CONVENTIONAL CCTV CAMERA N. Zarrinpanjeh a, F. Dadrassjavan b, H. Fattahi c * a Islamic Azad University of Qazvin - nzarrin@qiau.ac.ir

More information

What is Visualization? Information Visualization An Overview. Information Visualization. Definitions

What is Visualization? Information Visualization An Overview. Information Visualization. Definitions What is Visualization? Information Visualization An Overview Jonathan I. Maletic, Ph.D. Computer Science Kent State University Visualize/Visualization: To form a mental image or vision of [some

More information

Autonomous Advertising Mobile Robot for Exhibitions, Developed at BMF

Autonomous Advertising Mobile Robot for Exhibitions, Developed at BMF Autonomous Advertising Mobile Robot for Exhibitions, Developed at BMF Kucsera Péter (kucsera.peter@kvk.bmf.hu) Abstract In this article an autonomous advertising mobile robot that has been realized in

More information

Core Curriculum to the Course:

Core Curriculum to the Course: Core Curriculum to the Course: Environmental Science Law Economy for Engineering Accounting for Engineering Production System Planning and Analysis Electric Circuits Logic Circuits Methods for Electric

More information

SOFA an Open Source Framework for Medical Simulation

SOFA an Open Source Framework for Medical Simulation SOFA an Open Source Framework for Medical Simulation J. ALLARD a P.-J. BENSOUSSAN b S. COTIN a H. DELINGETTE b C. DURIEZ b F. FAURE b L. GRISONI b and F. POYER b a CIMIT Sim Group - Harvard Medical School

More information

Design and Implementation of a 4-Bar linkage Gripper

Design and Implementation of a 4-Bar linkage Gripper IOSR Journal of Mechanical and Civil Engineering (IOSR-JMCE) e-issn: 2278-1684,p-ISSN: 2320-334X, Volume 11, Issue 5 Ver. IV (Sep- Oct. 2014), PP 61-66 Design and Implementation of a 4-Bar linkage Gripper

More information

Multisensor Data Fusion and Applications

Multisensor Data Fusion and Applications Multisensor Data Fusion and Applications Pramod K. Varshney Department of Electrical Engineering and Computer Science Syracuse University 121 Link Hall Syracuse, New York 13244 USA E-mail: varshney@syr.edu

More information

CROPS: Intelligent sensing and manipulation for sustainable production and harvesting of high valued crops, clever robots for crops.

CROPS: Intelligent sensing and manipulation for sustainable production and harvesting of high valued crops, clever robots for crops. CROPS GA 246252 www.crops-robots.eu CROPS: Intelligent sensing and manipulation for sustainable production and harvesting of high valued crops, clever robots for crops. The main objective of CROPS is to

More information

Unit 1: INTRODUCTION TO ADVANCED ROBOTIC DESIGN & ENGINEERING

Unit 1: INTRODUCTION TO ADVANCED ROBOTIC DESIGN & ENGINEERING Unit 1: INTRODUCTION TO ADVANCED ROBOTIC DESIGN & ENGINEERING Technological Literacy Review of Robotics I Topics and understand and be able to implement the "design 8.1, 8.2 Technology Through the Ages

More information

Lecture 3: Teleoperation

Lecture 3: Teleoperation ME 328: Medical Robotics Spring 2015 Lecture 3: Teleoperation Allison Okamura Stanford University Announcements 1. I am not Allison. 2. You re a huge class. So, we found a 2nd CA! meet Jeesu Baek jeesu@stanford.edu

More information

Static Environment Recognition Using Omni-camera from a Moving Vehicle

Static Environment Recognition Using Omni-camera from a Moving Vehicle Static Environment Recognition Using Omni-camera from a Moving Vehicle Teruko Yata, Chuck Thorpe Frank Dellaert The Robotics Institute Carnegie Mellon University Pittsburgh, PA 15213 USA College of Computing

More information

FSI Machine Vision Training Programs

FSI Machine Vision Training Programs FSI Machine Vision Training Programs Table of Contents Introduction to Machine Vision (Course # MVC-101) Machine Vision and NeuroCheck overview (Seminar # MVC-102) Machine Vision, EyeVision and EyeSpector

More information

Figure 3.1.2 Cartesian coordinate robot

Figure 3.1.2 Cartesian coordinate robot Introduction to Robotics, H. Harry Asada Chapter Robot Mechanisms A robot is a machine capable of physical motion for interacting with the environment. Physical interactions include manipulation, locomotion,

More information

How To Get A Computer Engineering Degree

How To Get A Computer Engineering Degree COMPUTER ENGINEERING GRADUTE PROGRAM FOR MASTER S DEGREE (With Thesis) PREPARATORY PROGRAM* COME 27 Advanced Object Oriented Programming 5 COME 21 Data Structures and Algorithms COME 22 COME 1 COME 1 COME

More information

Electronic Interface for Pneumatic Grippers Using USB Port

Electronic Interface for Pneumatic Grippers Using USB Port ISBN 978-1-84626-xxx-x Proceedings of 2011 International Conference on Optimization of the Robots and Manipulators (OPTIROB 2011) Sinaia, Romania, 26-28 Mai, 2011, pp. xxx-xxx Electronic Interface for

More information

Dually Fed Permanent Magnet Synchronous Generator Condition Monitoring Using Stator Current

Dually Fed Permanent Magnet Synchronous Generator Condition Monitoring Using Stator Current Summary Dually Fed Permanent Magnet Synchronous Generator Condition Monitoring Using Stator Current Joachim Härsjö, Massimo Bongiorno and Ola Carlson Chalmers University of Technology Energi och Miljö,

More information

INTRODUCTION. Robotics is a relatively young field of modern technology that crosses traditional

INTRODUCTION. Robotics is a relatively young field of modern technology that crosses traditional 1 INTRODUCTION Robotics is a relatively young field of modern technology that crosses traditional engineering boundaries. Understanding the complexity of robots and their applications requires knowledge

More information

LEGO NXT-based Robotic Arm

LEGO NXT-based Robotic Arm Óbuda University e Bulletin Vol. 2, No. 1, 2011 LEGO NXT-based Robotic Arm Ákos Hámori, János Lengyel, Barna Reskó Óbuda University barna.resko@arek.uni-obuda.hu, hamoriakos@gmail.com, polish1987@gmail.com

More information

Development of Simulation Tools Software

Development of Simulation Tools Software Development of Simulation Tools Software Vincent Luboz Department of Biosurgery and Surgical Technology Imperial College London BSc VR Surgical Simulation Software Slide 1 Contents Virtual Reality VR Surgical

More information

POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES

POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES L. Novotny 1, P. Strakos 1, J. Vesely 1, A. Dietmair 2 1 Research Center of Manufacturing Technology, CTU in Prague, Czech Republic 2 SW, Universität

More information

Development and optimization of a hybrid passive/active liner for flow duct applications

Development and optimization of a hybrid passive/active liner for flow duct applications Development and optimization of a hybrid passive/active liner for flow duct applications 1 INTRODUCTION Design of an acoustic liner effective throughout the entire frequency range inherent in aeronautic

More information

Making Machines Understand Facial Motion & Expressions Like Humans Do

Making Machines Understand Facial Motion & Expressions Like Humans Do Making Machines Understand Facial Motion & Expressions Like Humans Do Ana C. Andrés del Valle & Jean-Luc Dugelay Multimedia Communications Dpt. Institut Eurécom 2229 route des Crêtes. BP 193. Sophia Antipolis.

More information

School of Computer Science

School of Computer Science School of Computer Science Head of School Professor S Linton Taught Programmes M.Sc. Advanced Computer Science Artificial Intelligence Computing and Information Technology Information Technology Human

More information

A Remote Maintenance System with the use of Virtual Reality.

A Remote Maintenance System with the use of Virtual Reality. ICAT 2001 December 5-7, Tokyo, JAPAN A Remote Maintenance System with the use of Virtual Reality. Moez BELLAMINE 1), Norihiro ABE 1), Kazuaki TANAKA 1), Hirokazu TAKI 2) 1) Kyushu Institute of Technology,

More information

Definitions. A [non-living] physical agent that performs tasks by manipulating the physical world. Categories of robots

Definitions. A [non-living] physical agent that performs tasks by manipulating the physical world. Categories of robots Definitions A robot is A programmable, multifunction manipulator designed to move material, parts, tools, or specific devices through variable programmed motions for the performance of a variety of tasks.

More information

Research-Grade Research-Grade. Capture

Research-Grade Research-Grade. Capture Research-Grade Research-Grade Motion Motion Capture Capture The System of Choice For Resear systems have earned the reputation as the gold standard for motion capture among research scientists. With unparalleled

More information

User Guide MTD-3. Motion Lab Systems, Inc.

User Guide MTD-3. Motion Lab Systems, Inc. User Guide MTD-3 Motion Lab Systems, Inc. This manual was written by Motion Lab Systems using ComponentOne Doc-To-Help. Updated Tuesday, June 07, 2016 Intended Audience This manual is written to provide

More information

Analecta Vol. 8, No. 2 ISSN 2064-7964

Analecta Vol. 8, No. 2 ISSN 2064-7964 EXPERIMENTAL APPLICATIONS OF ARTIFICIAL NEURAL NETWORKS IN ENGINEERING PROCESSING SYSTEM S. Dadvandipour Institute of Information Engineering, University of Miskolc, Egyetemváros, 3515, Miskolc, Hungary,

More information

Automatic Labeling of Lane Markings for Autonomous Vehicles

Automatic Labeling of Lane Markings for Autonomous Vehicles Automatic Labeling of Lane Markings for Autonomous Vehicles Jeffrey Kiske Stanford University 450 Serra Mall, Stanford, CA 94305 jkiske@stanford.edu 1. Introduction As autonomous vehicles become more popular,

More information

A Reliability Point and Kalman Filter-based Vehicle Tracking Technique

A Reliability Point and Kalman Filter-based Vehicle Tracking Technique A Reliability Point and Kalman Filter-based Vehicle Tracing Technique Soo Siang Teoh and Thomas Bräunl Abstract This paper introduces a technique for tracing the movement of vehicles in consecutive video

More information