Design of Intelligent Robotics. René van de Molengraft December, 6th, 2010

Similar documents
Tech United Eindhoven Team Description 2015

Prof. Dr. Raul Rojas FU Berlin. Learning and Control for Autonomous Robots

Participating in Autonomous Robot Competitions: Experiences from a Robot Soccer Team

Team Description for RoboCup 2013 in Eindhoven, the Netherlands

Industrial Vision Days 2012 Making Cameras Smarter: FPGA Based Image Pre-processing Unleashed

Obstacle Avoidance Design for Humanoid Robot Based on Four Infrared Sensors

Dutch Nao Team. Team Description for Robocup Mexico City, Mexico January 11, 2012

Dutch Nao Team. Team Description for Robocup Mexico City, Mexico

Internet of Things and Cloud Computing

3D Vision An enabling Technology for Advanced Driver Assistance and Autonomous Offroad Driving

Rules for the IEEE Very Small Competition Version 1.0

The RoboCup Soccer Simulator

Cooperation Proposal between IUB Robotics and BioART at Imperial College

Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia

Rhoban Football Club Team Description Paper

Tech United 2015 Team Description Paper

Entwicklung und Testen von Robotischen Anwendungen mit MATLAB und Simulink Maximilian Apfelbeck, MathWorks

2013 International Symposium on Green Manufacturing and Applications Honolulu, Hawaii

RoboCup Returns to the US at Georgia Tech!

Sensing, monitoring and actuating on the UNderwater world through a federated Research InfraStructure Extending the Future Internet SUNRISE

School of Computer Science

A very short story about autonomous robots

EDROM Humanoid Kid Size 2014

RoboCup Advanced 3D Monitor

Embedded Distributed Vision System for Humanoid Soccer Robot

Resilience / Expertise and technology

Limitations of Human Vision. What is computer vision? What is computer vision (cont d)?

Intelligent Flexible Automation

Embedded systems in the Masters education at KTH

Challenges for the European Automotive Software Industry

DELIVERABLE D1.3 SRS Initial Knowledge-base and SRS hardware, software communication, and intelligence specification

CROPS: Intelligent sensing and manipulation for sustainable production and harvesting of high valued crops, clever robots for crops.

How To Get A Computer Engineering Degree

KEY KNOWLEDGE MANAGEMENT TECHNOLOGIES IN THE INTELLIGENCE ENTERPRISE

Project Development Plan

A Cognitive Approach to Vision for a Mobile Robot

Center for Dynamic Data Analytics (CDDA) An NSF Supported Industry / University Cooperative Research Center (I/UCRC) Vision and Mission

Exergaming: Video Games as a form of Exercise

Force and Visual Control for Safe Human Robot Interaction

ASSOCIATE IN ARTS DEGREE-60 UNITS

Zeppy: The Project. Jaldert Rombouts, Tessa Verhoef Matthijs Zwinderman, Tijs Zwinkels. Supervisor: Tijn van der Zant

Software Development Engineer Management Protection & Access Group

GLOVE-BASED GESTURE RECOGNITION SYSTEM

Feasibility of an Augmented Reality-Based Approach to Driving Simulation

From Big Data to Smart Data Thomas Hahn

CS 6795 Introduction to Cognitive Science Spring 2012 Homework Assignment 3

Soccer Offensive Strategies

COMP 590: Artificial Intelligence

Definitions. A [non-living] physical agent that performs tasks by manipulating the physical world. Categories of robots

How cloud-based systems and machine-driven big data can contribute to the development of autonomous vehicles

Sensor Fusion Mobile Platform Challenges and Future Directions Jim Steele VP of Engineering, Sensor Platforms, Inc.

Mobile Robot FastSLAM with Xbox Kinect

Computer Science A.A. Degree, Certificate of Achievement & Department Certificate Programs

Digital Image Increase

ER-Force Team Description Paper for RoboCup 2011

Naval Postgraduate School Department of Computer Science Graduation Checklist for MSCS Degree 6203P Subspecialty Code (Revised: Fall AY14)

Unit 1: INTRODUCTION TO ADVANCED ROBOTIC DESIGN & ENGINEERING

An Autonomous Orchard Spraying System: Mission Planning and Control

Robotic Apple Harvesting in Washington State

Specific Targeted Research Project IST call 6 FP IST-6. Project Reference Number: FP

Elements of robot assisted test systems

Distributed Sensing for Cooperative Robotics

Praktikum "Mobile Roboter" mit Simulation und Telerobotik-Zugang (TELEBOTS)

I. INTRODUCTION

FC Portugal D Simulation Team Description Paper

Embedded Vision on FPGAs The MathWorks, Inc. 1

SYSTEMS, CONTROL AND MECHATRONICS

CHAPTER 1 INTRODUCTION

Sensors for plastic manufacturing Solutions in partnership from a single source

Applications > Robotics research and education > Assistant robot at home > Surveillance > Tele-presence > Entertainment/Education > Cleaning

3D Vision An enabling Technology for Advanced Driver Assistance and Autonomous Offroad Driving

Bernie Velivis President, Performax Inc

NaoTH Software Architecture for an Autonomous Agent

Software Development Workflow in Robotics

A Decision Support System for the Professional Soccer Referee in Time-Sensitive Operations

Virtual Environments - Basics -

PrioVR Production Plan:

DEOS. Deutsche Orbitale Servicing Mission. The In-flight Technology Demonstration of Germany s Robotics Approach to Service Satellites

What s Left in E11? Technical Writing E11 Final Report

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON

Programa ROBOT CA ICARSC :00 09:00 10:00 11:00 12:00 13:00 Lunch 14:00 15:00 16:00 17:00 18:00 19:00 Dinner 20:00 21:00 22:00 23:00

Product Characteristics Page 2. Management & Administration Page 2. Real-Time Detections & Alerts Page 4. Video Search Page 6

Interactive Motion Simulators

Information Technology Career Field Pathways and Course Structure

Artificial Intelligence and Politecnico di Milano. Presented by Matteo Matteucci

Defending against modern cyber threats

Discussion 2 Android science. Appearance or behavior

Digital Position Control for Analog Servos

IBX Business Network Platform Information Security Controls Document Classification [Public]

Amit Moran, Gila Kamhi, Artyom Popov, Raphaël Groscot Perceptual Computing - Advanced Technologies Israel

Simulation-based traffic management for autonomous and connected vehicles

Guideline for stresstest Page 1 of 6. Stress test

Software Engineering. Objectives. Designing, building and maintaining large software systems

Emerging behavior of autonomous agents

Requirements Analysis Concepts & Principles. Instructor: Dr. Jerry Gao

School of Computer Science

Internet based manipulator telepresence

RiMONITOR. Monitoring Software. for RIEGL VZ-Line Laser Scanners. Ri Software. visit our website Preliminary Data Sheet

Learning tasks from observation and practice

Transcription:

Design of Intelligent Robotics René van de Molengraft December, 6th, 2010

Theme Health: Care and Cure 11-12-2009 PAGE 2

Mission Help elderly people to stay in their homes Improve quality of surgery for surgeon and patient 11-12-2009 PAGE 3

Research challenges Learning Low-level: 3D-sensing, world modeling, grasping, locomotion High-level: cognition, planning, coordination of multiple robots Approach Mixed Model/Data-based Use priors 11-12-2009 PAGE 4

Robocup@Home 11-12-2009 PAGE 5

RoboCup use cases Midsize league soccer Scenario: structured, but highly dynamic Low-level: world modeling, skills High-level: strategy, coordination @Home league Scenario: static, but highly unstructured Low-level: 3D-sensing, object recognition, grasping High-level: cognition, learning 11-12-2009 PAGE 6

RoboEarth Project Four-year funding from European Commission (FP7) Starting date: December 1st, 2009 Consortium consisting of: 12-03-2010 PAGE 7

Motion Control Performance 90% feedforward 10% feedback Humans in day2day tasks 90% feedforward learning and memorization 10% feedback sensory feedback 12-03-2010 PAGE 8

Industrial robots Structured environment Same scene, same task No humans 12-03-2010 PAGE 9

Domestic and care robots How to deal with a complex world? Changing scenes Many possible scenarios 12-03-2010 PAGE 10

RoboEarth How to deal with a complex world? Changing scenes Many possible scenarios RoboEarth learning and memorization Share any reusable knowledge between robots World-Wide-Web for and by robots 12-03-2010 PAGE 11

RoboEarth 12-03-2010 PAGE 12

Safety and risks Consistency of data in RoboEarth Who is allowed to sharing what? Use existing protocols (HTTPS) Protect personal data (compare Streetview) Certified users Log and analyse usage Liability in case of malfunction? Autonomous operation Who is responsible? 12-03-2010 PAGE 13

Robocup By the year 2050, develop a team of fully autonomous humanoid robots that can win against the human world soccer champion team Joint development of technology in robotics and artificial intelligence Since 1997

Tech United Founded spring 2005 20 active members 2nd place World Cup 2008/2009/2010

Challenges fully autonomous vision and localisation fast and safe ball-handling (don t clamp!) ball-kick team-play

Design goal design a team of autonomous soccer robots robot is of DH/CS type team is of DH/DS type soccer = strategy + skills

Design criteria robustness performance time-to-next-tournament safety maintenance cost

Constraints FIFA rules additional Robocup rules size, weight, color

Design rules of thumb manage complexity keep it simple hierarchy make choices explicit use models create robustness redundancy

Bottom-up design team robot robot robot

Requirements localisation soccer skills intercept, dribble, kick soccer roles attacker, defender, goalkeeper soccer tactics pass, assist, play system

Identify functions low level (hardware) functions drive kick ball handling sense environment (high) level (sofware) functions localisation skills roles and strategy

System architecture SW SW SW SW HW/SW HW/S HW/SW HW/S HW/SW HW/S HW/SW HW/S W W W W HW H HW H W W HW H W HW H W

Design space exploration which sensors? vision odometry accelerometers laser hardware or software? cpu power sensor fusion

Localization vision number of cameras, type of camera, resolution, omnivision, mirror, construction, acquisition, feature extraction, modelfit, object tracking etc.

Specialists needed Interdisciplinary mechanics electronics software Approach model-based design (simulation and prototyping ) early integration

Our localization design hardware omnivision camera+mirror electronic compass odometry with motor encoders software white-line detection orientation calibration sensor fusion

White-line detection

Evolution and revolution Devbot0 2005 Model 2006 Model 2007 Model 2008 Model 2009 11-12-2009 PAGE 32

How to design a system of systems??

System of systems 5 agents: distributed system agents must be self-reliant minimise interaction/sync maximise cooperation aggressive environment

Towards Istanbul, 2011 April 2011, German Open, Magdeburg July 2011, World Cup, Istanbul Dedicated goal keeper Robustified ball handling Passing during gameplay