Limits and Possibilities of Markerless Human Motion Estimation Bodo Rosenhahn Universität Hannover
Motion Capture Wikipedia (MoCap): Approaches for recording and analyzing Human motions
Markerless Motion Capture
Impact Sports Science Geriatrics Orthopedics Animation Surveillance
Basics Texture driven Tracking + optimization Segmentation Correspondences Outdoor Cloth models Pose estimation Statistical learning Output: Pose and joint angles
Outdoor Motion Capture
Priors 3D Mesh Synchronized, calibrated cameras static background
MoCap Everywhere
MoCap Everywhere Challenges: - Moving Cameras - Non-Synchronized Cameras - Tracking Articulated objects - No Model
MoCap Everywhere
Sound-driven Synchronization MoCap Everywhere 11
MoCap Everywhere Cross-correlation 12
Video Hasler et.al. CVPR-09
Video
Prior: Model
Shape and Pose Database Hasler et.al. Eurographics-09
Shape and Pose Database Hasler et.al. Eurographics-09
3D Scans 114 Subjects 34 Poses
Correlations Pose Space Shape Space
Shape and Pose Database
Shape and Pose Database Random Characters
Control Height/Weight weight height
Shape and Pose Database Generate Shapes with specific properties (Female, 65kg)
Train Gradients
Shape and Pose Database Muscle-morphing
Shape and Pose Database Interactive shape editing
Cloth X-Ray Hasler et.al. SMI-09
Image Fitting Accepted: CVPR-10
Monocular Shape and Pose Estimation Input: Flickr-Image + Silhouette Output: Shape, pose & camera calibration
Monocular Shape and Pose Estimation
Example Estimated : 1.89 m, 82 kg Ground truth : 1.93 m, 82 kg
Still Ambiguities remain
Orientation Sensors Z Y F I X Magnetic North Gravity direction Û V W Pons et.al. CVPR-10
Validation Validation with a Database of sequences comprising: - 8 camera views - 4 actors - Variety of motions: cart-wheel, jumping, running - 5 inertial sensors x 5
Video-based (V) vs Hybrid tracker (H) Mean Variance % Large Errors Most of the large tracking errors are corrected with our Hybrid tracker
Topics Basics for Markerless Motion Capture Overcoming Limitations Camera Motions Camera Synchronization Model generation / Missing data estimation Clothed people Stability, Robustness, Speed