Fitness Motion Recognition

Transcription

1 Fitness Motion Recognition with Android Wear Edward Dale Freeletics Edward Dale,

2 Edward Dale,

3 Agenda Define scope Sensors Algorithms Battery Efficiency Edward Dale,

4 Defining the problem scope Segmenting exercise from non-exercise Recognizing which exercise is being performed Counting repetitions Online Edward Dale,

5 Defining the problem scope Segmenting exercise from non-exercise Recognizing which exercise is being performed Counting repetitions Online Edward Dale,

6 Defining the problem scope Segmenting exercise from non-exercise Recognizing which exercise is being performed Counting repetitions Online Edward Dale,

7 Defining the problem scope Segmenting exercise from non-exercise Recognizing which exercise is being performed Counting repetitions! Online Edward Dale,

8 Defining the problem scope Segmenting exercise from non-exercise Recognizing which exercise is being performed Counting repetitions! Online! Edward Dale,

9 Which "Fitness Motion"? Running Swimming Cycling Edward Dale,

10 This "Fitness Motion" Pushups Jumping Jacks Burpees Edward Dale,

11 Pushups Edward Dale,

12 Edward Dale,

13 Pushup Sensors Proximity (Sensor.TYPE_PROXIMITY) Edward Dale,

14 Pushup Sensors Proximity (Sensor.TYPE_PROXIMITY) Rotation (Sensor.TYPE_GAME_ROTATION_VECTOR, Sensor.TYPE_GEOMAGNETIC_ROTATION_VECTOR, Sensor.TYPE_GYROSCOPE, Sensor.TYPE_ROTATION_VECTOR) Edward Dale,

15 Pushup Sensors Proximity (Sensor.TYPE_PROXIMITY) Rotation (Sensor.TYPE_GAME_ROTATION_VECTOR, Sensor.TYPE_GEOMAGNETIC_ROTATION_VECTOR, Sensor.TYPE_GYROSCOPE, Sensor.TYPE_ROTATION_VECTOR) Acceleration (Sensor.TYPE_ACCELEROMETER, Sensor.TYPE_LINEAR_ACCELERATION, Sensor.TYPE_GRAVITY) Edward Dale,

16 Pushup Sensors Proximity (Sensor.TYPE_PROXIMITY) Rotation (Sensor.TYPE_GAME_ROTATION_VECTOR, Sensor.TYPE_GEOMAGNETIC_ROTATION_VECTOR, Sensor.TYPE_GYROSCOPE, Sensor.TYPE_ROTATION_VECTOR) Acceleration (Sensor.TYPE_ACCELEROMETER, Sensor.TYPE_LINEAR_ACCELERATION, Sensor.TYPE_GRAVITY)! Edward Dale,

17 Acceleration Sensors TYPE_ACCELEROMETER uses the accelerometer and only the accelerometer. It returns raw accelerometer events, with minimal or no processing at all. TYPE_LINEAR_ACCELERATION and TYPE_GRAVITY... are "fused" sensors Mathias Agopian on android-developers Always returns 3 components of acceleration vector Edward Dale,

18 Acceleration Vector What to do with acceleration direction? Pushup acceleration happens in primary one direction Ignore acceleration direction and just use magnitude Edward Dale,

19 Edward Dale,

20 Edward Dale,

21 Not so fast Still have to count But there are well-known algorithms for that Google: Online peak detection algorithm Edward Dale,

22 Peakdet A point is considered a maximum peak if it has the maximal value, and was preceded (to the left) by a value lower by DELTA Edward Dale,

23 Edward Dale,

24 Edward Dale,

25 Peakdet Online! Efficient! Sensitive to DELTA parameter " Edward Dale,

26 Battery Efficiency Analyze fewer samples Do less analysis per sample Analyze sample on the phone Choose less power-hungry sensors Watch the Power Optimization for Android talk from day 1 Edward Dale,

27 Battery Efficiency Analyze fewer samples Register for sensor updates with lowest sampling frequency necessary SENSOR_DELAY_NORMAL (5Hz) SENSOR_DELAY_UI (15Hz) SENSOR_DELAY_GAME (50Hz) SENSOR_DELAY_FASTEST (~ Hz) Edward Dale,

28 Battery Efficiency Analyze fewer samples Register for sensor updates with lowest sampling frequency necessary Also possible to suggest your own sampling frequency Just a suggestion to the device Edward Dale,

29 Battery Efficiency Do less analysis per sample Choose an efficient algorithm Peakdet is relatively efficient More efficient than algorithms using derivates Edward Dale,

30 Battery Efficiency Analyze samples on the phone Just use the watch as a wearable sensor that sends data to be analyzed on the phone. Edward Dale,

31 Battery Efficiency Choose Less Power-Hungry Sensors Sensor power drain will differ on different hardware Ask the sensor how much power the sensor uses Sensor.getPower() Edward Dale,

32 Thanks! Edward Dale Freeletics (We're hiring) Edward Dale,

33 Links Walk Detection and Step Counting on Unconstrained Smartphones RecoFit: Using a Wearable Sensor to Find, Recognize, and Count Repetitive Exercises Sample Project Edward Dale,