Turning smartphones into medical devices:

Transcription

1 Turning smartphones into medical devices: Activity monitoring, experience sampling, and interactive messaging Sean T. Doherty May 8, 2012

2 Outline n Overview of human tracking technologies n Closer look at GPS Accelerometers Smartphones n Beyond activity/travel tracking Smartphone+ case studies Ultimate application n Discussion

3 What tracking devices do you have on you?

4 We will soon be able to track almost anyone, anywhere at anytime without any cost

5 Human Tracking Technologies Overview

6 Tracking Humans

7 Closer look at GPS Data n GPS can be used for more than just navigation and local search n Tracking is the key

8 Google Earth Demo

9 Closer look at Accelerometers

10 GPS + Accelerometry n A one-two punch n Complementary sensors n Continuous tracking

11 n Opens door to live interaction Closer look at Smartphones n Internal sensors n Hi-res user interface n Open access programming n Remote monitoring n Pervasive, ubiquitous n Wireless (Cell, wifi, Bluetooth) n Live/continuous processing n Easy to add to

12 What s the use of all these sensors? n Real-world application n Track daily acts/travel + physical activity n Explore links to the built environment n Is that all?

13 Going Beyond Activity/travel Tracking Applications

14 Going beyond passive tracking n GPS tracking now common n In combination with other sensors or interactive techniques, has potential to lead to more substantive breakthroughs

15

16 Beyond Tracking Case Studies Smartphones +

17 DIABETIC PATIENT MULTI- SENSOR MONITORING A first multi-sensor study

18 Patient Multi-sensor Monitoring n Smartphone GPS/Acc tracking + Blood Glucose, Heart monitoring n Demonstrate monitoring capabilities n Daily activities/lifestyle/routines n Exercise n Exposure/stress Discover new correlates of Blood Glucose n 40 Patient study with Toronto Rehab

19 Diabetic Patient Monitoring System

20 Example Equipment Placement

21 Interfaces and Analysis n See the following publications for more details: Doherty, S. T. and Oh, P A multi-sensor monitoring system of human physiology and daily activities. Telemedicine and e-health 18 (3): Doherty, S. T Exploring Blood Glucose Variation Over Geographical Space. Diabetes Technology and Therapeutics 14(3):

22 DISABLED CHILDREN S MOBILITY

23 Disabled Child Monitoring n Smartphone GPS tracking, Diary + Google-earth based interactive discussion n Goal was to explore micro-mobility issues: Accessibility Inclusivity n Pilot study with Bloorview Kids Rehab

24 Tracking Diary Server Kids Activity Detection Algorithm Mobility Accessibility BlackBerry Interactive Interview GPS Google Earth

25 EXPERIENCE SAMPLING METHOD (ESM) In-situ interaction with subjects

26 Park Visitors Experience n Smartphone GPS/Acc tracking + In-situ Prompting via ESM n Goal was to exploring Health and Wellbeing Benefits of Park Experiences n Pilot study in Pinery Provincial Park

27 ESM Methods In Situ Survey n Repeated queries of on-going experiences in natural setting n Fills in qualitative gaps n Significantly reduced recall bias; enhanced validity n Allows for situational analysis of experiences as they occur Tourism experience Harassment Illnesses Pain Etc. n GPS/Accel also allows for context specific queries

28 Parks Experience

29 Xsam: Initial Automated Prompt

30 Xsam: Verbal Response Question

31 Xsam: Mood/Emotion Pull-downs

32 Xsam: Best/Worst Part Questions

33 Xsam: Final Two Questions

34 Xsam: Log

35 Analysis Highlights n Avg 1-2 completions/hour without undue burden n 20% skipped, 13% snoozed n Audio responses: Avg length 15 sec or 25 words Avg 1 min per question to code n Considerable insights into experiences in their own words: Positive, negative and funny aspects Feelings, emotions and physical health Frequent reference to themselves, people, activities, and environment

36 Next steps n Larger study awaits funding

37 ELDERLY POINT-OF-CARE INTERFACE 24 hour monitoring and reporting

38 Elderly Point-of-care Monitoring n Smartphone GPS/Acc + Bed Mat n 24hr monitoring n Community nurses interface

39 Interactive Messaging

40 Interactive Messaging n The ultimate application? n Context awareness allows targeted messages n Literature reports in-situ messaging far more effective for behavioural change n Apps in: Promoting physical activity Smoking cessation Advertising

41 Discussion

42 Discussion n Smartphones ideal for more than just tracking activity-travel patterns + Physiology (heart, BG, ) + Other activity info (food, sleeping) + After-the-fact in-depth discussion + After-the-fact decision support + In-situ capture of experiences + Real-time interaction to change behaviour n From passive observation to active intervention to improve health

43 Funding Acknowledgements Industry Medical Drs. Oh and Sarin