Mobile Hybrid Assistance Systems for Education and Training with Smartpads

Transcription

1 Mobile Hybrid Assistance Systems for Education and Training with Smartpads Ute von Jan, Christoph Noll, Marianne Behrends, Urs-Vito Albrecht Hannover Medical School Peter L. Reichertz Institute for Medical Informatics PLRIMedAppLab Carl-Neuberg-Str. 1 D Hannover ute.von.jan@plri.de

2 Why Augmented Reality AR based technologies serve to bridge the gap between the real world and an enhanced, virtual reality When applied in education/training, it allows learners to gain experience in simulated settings that are hard to come by in reality Learners can become integrated into the learning situation Learners become their own learning objects Possible emotional involvement Content is anchored in memory 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 2

3 Mobile Augmented Reality At the beginning, the demands of AR based training were too high for mobile use Modern mobile devices (ios, Android, ) offer Good computing power Additional sensor input (e.g. camera, gyroscope, accelerometer, GPS, ) Good portability, allowing for time- and location independent use if necessary Are relatively cheap Therefore, mobile AR seems feasible, even in a classroom setting 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 3

4 Mobile Augmented Reality Virtual content can be triggered in various ways Using geolocation data: e.g. overlay information about buildings, artwork, onto an image of the current surroundings Using image recognition techniques to detect objects for anchoring the virtual content triggers 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 4

5 Use Case: Basic Education in Legal Medicine mobile Augmented Reality blended learning environment 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 5

6 The Application 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 6

7 The Application: Interactive Flashcards Frage 1 von 12: Nennen Sie bitte Merkmale des Einschusses ( Einschusszeichen ) Antwort 1 von 12: Als Einschusszeichen werden der zentrale, nicht adaptierbare Substanzdefekt, der Schürfsaum und Abstreifring bezeichnet. Zusätzlich finden sich Nahschusszeichen. Marker-Detection Questions Additional Content Answers 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 7

8 Benefits of AR based learning Learners: Interactive alternative to reality e.g. for medicine, ethical problems can be avoided The concept can be applied in various settings: group settings/role play, single learners, The learning scenario stays close to reality The presentation may trigger questions and provide answers that cannot be covered by (static) textbook content Authors / Learners: In case of marble : simple editing of content (XML based) Flexible presentation of the content: e.g. combine certain findings to construct virtual cases 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 8

9 Does AR Based Learning Make Sense? Preliminary Evaluation: comparison between marble textbook material 10 Learners without any previous education about the subject Divided into two groups Before and after the learning period, both groups were given questionnaires covering Learning efficiency Emotional state while learning User experience for the provided learning material (textbook or marble ) 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 9

10 Preliminary Results marble was rated as very stimulating and attractive compared to the textbook material Regarding the emotional state before/after the learning period, marble seems to have the properties of a good cup of coffee ;-) marble learners stated that they were much more awake and felt vigorous The textbook group was more tired/less vigorous after the learning period 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 10

11 Preliminary Results Small number of participants only allows for generation of hyptotheses Nevertheless, evaluation results so far point to activating properties and good learning efficiency of marble These should also be attainable by other AR based mobile learning solutions An additional evaluation with a larger group of learners is planned implemetation for other visually oriented medical subjects 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 11

12 THANK YOU! 15. SpectroNet Collaboration Forum Puchheim, , von Jan / Noll / Behrends / Albrecht 12