The 5 th International Conference on Web-based Learning Web-based Learning with Non-linear Multimedia Stories 1, 1, 2, 1,3 Georgetown, Malaysia, 21 st of July 2006 I5-SKSJ-0706-1/15 1 Informatik 5, RWTH Aachen University, Germany 2 Victoria University, Melbourne, Australia 3 Fraunhofer FIT, Schloss Birlinghoven, Sankt Augustin, Germany
Agenda Story Telling & Technology Enhanced Learning (TEL) - Why? Learning & Knowledge management in CoPs - What? Non-linear multimedia-storytelling - How? Movement Oriented Design (MOD) Media Integrated Story Telling (MIST) - Non-linear digital story telling - Metadata management - Formal notation of MIST - User interfaces I5-SKSJ-0706-2/15 Conclusions & Outlook
Learning & Knowledge Management Individual / Community Perspective Declarative Knowledge Procedural Knowledge sensomotoric skills, procedural scripts non-documented routines and operations Semantic Knowledge Episodic Knowledge semiotic concepts documentation memory of experiencing past episodes web blogs, narratives Verbal Non-verbal words linguistic data image, icon, index video blogs, diagrams, images, photographies [Nonaka & Takeuchi, 1995] [Ullman, 2004] I5-SKSJ-0706-3/15
Non-linear Multimedia Story Telling Digital Storytelling uses digital media to create media-rich stories to tell, share and to preserve. Digital stories derive their power through weaving images, music, narrative and voice together, thereby giving deep dimension and vivid color to characters, situations, and insights. Digital Storytelling Association (http://dsaweb.org) I5-SKSJ-0706-4/15 Tell: Experiencing & Navigating MM stories Share: Web-based collaboration Preserve: DB driven storage of contents TEL
Knowledge & Learning Methodology CoPs consume and produce stories in parallel Validation of stories required - Are all potential stories valid? - Are all problems covered by a medium? - Are all (sub-)problems solved in any paths? Story & media analysis (ongoing research) - How to create good stories? - Which agents, places, etc. are involved? - Are some media better than others? I5-SKSJ-0706-5/15 How to support learning from MM stories in CoPs?
Movement Oriented Design (MOD) I5-SKSJ-0706-6/15 Motivation - Decomposition of a problem into (sub-) problems ( Author s intention ) Structure - Story - (Composed) Story Units - Atomic elements (Media) - Decomposition of stories into: Begin, Middle, End (BME) Recursions possible! Aim - Satisfying the recipient s Emotional Movement
Media Integrated Story Telling (MIST) Combining - MOD structure - Non-linear navigation paths - Digital media Community-wide story creation & consumption - Central story server (IBM DB2 Version 9) - Media sharing via FTP - Java clients I5-SKSJ-0706-7/15 Web-based learning with non-linear multimedia stories
Metadata Management in Non-linear Digital Story Telling Problem hierarchy MOD - Story - Composed Story Units () - Story Units (SU) - Media Semantics linked with Media - Agents of Action - Places - Objects - Time Plot Storyboard Contents Formal notation I5-SKSJ-0706-8/15
Formal Notation of MIST I5-SKSJ-0706-9/15 Identifiers: Stories: Problems: I σ = S = I & & IP IM {, M, Rel, Rel, Rel, Rel, root}, Rel SUCC,Rel 0 root F ( σ ) = π = P S SUCC 1 M R ( σ ) B,Rel M,Rel E B M 2 R ( σ ) S S S S S S S ( SU,, M, Rel, Rel, Rel, Rel root ) { P, M, L, Rel, root, super} P, M, L R = Rel R 1 ( π) ( π) PM 2 1 PM super F ( π) SUCC B M E, 0 root F ( π) ( P ) S PS PS PS PS PS PS, I, M, L, Rel, root, super PM E
Transitions Type 1: Neighbors within the same How to prove MOD compliance of stories in MIST? Evaluation of Successor-Relations, but: Dependencies might not only exist between contents in a single but also in different s! Easy case : Single, or I5-SKSJ-0706-10/15
Transitions Type 2: Neighbor from a cascading Two or more s involved One cascading branch I5-SKSJ-0706-11/15 Possible Transitions:
Transitions Type 3: Neighbors from cascading s Three or more s involved Two cascading branches Possible Transitions: I5-SKSJ-0706-12/15
MIST Story Editor Creation of non-linear multimedia stories Episodic Knowledge Storyboard I5-SKSJ-0706-13/15 Definition of story paths according to BME Linkage of story elements with multimedia contents Plot Declarative Knowledge Annotations Semantic Knowledge
MIST Viewer Media Navigation Media Player I5-SKSJ-0706-14/15 Semantic annotations
Conclusions & Outlook I5-SKSJ-0706-15/15 First ever implementation of the MOD paradigm Measuring the learning success - Graph medial (network) analysis - User modeling MPEG-21 - Mobile end-devices - Rights management New application domains - Cultural heritage - E-Tourism Many thanks to: Petra Moog, Frank Huber, Wolfram Hußmann, Boris Kowalak, Carsten Conrad, Monika Pienkos, Dominik Renzel, and many others...