Workshop on Multimedia Semantics Semantic processing of multimedia data by MPEG-7 for capacious knowledge management Marc Spaniol, Ralf Klamma, Matthias Jarke RWTH Aachen Milovy, 29 th of November Prof. Dr. I5-SKJ-2911-1/14
Agenda Multimedia knowledge creation Framework of community-centred knowledge management Transcription Addressing Localization Semantic knowledge management by XML and MPEG-7 The Virtual Entrepreneurship Lab (VEL) Prof. Dr. I5-SKJ-2911-2/14 Conclusion & Outlook
Knowledge creation process Making implicit knowledge explicit (Externalization) Management of explicit data (Combination) Retrieval of explicit knowledge (Internalization) Sharing of implicit knowledge (Socialization) Externalization implicit explicit Socialization Combination implicit explicit Internalization The Knowledge-Creating Company [Nonaka, Takeuchi 95] Prof. Dr. I5-SKJ-2911-3/14 There is no media free knowledge (Multi) media semantics? Knowledge Management = Multimedia Management + Ontologies
How to transfer media dependent knowledge? Multimedia Concepts Ontologies Explanation of activities Media versatility Unspecified information Sample creation Learning by doing Abstraction of information Strict classification and categorization of data Modeling of data sources and information types Creation of domain specific structures Prof. Dr. I5-SKJ-2911-4/14 Predefined data structures
Analysis of knowledge management concepts Multimedia Concepts Applications Ontology based Information Systems Content adaptability o o Media versatility + o Community suitability + - Interactivity o o Personalization - + User interface flexibility o o Application popularity + o Prof. Dr. I5-SKJ-2911-5/14 Goal: Combining their benefits by simultaneously reducing their deficits
Knowledge creation framework: Transcription - Addressing - Localization New computer science approach: Combination of ontologies and multimedia concepts Supporting Transcription by (re-) combination of transcription tools Multimedia Concepts implicit Socialization Externalization Ontologies explicit Combination Stabilization Addressing implicit explicit Optimizing Localization Internalization Prof. Dr. I5-SKJ-2911-6/14 Testing in an interdisciplinary collaborative research center The Knowledge-Creating Company [Nonaka, Takeuchi 95] Transcribing Media/Reading [Jäger, Stanitzek 02] Signals of disturbance [Kümmel, Schüttpelz 02]
Semantics in community multimedia Prof. Dr. I5-SKJ-2911-7/14
Structural and content based KM with XML and MPEG-7 Content organization Collections Models User interaction Media Creation & Production Content Management Usage Navigation & Access Index User preferences Structural aspects Content description Semantic aspects Views Variations Usage History Prof. Dr. I5-SKJ-2911-8/14 Basis Schema- Links&Media Basic Basic Tools Localization Tools datatypes XML MPEG-7 [IEEE 02]
Structuring of heterogenous Data data XML Prof. Dr. I5-SKJ-2911-9/14 <Mpeg7>... <ContentDescription xsi:type="contententitytype"> 3-dimensional Categorization <MultimediaContent xsi:type="videotype">... <VideoSegment id="seg1"> <TextAnnotation type="question"> question </TextAnnotation> <TextAnnotation type="categories"> related categories </TextAnnotation> <TextAnnotation type="phases"> phases of an entrepreneurship </TextAnnotation> <TextAnnotation type="persons"> founder </TextAnnotation> Additional Information <TextAnnotation type="companies"> company name </TextAnnotation> <MediaTime> starting and ending point of the medium </MediaTime> </VideoSegment>... </MultimediaContent> </ContentDescription> Multimedia Information... </Mpeg7>
Prof. Dr. I5-SKJ-2911-10/14 Content and context description by MPEG-7 <Mpeg7> <DescriptionMetadata id="kais Rolle"> general information about the document </DescriptionMetadata> <ContentDescription xsi:type="contententitytype"> <MultimediaContent xsi:type="multimediacollectiontype"> <ContentCollection name="kais Rolle > <TextAnnotation> Collection type (public/private) </TextAnnotation> <Content xsi:type="imagetype"> Medium, technical Data, Annotations </Content> <Content xsi:type="videotype"> --- </Content> </ContentCollection> </MultimediaContent> </ContentDescription> <ContentManagement xsi:type="userdescriptiontype"> user management </ContentManagement> </Mpeg7> Transcription Addressing Multimedia Information
Case study: Didactic concept of VEL Prof. Dr. I5-SKJ-2911-11/14 Hypermedia learning environment Extensive, close to reality media material Explorative, non-linear learning Context dependent presentation Repeated considerations due to context changes Learning structure: Student = explorer Teacher = consultant, mentor Public / private collections Users annotations
Virtual Entrepreneurship Lab (VEL) Prof. Dr. I5-SKJ-2911-12/14
Conclusion & Outlook Prof. Dr. I5-SKJ-2911-13/14 MPEG-7 helps to overcome gap between Multimedia Concepts and Ontologies Combining loose characterization and generic classification with domain modeling and categorization Research on personalization and adaptive user interfaces Current projects at : i5 SOCRATES: Chat/Talk-tool for aphasics self help groups MARS: Electronic music analysis tool MECCA: Virtual movie archive for cinematic scientists Covering multimedia semantics by MPEG-7 Personalized multimedia addressing
Contact mspaniol@cs.rwth-aachen.de klamma@cs.rwth-aachen.de jarke@cs.rwth-aachen.de www.graeculus.de Prof. Dr. I5-SKJ-2911-14/14