COLLABORATIVE APPROACHES FOR MEDIA ANNOTATION

Transcription

1 Context Large amount of audiovisual content Difficulty of access, due to lack of annotations Annotation by professionals has significant costs Automatic processing of content presents several implementation difficulties Collaborative annotation of content has been the solution presented in Web 2.0 applications Objectives Develop an application for video content annotation Use a collaborative approach to decrease costs and time required for annotation Use the concept of Games With a Purpose (GWAP) to motivate players Allow annotations (tags) in specific time instants COLLABORATIVE APPROACHES FOR MEDIA ANNOTATION José Pedro Pinto Paula Viana

2 Main functionalities Collaborative Process Game for 1 person Each player has a sequence of videos for annotation within a pre-defined time interval Tags should be introduced while watching the video and remain associated with that precise timecode Tags are validated using an intelligent scoring mechanism Introduction of likes provide additional validation information. Additional Features HTML5/Javascript player Likes are shown in the video navigation bar Used Tags are presented on the top of the video with a like and dislike feature Direct access to a timecode associated to a metadata element Tag cloud Like s bar COLLABORATIVE APPROACHES FOR MEDIA ANNOTATION

3 Optical Music Recognition system Ana Rebelo Supervisor: PhD Jaime S. Cardoso (INESC TEC, Faculdade de Engenharia, Universidade do Porto, Portugal). Co-supervisor: PhD Andre R. S. Marcal (CICGE, CMUP, Faculdade de Ciências, Universidade do Porto, Portugal). Year: Objectives: Research new methods for OMR for handwritten and printed scores. Study of pattern recognition techniques, machine learning and logic inductive programming. Fusion of musical rules in the OMR process to overcome the existing problems in the current algorithms. Integration of the algorithms developed in a webbased system that allows browsing, analysis an retrieval of a corpus of handwritten scores. Publications: 3 journals. 6 conference papers. An effective and robust OMR system provides: an automated and time-saving input method to transform paper-based music scores into a machine-readable symbolic format for several music softwares, enable translations, for instance to Braille notations, better access to music, new functionalities and capabilities with interactive multimedia technologies, for instance association of scores and video excerpts, playback, musical analysis, reprinting, editing, and digital archiving, and preservation of cultural heritage.

4 Dynamic Recognition of Musical Characteres Creation of a software to draw musical symbols, with an instant response of the recognizable symbol and transformation into a universal editable symbol. Investigate and develop algorithms to recognise musical characters in real time to obtain a digital, easy-to-manage version of the original scores. Action Position X and Y Time Pressure The application will be an indispensable tool for composers, conductors and musicians. An OMR system can be divided according to the input data into two categories: offline and online. It could also be used to help in pedagogic situations, simplifying the process of introduction of musical information in digital systems without compromising the process of learning musical notation. Offline OMR system recognizes the symbols in a digitized music score, usually, obtained with a scanner. Online OMR system recognizes the symbols almost simultaneously when they are introduced in the system by a pen-based interface, being a real time process. Online recognition mandatorily deals with handwritten music works. The main advantages using online OMR systems are related to: (1) elimination of segmentation issues caused by overlapped symbols, and (2) extra knowledge about spatio-temporal information of symbols.

5 CRISTINA SÁ Universidade Católica Portuguesa / CITAR csa@porto.ucp.pt

6 INTERFACING ART, TECNOLOGY AND EXPERIENCE

7 INTERFACE INTERACTION EXPERIENCE DESIGN

8 INTERFACING DIGITAL CULTURE: SUBJECTIVITY IMAGE ART

9 George Sioros SMC group / Supervisor: Carlos Guedes Generation / Manipulation of Musical Rhythm Meter Tension Variation Syncopation Groove Complexity kin.rhythmicator: stochasticaly generated rhythms in a certain meter kin.recombinator: Variations through recombination of the drum loops

10 Context Hundreds of live channels Thousands of VOD items Customer face difficulties to find the right content Recommendation Systems (RS) stand out as a possible solution to help a watcher on the selection of the content that best fits his preferences. Results Objectives Compare the performance of generic collaborative and different approaches in contentbased recommendation algorithms Studying how metadata describing the movies may influence the recommendations performance Results showed that although the collaborative approach scored better, content-based algorithm was influenced by the metadata elements considered to compute recommendations and results could be quite similar METADATA BASED APPROACHES FOR RS Márcio Soares Paula Viana

11 Contextual collaborative ratings Can we provide better recommendations using a contextual hybrid approach? Results Currently Recommendations using Social Tags Tags clusters METADATA BASED APPROACHES FOR RS Results showed that better results could be obtained through this new approach

12 A. Augusto de Sousa Current Jobs Associate Professor at FEUP Director of MIEIC (Master in and Engineering) Research areas Computer Graphics Image Synthesis, Virtual and Augmented Reality Human- Computer Natural Temporal Management and Digital Games Serious Games Main research projects 3DWikiU A 3D Wiki for Urban Environments ERAS Expedi@ous virtual Reconstruc@on of Cultural Heritage Sites MASSIVE Mul@modal Acknowledgeable mul@sensorial Immersive Virtual Enviroments April 2013 Project MAT 8

13 António Fernando Coelho Assistant Professor at FEUP Director of the Master in at UP Assistant director of the Doctoral Program in Digital Media Research areas Computer Graphics Virtual and Augmented Reality, Procedural Modeling Systems based Databases, GIS Digital Games Serious Games, Games- based Learning & Training, Assessment and in Games, Procedural Content Mobile Games Main research projects European ICARUS: Integrated Components for Assisted Rescue and Unmanned Search (FP7 - SEC : Security) QREN CNG (New Genera@on Contents) Escolinhas Cria@vas (Crea@ve schools) DouroValley.eu; FCT 3DWikiU A 3D Wiki for Urban Environments ERAS Expedi@ous virtual Reconstruc@on of Cultural Heritage Sites April 2013 Project MAT 9

14 Rui Rodrigues Research areas Computer Graphics Virtual and Augmented Reality, GPU programming HCI systems and devices, Physical Digital Games Game development, Serious Games, Game- based Learning, Mobile Games Main research projects 3DWikiU A 3D Wiki for Urban Environments StableCargo - Cargo stability analysis in container transporta@on: a hybrid op@miza@on - heuris@cs framework ERAS Expedi@ous virtual Reconstruc@on of Cultural Heritage Sites April 2013 Project MAT 10

15 Lino Oliveira Skills: GIS Sogware Engineering Enterprise Engineering Management of Development teams Main research projects: MIELE [ ]: Interoperability E- services for and Environment sustainability (Consultant) APSAT [ ]: Satellite for Public Policy and Sustainable Development (Project manager and of the Portuguese development team) Douro Valley [ ]: Plataforma Web Inovadora para o Turismo da Região do Douro (Project specifica@on and coordina@on of the development team) IVDP [ ]: Sistema de Informação Vimcola do Douro SIVD (Project analysis, specifica@on and development. Coordina@on of the development team) GeoForum [2006]: Plataforma de discussão pública georreferenciada. (Management, analysis and specifica@on) (Ar@go na Exame Informá@ca nº 139 de Janeiro de 2007) HotSpots [ ]: Módulo aplicacional de georreferenciação de tráfego GSM, para a Siemens (analysis) April 2013 Project MAT 11

16 Lígia Silva Academic/Professional Background BSc in Surveying Engineering (FCUP, 1996) Post- in Planning and Design of Urban Environment (FEUP/FAUP, 2005) Project management at USIG since Skills GIS Techniques and Technology Data Management GeoICT Planning Main research projects European e- ASLA: e- for Small Local SIMAT: Municipal System: Technical in GIS technology Wine Slot SIGAVE: AVE Regional GIS PlaJorm April 2013 Project MAT 12

17 Miguel Leitão Research Areas areas Computer Graphics - Image Synthesis - Virtual Reality, - Procedural Modeling - Autonomous par@cipants Main research projects Virtual Reality System for Phobia Treatment (VRFobias). Contracted by School of Psychology, University of Minho. HASTE (Human Machine Interface And the Safety of Traffic in Europe), Growth Task 2.2.5/6, Project GRD1/2000/25361 S , Time to Collision and Road Safety: Frontal Collision Study. Supported by POCTI/ECM/11299/98, Synatel - In- Vehicle Informa1on and Communica1on Systems, Gerico, Global EneRgy management and driver Interface for a Ci1zen Op1mal driving behavior. France s Ministry of the Environment, OPIIS On- seat Passenger Interac1ve Informa1on System. Embedded interac@ve device aimed to in- vehicle use in train and avionics INTERACTION - Differences and similari1es in driver interac1on with in- vehicle technologies., European Project Ref , April 2013 Project MAT 13

18 Luís Magalhães (1/2) Bringing the past to life April 2013 Project MAT 14

19 Luís Magalhães (2/2) Serious and Social Games for Future Internet April 2013 Project MAT 15

20 Maximino Bessa Mul1sensory virtual environments Five Senses Visuals HDR Audio Feel Taste Smell Presence in Virtual Environments of perceptual equivalence for each sense virtual environments for training and April 2013 Project MAT 16

21 Leonel Morgado Simulador de manutenção mecânica de motores de F- 16: Tarefas bem definidas Equipas de 3 mecânicos Confirmação / validação / cer@ficação

22 Ensino de empreendedorismo e gestão Cidadania Europeia Direitos Fundamentais Jogo sobre bullying (em curso)

23 Vitor Filipe (1/2) April 2013 Project MAT 19

24 Vitor Filipe (2/2) April 2013 Project MAT 20