1 LOLA (LOw LAtency audio visual streaming system) A LOW LATENCY, HIGH QUALITY AUDIO/VIDEO TRANSMISSION SYSTEM FOR NETWORK MUSICAL PERFORMANCES AND INTERACTION
2 LOLA (the team working to make the dream come true) Production Conservatorio di musica G. Tartini - Trieste Implementation Paolo Pachini: general coordination Carlo Drioli: programming Nicola Buso: testing and musical advice Claudio Allocchio (Consortium GARR): testing and networking advice Massimo Parovel: conception and supervision
3 Musical Requirements to Play Together Audio Latency below ~75ms (depends on music gender) Eyes Contact to synchronize Spatial Sound immersion for expression Room Reverbering Continuous Presence of all musicians Non distracting environment
4 Motivations and Objectives Target applications: interactive musical tasks Network musical performances Network music education and training... but also... interactive on stage performances Network Dance performances Network Drama performances Network performing arts education and training...
5 Motivations and Objectives... and beyond: remote real time surgery virtual space immersion... you name it... Let the user invent new possibilities...
6 Motivations and Objectives Challanges Management of synchronous audio video streams over packet networks Minimal delay requirements for interactive task and music performances Optimal balance between AV presentation delay and quality The speed of computer/networking equipments... and beyond: the speed of light...
7 Motivations and Objectives Targets of the project A system suitable for musical performances relying on both audio and visual communication (but also other applications) A Transparent and Natural end-user interaction Providing lowest possible delay using available technology Low cost and portable equipment Oriented to dedicated high performance networks (LightNet Project, GARR, GÈANT, Internet2,...)
8 The LOLA system a very basic schema (well, what s the difference with DVTS, CXP?) Research & Education Networks
9 First results: 110km, 15 switches, 60fps, B/W June 4th Trieste fiber optics metropolitan network Lightnet
10 Yes, we can try to play together! First test with music: September 21st 2009 Two Pianos, in two studio rooms at Tartini, linked over the loop with LOLA Round Trip Latency ~90ms monitor on the music score, as if the other pianist was in his canonical duo position, e.g. in front Tests performed: One piano plays alone, with the return audio channel open; sound was coming back, but no echo cancelling needed; Two pianos play together some scales and easy execises; Two pianos play together some canone by J.S. Bach; The latency is artificially increased to test interaction limits; We can try with a full setup and a real Piano Duo to get feedback
11 Bach Brandeburgh Concerts Trevisan-Zaccaria Piano Duo: November 5th 2009 Two Pianos, in two Concert Hall at Tartini, linked over the loop with LOLA Round Trip Latency ~80ms, mostly due to CODECs Sound Rendering, Room Environment, musician interaction with LOLA environment. Tests performed: Play Bach Branderburgh Concerts Roundtrip Latency tests Remote sound in (insulating) earphone vs audio monitors Adaptation techniques to delay They can play together, but too much attention is payed to handle the delay. No confortable environment for artistic performance. We need to go further down with CODECs delays
12 The Triangle Test Experiments without WinSock: December 21st 2009 Just a Triangle, to make accurate latency measurments New Round Trip Latency ~20ms! Tests performed: Various buffers configuration to identify optimal results Sound Quality check (sending recorded audio tracks) We can give Bach another chance to meet technology!
13 Bach Brandeburgh Concerts (bis) Trevisan-Zaccaria Piano Duo: February 4th 2010 Two Pianos, in two Concert Hall at Tartini, linked over the loop with LOLA Round Trip Latency 20ms (artifically up to 70ms) Tests performed: Play Bach Branderburgh Concerts They started to play... and played them all! Natural interaction Many tests to refine the Sound Rendering of the remote piano.
14 Let s Try a shared real production network Trevisan-Zaccaria Piano Duo: October 16th 2010 Trieste-Milan-Trieste loop; ~40ms Sound equalisation and spatialisation tests for the remote piano; it seems to run safely in the middle of the highway:
15 The Work In Progress... make further tests with musicians; make further tests on different network configurations: longer distances; routed networks; color impact (on h/w and network bandwidth); QoS implementation through DiffServ further optimize graphic card rendering; simple user interface; to develop a users community and to build common projects; to liaise with other potential users spatial audio rendering (multichannels)
D6.3.1 SPECIFIC ENABLERS - INITIAL RELEASE September 2013 ABSTRACT This document describes the initial release of Specific Enablers for the Future Internet Content project. This performs the initial launch
Introduction to InfiniBand for End Users Industry-Standard Value and Performance for High Performance Computing and the Enterprise Paul Grun InfiniBand Trade Association INTRO TO INFINIBAND FOR END USERS
ericsson White paper Uen 284 23-3160 Rev B November 2014 Voice and video calling over SECURING HIGH-QUALITY COMMUNICATION SERVICES OVER IP NETWORKS As mobile-broadband networks continue to expand, Vo leverages
best practice design guide Deploying High Density Wi- Fi DESIGN AND CONFIGURATION GUIDE FOR ENTERPRISE Table of Contents Intended Audience... 3 Overview... 4 Performance Requirements... 5 Classroom Example...
Improv: A System for Scripting Interactive Actors in Virtual Worlds Ken Perlin / Athomas Goldberg Media Research Laboratory Department of Computer Science New York University ABSTRACT Improv is a system
EBU TECH 3329 A Tutorial on Audio Contribution over IP Source: N/ACIP Geneva May 2008 1 Page intentionally left blank. This document is paginated for recto-verso printing Tech 3329 Contents Foreword...
Information for registrants Continuing professional development and your registration Contents Introduction 2 About this document 2 CPD and HCPC registration: A summary of CPD and the audit process 2 CPD
NSN White paper November 2013 From Voice over IP to Voice over LTE CONTENTS 1. Introduction 3 2. VoLTE markets 4 3. VoLTE technology 5 3.1 VoLTE user experience 5 3.1.1 VoLTE talk time 5 3.1.2 VoLTE service
Wireless Networking in the Developing World Second Edition A practical guide to planning and building low-cost telecommunications infrastructure Wireless Networking in the Developing World For more information
Can the Production Network Be the Testbed? Rob Sherwood, Glen Gibb, Kok-Kiong Yap, Guido Appenzeller, Martin Casado, Nick McKeown, Guru Parulkar Deutsche Telekom Inc. R&D Lab, Los Altos, CA Stanford University,
Perfect For RTI Getting the Most out of STAR Math Using data to inform instruction and intervention The Accelerated products design, STAR Math, STAR Reading, STAR Early Literacy, Accelerated Math, Accelerated
The Industrial Internet@Work Marco Annunziata & Peter C. Evans Table of Contents Executive Summary The Industrial Internet Towards No Unplanned Downtime 3 Introduction A New Information and Collaboration
Special educational needs and/or disabilities Training toolkit For primary PGCE tutors and trainees Including pupils with SEN and/or disabilities in primary physical education Contents 1 Including pupils
While every care has been taken in the compilation of this information to ensure that it is accurate at the time of publication, Becta cannot be held responsible for any loss, damage or inconvenience caused
The Business Case for Videoconferencing Achieving a Competitive Edge Achieving a Competitive Edge Andrew W. Davis Ira M. Weinstein Wainhouse Research March 2005 Table of Contents The Business Challenge...
Design Thinking for Educators 2nd Edition 2 How might my classroom be redesigned to better meet my students needs? Michael Schurr, a 2nd grade teacher in New York, realized that he never asked his students
The 7 Biggest Mistakes You Can Make in Web Conferences Gihan Perera Sponsored by The 7 Biggest Mistakes You Can Make in Web Conferences There s a growing need for organizations to engage in online calls
How to pass your driving assessment... A Candidate s Guide to the Practical Driving Assessment Prepared and published by Department of Transport, Driver and Vehicle Services. Disclaimer: The information
Establishing a Mentoring Plan for Improving Retention in Online Graduate Degree Programs Janet Truluck Academic Professional and Coordinator of the Online Master's of Adult Education Degree Program The
Introduction: Principles of CALL Introduction: Principles of CALL 1 chapter 2 Focus In this chapter you will reflect on definitions of CALL learn about conditions for optimal language learning and standards
The Problem with Faxing over VoIP Channels Lower your phone bill! is one of many slogans used today by popular Voice over IP (VoIP) providers. Indeed, you may certainly save money by leveraging an existing