Janus: back to the future of WebRTC

Transcription

1 TF- : back to the future of Lorenzo Miniero [email protected] 1 st TF- meeting 15 th December 2014, Paris

2 Outline TF- 1 A brief introduction 2 A stroll through time activities and running code related efforts 3 : a general purpose gateway and gateways Programmable real-time media components A modular and extensible architecture 4

3 Who am I? TF- Someone not used to this cold! From sunny Sorrento, Italy Current activities Ph.D UniNA Worked on real-time applications for a long time participant Several WGs First time in 67 San Diego (2006) Open source contributor libbfcp, libmsrp, confiance, mediactrl, Asterisk,... gateway main author Getting older but, unlike whisky, not getting any better

4 What is? TF- A startup focused on real-time multimedia applications Academic spin-off of the University of Napoli Federico II Official tool for remote At first born to turn research into a product Efforts on XCON (Centralized Conferencing) and MEDIACTRL (Media Server Control) Web Conferencing and Collaboration Widened the scope to cover multimedia in general How is it pronounced, you say?? Good question!

5 A few more words on TF- comes in different flavours Interactive Webinar (-style) Web conference UCC (Unified Communication and Collaboration) What s in there? Enjoy watching our teaser spot on: audio/video Jabber chat Slides Etherpad support Application/desktop sharing Whiteboard Polling Moderation Mobile apps IPv6 support

6 First steps: San Diego (2006) TF- Don t try this at home!

7 First steps: San Diego (2006) TF- Live demo of the BFCP/CCMP protocols in action (XCON) Open source project:

8 Binary Floor Control Protocol (BFCP) TF- Open source project:

9 Centralized Conferencing Manipulation Protocol (CCMP) TF- Authors: CCMP and examples

10 XCON/DCON: Stand-alone client TF-

11 One step further: from XCON to MEDIACTRL TF- Open source project:

12 MEDIACTRL: programming media control TF-

13 MEDIACTRL: programming media control TF-

14 MEDIACTRL: programming media control TF-

15 Prototype and ( running code ) TF-

16 Prototype and ( running code ) TF-

17 Prototype and ( running code ) TF-

18 More scalability: Media Resource Brokering TF- Design Team: IVR and Mixer Authors: MRB and examples

19 First steps TF- RTCWEB BoF in 80 (March 2011, Prague) First RPS experiment at the same meeting already RTP- and web-based for a while RTP Java applet implemented for the purpose Other protocols (SIP, BFCP, XMPP, etc.) wrapped by HTTP Started working on as soon as it came out May/ html A custom VP8 video mixer for Asterisk MeetMe/ConfBridge

20 First steps TF- 84 Vancouver

21 Opus audio codec integration TF- Opus is a standard, high quality, adaptive audio codec Mandatory-To-Implement (MTI) in! Open source library available Integrated by us in Asterisk Transcoding support in open source patch Passthrough support in mainstream Asterisk 12 Tested in Streaming (HTML5 <audio>) Multimedia conferences (mixing and transcoding)

22 Technical 87 in Berlin TF- Technical Plenary on Opus Invited speaker with Google, Mozilla and Jitsi

23 Technical 87 in Berlin TF- Super-wideband (48kHz) Opus audio streaming

24 World Tour J2 TF /

25 @ TF-

26 @ TF-

27 Director NOC in Honolulu TF- Completely -based Slides as a video feed from the beamer Static video feed from the room Dynamic video feeds for remote speakers

28 reference architecture TF-

29 Involving a gateway (and applications) TF-

30 Involving different technologies as well TF-

31 Do we really need a gateway? TF- Several reasons for a YES, here Relieve full-meshes (heavy on the client side) Leveraging widespread technologies (e.g., SIP infrastructures) Fixing things between implementations Reason for a NO? You won t go beyond 1-1 communication You don t want an infrastructure You don t care about legacy stuff What is a Gateway anyway?

32 Real-time Media Components TF- Writing a gateway from scratch is a heavy task Implementation of the protocol suite Bridge between legacy stuff (SIP, RTMP, etc.) and Needs to support both ( gateway) J1 What about statistics? D1 Reachability may be an issue D2 Programmable interface Different applications/technologies, different requirements Dynamic management of media flows and users Something a-la MEDIACTRL? W1, B1, R1, R2

33 : a general purpose gateway TF- In ancient Roman religion and myth, [..] is the god of beginnings and transitions, and thereby of gates, doors, passages, endings and time. He is usually depicted as having two faces, since he looks to the future and to the past.

34 : a general purpose gateway TF- A door between the communications past and future Legacy technologies (the past ) (the future ) General purpose, open source gateway Demos and documentation: Design and implementation of the gateway J3 suite re-implemented (core) Modular architecture rewritten from scratch Plugins as the MEDIACTRL packages

35 Modular architecture TF- The core only implements the stack JSEP/SDP, ICE, DTLS-SRTP, Data Channels,... REST (HTTP) / WebSockets / RabbitMQ APIs Application logic implemented in server side plugins Users attach to plugins via the gateway core The gateway handles the stuff Plugins route/manipulate the media/data Some proof of concept plugins implemented Echo Test ( Self testing!) Streaming ( Live events!) Conferencing ( Communication!) SIP Gateway ( Legacy SIP!)...

36 Extensible and API TF-

37 Extensible and API TF-

38 Plugins as bricks TF- Each plugin is a feature, not an application Application can be composed out of different features Features as bricks for a complex scenario A few examples... Screensharing with Q&A Video MCU (screen) + Video MCU (speakers) + Audio Bridge (questions) Video communication in social networks SIP plugin (calls) + Echo Test (diagnostics) + Voice Mail (messaging) Social TV Streaming (TV channel) + Video MCU (interaction)

39 Screen Sharing with Q/A TF-

40 Social TV TF-

41 What is it used for today? TF- We use it ourselves for many things (obviously) Web conferencing Webinars and e-learning Streaming of live events -to-sip gateway Many people/companies using it as well in even more creative ways! Coworking TV broadcasting and Social TV Home automation Internet of Things New third-party tools are starting to come out New plugins for ad-hoc requirements Server-side API wrappers (node.js,.net,...)

42 What to do next? TF- Finalize the implementation Stabilize SSRC multiplexing Add octets (besides strings) to DataChannels Keep up-to-date with newest stuff Mobile access stack for Android basically done, to refine Already interoperable with libjingle_peerconnection Improve the pluggable architecture Plugins as filters, not only sinks (e.g., transcoders) Plugins in series and/or in parallel Help us improve this! Play with it, more testing is important Write your own plugins/applications!

43 Questions? Comments? TF-

44 Related Publications TF- International journals J1 A. Amirante, T. Castaldi,, S. P. Romano, On the seamless interaction between browsers and SIP-based conferencing systems, IEEE Communications Magazine 51(4), pg (April 2013) J2 A. Amirante, T. Castaldi,, S. P. Romano, : How We Turned an Experiment into an Tool, Journal, Volume 9, Issue 3, (March 2014) J3 A. Amirante, T. Castaldi,, S. P. Romano, : a general purpose gateway, IPTComm 2014, (in press) Book chapters B1 A. Amirante, T. Castaldi, and S. P. Romano. Protocol Interactions among User Agents, Application Servers, and Media Servers: Standardization Efforts and Open Issues, Intelligent Multimedia Technologies for Networking Applications: Techniques and Tools. IGI Global, Web. 7 Jan doi: / ch003 Conferences and workshops W1, Improving the scalability of real-time multimedia applications using brokering of media resources, InfQ 2013, June 13-14, 2013, Sorrento, Italy W2 A. Amirante, T. Castaldi, and S. P. Romano, SOLEIL: Streaming Of Large-scale Events over Internet clouds, 11 th Italian Networking Workshop, January 15-17, 2014, Cortina d Ampezzo, Italy Request For Comments (RFC) R1 C. Boulton,, G. Munson, Media Resource Brokering, RFC6917, April 2013 R2 A. Amirante, T. Castaldi,, S. P. Romano, Media Control Channel Framework (CFW) Call Flow Examples, RFC7058, November 2013 Internet Drafts D1, S. Garcia Murillo, V. Pascual Guidelines to support RTCP end-to-end in Back-to-Back User Agents (B2BUAs), draft-ietf-straw-b2bua-rtcp-02 D2 X. Chen, S. Garcia Murillo, O. Moskalenko, V. Pascual,, WebSocket Protocol as a Transport for Traversal Using Relays around NAT (TURN), draft-chenxin-behave-turn-websocket-01