Towards Cloud Streaming: architecture, mechanism and deployments

Transcription

1 outline Towards Cloud Streaming: architecture, mechanism and deployments IETF-78, Clouds bar BoF, July 2010 Xiaogang Wei Lisa Dewar About ForceTech Architecture for Cloud streaming Platform Mechanisms and Algorithms Preliminary Industrial Deployments Force Innovation Technology Inc. 1

2 Company overview Solution overview Founded in March, 2004, Force Innovation Technology Inc. holds its headquarter in Beijing (Zhongguancun Software Park), oversea offices in Canada, UK and Korea, and distributors worldwide. As an international solution provider for video streaming, ForceTech is an expert and technical leader in providing a complete suite of solutions for 3 SCREEN (PC, TV, mobile) media streaming system with Peer-to-Peer(P2P) technology. ForceTech offers complete solutions for the whole lifecycle of providing Internet video services, including live video/vod P2P media server, cross-region region transmission, CMS management & billing system, video transcoding system, H.264 encoder, P2P streaming client software, etc. In 2005, ForceTech first developed the P2P VOD system in China; In 2007,ForceTech was the first to launch IPTV Streaming platform, and integrated with several main STB chips in China. In 2008,ForceTech began to develop 3G mobile streaming system in funded project with China Mobile. In 2009,ForceTech proposed cloud streaming concept,which has applied a national patent and published an academic paper in IEEE Transaction on Consumer Electronics. In year 2010, Forcetech start improving its 3-screen video conference system, targeting at providing a video software solution for the national network convergence policy. So far, with its global leading manageable P2P 3-Screen streaming solution integrated into several chips and supported by main hardware providers. ForceTech has successfully provided solutions for the live broadcasting/vod applications with nearly one million of concurrent users for tens of Medias like CCTV-6 movie channel( Internet TV, China education station ( Group Sobox, Joy net( 2

3 Intellectual properties outline As a high-tech company, ForceTech advances in technical innovations and owns full intellectual property rights of its products Software copyright About Forcetech Architecture for Cloud streaming Platform Patent 1. cloud streaming service platform, State Intellectual Property Bureau( NO ); 2. multi-terminal Internet video system, State Intellectual Property Bureau(authorized) (NO. ZL ) Mechanisms and Algorithms Preliminary Industrial Deployments Publication Enabling on-demand Internet video streaming services to multi-terminal users in large scale", IEEE Transactions on Consumer Electronics, Nov.2009, Volume: 55, Issue: 4, page(s): (US) 3

4 Cloud streaming Charging model The concept of cloud streaming targets at providing the video over the cloud as a service, so that end users can satisfy their varieties of streaming demands as long as it can access to Internet. Users of different terminal can obtain the same high quality of service, with no special software or hardware required to enable streaming media Internet content providers can stream their videos to end users, by replying on public cloud streaming platform, instead of building their own streaming media server. ICPs then can share the cost and become rather scalable in serving users. content providers can avoid capital expenditure (CapEx) on hardware, software, and services, but instead renting the service of a cloud streaming platform operator only for what they use. Consumption is usually billed on a utility (resources consumed, like storage size, Internet bandwidth) or subscription (time-based) basis with little or no upfront cost. 4

5 ForceTech Cloud streaming solution Cloud streaming component an ecosystem solution to meet the multiple streaming needs for multiple users through a unified video service platform With efficient server virtualization and organization, QoS-guaranteed streaming services on demand are delivered through unified web access. live video broadcasting, video on demand,video downloading and video conference services. Video viewing and video distribution PC, TV, mobile, MID P2P extended cloud of high bandwidth terminals Cloud streaming service system: The system includes: 1)ondemand distribution network; 2)on-demand rate transfer network; 3)multiple terminal support interface; 4) server organization and management. Multi-terminal accessing server is responsible for judging and accepting users that access with multiple terminals. The PC user gets access to the platform through WEB server, and IPTV user through EPG server and mobile terminals through WAP server. Cloud Streaming client side: With no reliance on client bandwidth, end terminal can obtain cloud streaming service as long as it gets access to the Internet. Users can either access the platform in C/S mode or P2P mode based on their needs and available bandwidth. In most cases, users, especially PC and TV users, are encouraged to access in P2P manner to increase the platform capacity and scalability. In such case, those users become part of the extended cloud platform. 5

6 ForceTech Cloud streaming solution System features In such cloud streaming data centre, with the building of hardware, software and platform, different terminal users can obtain QoS-guaranteed streaming services on demand through Internet. The multiple terminal support enables PC end, IPTV STB, mobile phone, PDA,etc, to access the cloud streaming platform through unified web access. The multiple streaming service support enables live video broadcasting, video on demand and video downloading services. The multiple user service support enables users to either access the streaming service on the platform, or distribute streaming service through the platform. multi-terminal Operating multi-screen streaming enables operators to realize unified management for different terminals (PC, TV, Mobile) and streaming services with same content and distribution. Cross-ISP Operating enables operators to provide users in different IPs with the highest quality and smoothest video watching experiences possible. Unified Management support large-scale server clusters and distributed management, and enables unified video distribution over a streaming server cluster platform 6

7 Service logic framework outline On-demand video service with unified access Video conference, video live broadcast, video on demand Supported by combing P2P media server and MCU Unified web access with flexible user selection About ForceTech Architecture for Cloud streaming Platform Mechanisms and Algorithms Preliminary Industrial Deployments 7

8 CDN+P2P hybrid mechanisms Manageable Server Cluster operating with robustness and load balance As the core side for the cloud streaming platform, the ForceP2P cloud streaming data centre is built with a hybrid of CDN and P2P framework, with the combination of virtualization and Multi-tenancy techniques. a trustworthy and controllable overlay CDN reduces end-to-end delay; P2P promotes scalability The whole platform contain two layers of P2P networks: 1) Structured Edge Server P2P: to optimally place edge servers and to reload traffic from fullloaded server to less-loaded server. 2) Distributed User P2P: to employ a pure multiple-source to multiple-receiver P2P to achieve maximum scalability in each cluster. A ring distribution network, pushing content from center to distributed server clusters Intelligent content distribution, automating synchronized distribution for hot content Distributed content storage, storing content in local hardware after distribution Content-guided, enabling fast content delivery in the content releasing system 8

9 Manageable Server Cluster operating with robustness and load balance Server Module With multi-process handling function and partial server virtualization, the Force cloud streaming servers can better utilize and save hardware in reasonable environments. The Force cloud streaming servers are divided by functions and make every kind of servers handle their responsibility more professionally, to improve the overall service quality. 9

10 Server Components Intelligent P2P assitance enabling more user= higher quliaty+lower cost through sub cloud Components Function Force P2P Database -FDBS is responsible for taking all dynamic data the FCCS cluster needs to store and sending the Server (FDBS) proper data information cached in servers to FCCS. Force P2P Central -FCCS handles all servers, mainly for the server information management and interaction. Control Server -FCCS conducts the load analysis of the servers with efficient algorithm and assigns the most (FCCS)Cluster proper Force CDN node or FTDS server as the seed. The seeding node is selected with load and connectivity analysis, incorporating principles like nearest location, best seed and best connection number. Force P2P CDN - FCDN is between FCCS server and FTDS server, responsible for inter-domain content handling Server and distribution in cross-domain network. When FTDS server is far from FCCS server, FCDN server will take responsibility for real-time data delivery and distribution in its domain. Force P2P - Directly respond to user upload request, handle user uploaded content, integrate into full stream, Transmission upload the video stream to streaming server and distribute to other users. Uploading -Directly obtain collected live video stream, push live stream to streaming server, form live Server(FTUS) channel for live video distribution. Force P2P -FTDS (Force Transmission and Delivery Server) is at the bottom layer of FCCS and FCDN, and Transmission and is responsible for accepting node joining and streaming the node, with the guide of FCCS. FTDS Delivery Server (FTDS) receives file and live content distributed from FCCS and FCDN. -FTDS mainly serves the client peer for responding user request and provides requested live data/stream to users. Certain Client with high bandwidth(e.g PC) are enabled to share content in P2P manner to decrease the pressure of cloud data centers the combination of P2P networks around those servers facilitates peers to freely transmit within their P2P clusters to achieve maximum scalability 10

11 advanced P2P algorithms Multi-terminal access process P2P SIDE Content driven Peer selection algorithm Quantizing seed, packet loss, ISP values. Piece-on-demand and availability piece selection scheme Rapid live chunk delivery algorithm Private UDP protocol for transfer NAT Server SIDE Seed-priority server scheduling strategy CDN manner server organization CDN-assited P2P combination Adaptive Time switch Intelligent Space organization 1. mid user sends request through Internet 2. cloud streaming platform search requested content in all server and users(pc, STB, mobile, etc) 3. cloud streaming platform redirects request to PC users. if find the PC with the content, 4. return pc address 4. or else, if find the STB with the content, return stb address 5. if not, return server address with the content 6. MID obtain content from returned PC/stb/ server 7. mid s cached content for global search and share 11

12 outline Preliminary deployments About ForceTech Architecture for Cloud streaming Platform Mechanisms and Algorithms Preliminary Industrial Deployments Based on years of experience in serving as the solution provider of Internet video industry, ForceTech provides software and hardware solutions to support the on-demand streaming to multiple terminals over Internet. Till now, the Force Media streaming system widely supports mainstream protocols, video formats, and stb chips. With the emerging of cloud computing paradigm, ForceTech is now building the cloud streaming platform to provide qualityguaranteed streaming services on demand to any user anywhere through unified web access. 12

13 ForceP2P 3 Screens make Anytime Anywhere Any Device Streaming Together. 13