IxLoad TM Adobe HDS Player Emulation HTTP Dynamic Streaming (HDS) is a solution developed by Adobe Systems to playback high quality live and on-demand content. The playback uses HTTP for streaming fragmented MP4 files that is network efficient, allows caching, and extends reach. HDS is part of the Open Source Media Framework (OSMF), and it works with Adobe Access to deliver reliable and high quality video playback. The Adobe Player emulation offers: IxLoad emulates key Adobe HDS media player capabilities, allowing the creation of thousands of interactive on-demand and live streaming user sessions. These sessions perform realistic load testing of Adobe HDS compatible media, cache platforms to validate end to end video delivery architectures. High performance client emulation to scale to thousands of HDS players Processing of F4M format manifest and F4F media fragments Live and on-demand playback with full playout buffer configuration Adaptive streaming that upshifts and downshifts based on network conditions Real-time assessment of quality levels during playback HTTP proxy support to test content cache systems Adobe HDS Media Server HTTP IxLoad Adobe HDS Clients Proxy Cache Distribution Origin Figure 1: Delivering high quality content with Adobe HDS solution 26601 Agoura Road Calabasas, CA 91302 USA Tel + 1-818-871-1800 www.ixiacom.com Document No.: 915-1882-01 Rev D July 2015 - Page 1
The Adobe HDS Player emulation can be used to: Create large-scale user sessions for load testing of devices and networks, in order to measure throughput capacity with reliable delivery of streams Validate performance of real media servers to quantify their ability to handle peak number of active streaming sessions and throughput Emulate adaptive streaming nature of real devices which examine network bandwidth availability to play content from the closest matching quality level Create profile of user behavior that is fixed on different playback levels in order to deterministically playback streams of different quality with no network heuristic at play Determine the optimal user session limits of edge and origin media servers, content proxy, caching systems, and media load balancers Determine the total number of streams a content delivery network (CDN) can handle with consistent and reliable stream delivery Adobe HDS Player Emulation Features IP Support Emulation IPv4 HDS Basic Media Player functionality All messages sent over HTTP Interoperability Stream Handling User Playback File playback Command Configuration Media Name Playout Buffer Performance Metrics Adobe Flash Media Server 4.5, Wowza Media Server 3.0 and other HDS compatible media delivery platforms Playback of recorded and live streams PLAY Any media delivered using HDS technology Destination Server: IP:PORT, FQDN, Hostname Play Duration: Automatic (until end), or user configurable range Configurable on a per playback command basis Configurable on a per HDS emulation basis, in seconds Active stream count Throughput (RX, TX) HTTP connection and transaction level statistics, including error codes HTTP Error Response tracking (e.g. 404, 503) Video quality playback levels across all users Counts for Manifest, fragments for Audio and Video Requests Objectives Total user sessions Page 2
Real Time Performance Statistics IxLoad provides HDS specific, TCP, HTTP and test level statistics. Statistic Description Test Objective statistics Active Live Streams Active VoD Streams Streams Attempted Streams Played Successful Streams Played with Error Number of Live streams playing Number of on-demand streams playing Number of stream playback attempted Number of streams played without errors Number of streams played, but in which one or more errors occurred during playback. Examples of errors could include a request for a playlist or media segment that could not be completed Manifest statistics HDS Manifest Failed HDS Manifest Request HDS Manifest Successful Number of attempts by a HDS client to download a manifest file that failed. Number of attempts by a HDS client to download a manifest file. Number of attempts by a HDS client to download a manifest file that failed. Fragment statistics HDS Fragments Requested HDS Fragments Successful HDS Fragments Failed Number of HDS fragments requested. Number of HDS fragments successfully downloaded. Number of HDS fragments that could not be downloaded. Bitrate Shifts HDS Downshifts Requested HDS Downshifts Successful HDS Downshifts Failed HDS Upshifts Requested HDS Video Segments Successful Number of attempts by a HDS client to download a lower bit rate playlist. Number of attempts by a HDS client to download a lower bit rate playlist that succeeded. Number of attempts by a HDS client to download a lower bit rate playlist that failed. Number of attempts by a HDS client to download a higher bit rate playlist Number of HDS video segments successfully downloaded Page 3
Statistic HDS Video Segments Failed Description Number of HDS video segments that could not be downloaded. Playback Quality Assessment of Users Quality Levels Number of active users sessions in the following quality levels 0-400kbps 400-900kbps 900-1500kbps 1500-2000kbps 2000-3000kbps 3000-4000kbps 4000-5000kbps 5000-6000kbps 6000-7000kbps 7000+ kbps TCP statistics Connection Requests Failed Resets Sent Resets Received HTTP Requests Failed (Bad Header) HTTP Requests Failed (Timeout) HTTP Session Timeouts (4xx) HTTP Sessions Rejected (5xx) HTTP Throughput TX HTTP Throughput RX HTTP Throughput Total Media Data rate Total Audio Data rate Total Video Data rate Number of attempts to establish connections which did not result in connections being created. Number of Resets (RST) sent for any reason. Number of connection termination acknowledgments (FIN-ACK) received. Error Statistics Number of HTTP requests that failed due to a defective HTTP header. The statistics show the number of requests for each URL (page). Number of HTTP requests that failed because the clients did not receive a response within 600 seconds. The statistics show the number of requests for each URL (page). Number of HTTP requests that failed for reasons other than a Bad Request (400), Unauthorized (401), Forbidden (403), Not Found (404), or Timeout (408) error, Request Precondition Error (412). The statistics show the number of requests for each URL (page). Number of HTTP requests that failed due to lack of resources on the server (HTTP 500-series errors). This statistic is only incremented if the client had issued a request to the server before receiving the 5xx response. The statistics show the number of requests for each URL (page). Throughput Statistics Rate of HTTP traffic sent Rate of HTTP traffic received Rate at which the client sent and received HTTP traffic Rate of HDS total audio and video traffic sent Rate of HDS audio traffic received Rate of HDS video traffic received Page 4
Ordering Information Chassis Licenses: 925-3339 IxLoad-Video-OTT-2015, Software Bundle, Layer 4-7 Performance Test Application; Enables support for Adobe Flash Client, Apple HLS Client, Microsoft Silverlight Client, Adobe HDS Client and DASH Client emulations to validate OTT infrastructures. Includes 925-3193 TCP VQ Video quality for TCP video traffic for up to 10 Gbps. Also includes AVDNET-DHCP to emulate DHCP enabled clients and Software Impairment on selected hardware. 925-3359 IxLoad Multiplay-2015, Software Bundle, Layer 4-7 Performance Test Application; Data-Video-Voice package includes: Data: Enables support for HTTP, HTTPS, TCP Session, FTP, DNS, Mail (SMTP, POP3 and IMAP), SSH, RADIUS, TFTP, Application-Replay, DHCP, LDAP, Telnet, Stateless-Peer and StreamBlaster emulations; Video: Enables support for basic RTSP, IPTV (Multicast), Video-ADVANCED (VoD), Adobe Flash Client, Apple HLS Client, Microsoft Silverlight Client, Adobe HDS Client and DASH Client emulations. Includes 925-3189 Video Quality VQMON engine for up to 10Gbps and 925-3193 TCP VQ Video quality for TCP video traffic for up to 10 Gbps; Voice: Advanced VoIP SIP & RTP, Audio Codecs, H.323, VoLTE extensions, and Bulk SIP & MGCP. Also includes 925-3528 Voice Quality engine for up to 10Gbps, 925-3512 Video Quality engine for up to 10Gbps conversational video traffic; Access: Enables support for Advanced Access networking protocols such as DHCP for IP address acquisition, DHCP Server, PPP, L2TP and IPsec. Note: StreamBlaster, H.323 and Bulk SIP & MGCP are supported on selected load modules 925-3361 IxLoad Multiplay-Security-2015, Software Bundle, Layer 4-7 Performance Test Application; Data-Video-Voice- Security package includes: Data: Enables support for HTTP, HTTPS, TCP Session, FTP, DNS, Mail (SMTP, POP3 and IMAP), SSH, RADIUS, TFTP, Application-Replay, DHCP, LDAP, Telnet, Stateless-Peer and StreamBlaster emulations; Video: Enables support for basic RTSP, IPTV (Multicast), Video-ADVANCED (VoD), Adobe Flash Client, Apple HLS Client, Microsoft Silverlight Client, Adobe HDS Client and DASH Client emulations. Includes 925-3189 Video Quality VQMON engine for up to 10Gbps and 925-3193 TCP VQ Video quality for TCP video traffic for up to 10 Gbps; Voice: Enables Advanced VoIP SIP & RTP, Audio Codecs, H.323, VoLTE extensions, and Bulk SIP & MGCP. Also includes 925-3528 Voice Quality engine for up to 10Gbps, 925-3512 Video Quality engine for up to 10Gbps conversational video traffic; Access: Enables support for Advanced Access networking protcols such as DHCP for IP address acquisition, DHCP Server, PPP, L2TP and IPsec; Security: Enables support for a collection of vulnerabilities and malware attacks with 1-year subscription service and DDoSv2; Note StreamBlaster, H.323, Bulk SIP & MGCP and DDoSv2 are supported on selected load modules. Page 5
Appliance Licenses: 925-6112 IxLoad PerfectStorm ONE VIDEO, Software Bundle, Layer 4-7 Performance Test Application Includes: RTSP, IPTV, Video-ADVANCED FLASH, APPLE HLS, Silverlight, Adobe HDS, MPEG-DASH 925-3189 Video Quality VQMON engine for up to 10Gbps 925-3193 TCP VQ - Video quality for TCP video traffic for up to 10 Gbps 925-6321 IxLoad, PerfectStorm ONE Multiplay, Software Bundle, Layer 4-7 Performance Test Application; Data, Voice, Video, Access, VPN and Storage bundle for PerfectStorm ONE appliances. Includes: 925-6111 IxLoad PerfectStorm ONE DATA, 925-6112 IxLoad PerfectStorm ONE VIDEO, 925-6113 IxLoad PerfectStorm ONE VOICE, 925-6114 IxLoad PerfectStorm ONE AUTH, 925-6115 IxLoad PerfectStorm ONE VPN/ACCESS, and 925-6116 IxLoad PerfectStorm ONE STORAGE IxVM License: 939-9513 IxVM, IxLoad Tier-3 FLOATING Subscription license. Includes the following IxLoad protocols supported on IxVM for the purchased term (List price is per unit, per year). HTTP, HTTPS, FTP, DNS, DHCP, LDAP, TFTP, Radius, Mail (IMAP, POP3, SMTP), Storage, IxLoad-Attack and AppLibrary. REQUIRES: License term to be specified (MUST be purchased in multiples of years). Enables 1Gig throughput per unit. INCLUDES IxVM Software Platform Framework, FLOATING. Enables support for IxVM IxServer This material is for informational purposes only and subject to change without notice. It describes Ixia's present plans to develop and make available to its customers certain products, features and functionality. Ixia is only obligated to provide those deliverables specifically included in a written agreement between Ixia and the customer. Page 6