PBS on Amazon. Jon Brendsel Vice President, Products

Transcription

1 PBS on Amazon Jon Brendsel Vice President, Products

2 Iconic Brands

3 A little bit about PBS General Audience, PBS Kids, PBS Education We are not NPR! Member organization 165 dues paying stations Dues are used for License broadcast and digital content Build distribution infrastructure Producers are not owned by PBS Station sponsored/owned (e.g. Frontline) Independent (Children s Television Workshop)

4 #1 in Unique Visitors Among major networks PBS sites 8555 ABC.com 5977 CBS.comPBS sites 5338 NBC.com 5266 PBS.org ABC.com (no Kids) 4566 FOX.com 3073 CWTV.com CBS.co m1120 NBC.com 0 2,000 4,000 6,000 8,000 10,000 PBS.org (no Kids) FOX.com CWTV.com (comscore MediaMetrix, July 2011)

5 Fun With Numbers Facebook Fans: ~ 1M Unique visitors: 18M/mo Visits: 37M/mo Page views: 367M / mo Video streams: 93M/mo Mobile Apps 27% of hours watched, 11% of streams

6 Traditional Big Iron infrastructure Three Years Ago Life before Amazon Ping Power and Pipe managed by PBS IT Applications (Apache and higher) managed by PBS Developers No DR Fixed bandwidth Shared Hosting Environment Traditional three-tier architecture Little isolation between applications / producers Limited freedom to innovate No real product development capability Small team of web technologists Projects built by outside design build firms No product lifecycle management No shared services

7 Three Years Ago Life was Painful Routine outages, lots of downtime Multiple single points of failure Perpetual state of emergency No application/producer isolation One mistake impacts everyone Producers hated the restrictions Long lead times to get new hardware Limited long term product planning Ready-Fire-Aim Poor morale Lack of confidence in technology organization

8 Today All New Applications / Producers -> Ec2 Hosted producer sites PBS.org National Portal Video distribution platform UUA (Registration and Profiles) Bento (NG templated publishing system) TV Schedules Other: tools, PBS Education, PBS Kids, dev, staging, etc.

9 A Birds Eye View ~270 EC2 machines 75 ELBs 260 Elastic IPs 5 AWS accounts 52 RDS databases 608 EBS volumes many S3 buckets 19 COVE Cloudfront distributions

10 Technology Stack Linux Centos 5.2 (32 and 64-bit) Python/Perl/PHP Webserver: Apache DB: Mysql (RDS and hosted) Caching: memcached, SOLR File storage: S3, EBS Job management: SQS, celery Transcoding: Zencoder service Configuration management: Rightscale

11 Rightscale Manage 5 AWS accounts Performance monitoring and alerting (collectd) Configuration management of 5 shared templates Easy provisioning of most AWS services Authentication and authorization for ~30 employees

12 Hosted Producer Sites

13 Hosted Producer Sites Dedicated VPS-style hosting 43 machines (mostly m1.small) LAMP templates Nightly backups (EBS or S3) Isolation from other producers / systems VPS style SLA Provides freedom to innovate

14 PBS Video for ipad Launched Nov 10

15 PBSKids Video for ipad Launched April 11

16 PBS Video for iphone Launched Jan 11

17 Local/National Video Portals

18 CDN video.pbs.org Next Generation Video Platform Limelight (static http) Cloudfront (rtmp, HTTP pseudo streaming (Apple HLS) Presentation Layer Manually scaled array (4 medium) ELB load balancing S3 application server template Caching Layer (memcached) Memcached

19 video.pbs.org Next Generation Video Platform (cont.) Service Layer ( REST API) Manually scaled array (m1.medium) ELB load balancing S3 application server template DB layer RDS Master (m1.medium) RDS Slaves (4 x db.xlarge) HAProxy load balancing

20 PBS Video for Mobile iphone and ipad Compiled Apps PBS General Audience ipad and iphone Apps PBS Kids ipad App (iphone on the way) Video API VTS (Video Transcoding Service) EC2 instance m1.small API wrapper around Zencoder Transcoding from MP4 to Apple HLS for ios distribution Application hosted on PBS App Server template (Ec2) with RDS DB File storage in in S3 Distribution via Cloudfront CDN

21 Video Transcoding Service Transcoding for multiple distribution endpoints Ingest: Mezzanine quality (5 mpbs) Outputs: Current: Apple HLS for ios distribution Future: web output, + partners (itunes, Amazon, etc.) API wrapper around Zencoder Application: 1 App ServerEC2 instance with RDS DB File storage in in S3 Distribution via Cloudfront CDN

22 Zencoder Encoding needs Today: Mobile only Soon: All web outputs Powerful API Fast encoding times Based on FFMPEG Strong support for Apple ios HLS (HTTP Live Streaming) Reliable support for Amazon S3 storage

23 Development / QA / Staging Mirrored environment and topology Load testing Demos & training On demand Bamboo-based continuous integration

24 Takeaways & Lessons Learned Vastly improved uptime Infrastructure: from an obstacle to an asset DevOps Build applications around infrastructure Design for failure Easy can become expensive PBS has proliferating infrastructure Now need to invest in efficiency