T16. Digital TV Testing - Zero Tolerance. Sally Drew. Presentation Paper Bio Return to Main Menu. Thursday, Nov 11, 1999 P R E S E N T A T I O N

Transcription

1 Presentation Paper Bio Return to Main Menu P R E S E N T A T I O N T16 Thursday, Nov 11, 1999 Digital TV Testing - Zero Tolerance Sally Drew International Conference On Software Testing, Analysis & Review NOV 8-12, 1999 BARCELONA, SPAIN

2 Digital TV Testing - Zero Tolerance TesCom UK SST 1

3 Objectives How do WEB technologies perform in the DTV environment? Why are there such high quality standards in Digital TV applications? Approach used Lessons learned. What would we do differently? 2

4 Introduction to the Projects Application Development Testing EPG (Electronic Programming Guide) OLCS (Online Client Services) Web Site Testing RPWS (Re Purpose Web Site) Set Top Box Acceptance Testing 3

5 Who is Involved Cable & Wireless Communications Liberate PACE Andersens Consulting TesCom 4

6 System Architecture World Head End Transmission STB Internet User data server Application server Translation & Proxy Server OOB TCP/IP EPG TV Navigator Data Provider (Tvinfo server) Schedule Importer Nagra Cond. access In band MPEG2 DVB/SI VxWorks H/W 5

7 End to end transaction Translation server User data server Internet Proxy 6

8 Why such low tolerance to errors? To the users this is a TV deliverable and modern TV stability standards will apply Move from Computer geeks to real people as customers 14 million users simultaneously hit by system crash 7

9 Test Issues Integration environment Extremely dynamic Emphasis on: Market Deployment / Market Differentiation Catalysts For Change: Technology Marketing & Branding Usability 8

10 Application Development Test Approach Requirements/Storyboards Document Maintenance Test Goals Test Management tools Test Execution Tight control of CM 9

11 Approach Set top box acceptance test HTML 3.2 and JavaScript 1.1 DTV extensions 10

12 Approach Web Sites DVT tests Aligned text Aligned graphic Text/background contrast Colours Selection box visibility over background Technologies used Site organisation Navigation JavaScript Comfortable input Font size Text in graphics Text wrapping Link identification Performance Unsupported technology Frames Image maps 11

13 WEB Sites on a TV? Viewed on a PC Viewed on a TV 12

14 Automation aspects Test Management Automating test execution? Operational support and regression Client performance testing Emulated environment Automating Infra-red signals 13

15 Lessons Rapidly changing environment Wide ranging inputs and influences What would we do differently? Be Pragmatic Be Flexible Be Disciplined (Continually Retesting) Be Pro Active Drive Issues Back Through Development & Design Teams 14

16 Good News and Not So Good News! Not so good news Market presence, timing and features have changed the focus of delivery Rapid development reduces test coverage and provide less information for testers up front Changed role of quality gate to quality status Good news Testers have to be involved in every stage Better and closer relationships with developers 15

17 Glimpse into your TV future Purchasing Interactive, multi-player games Direct your own TV experience 16

18 Sally Drew Sally has 10 years experience as a specialist tester, including development of Project Management skills and Systems Analysis techniques. Prior to joining TesCom she was Test Manager for an innovative multi-million dollar OMT based e-commerce system using COM and DCOM technology. Prior to that she managed the testing of major CASE, Configuration and Object Repository Tools. Since joining TesCom she has overseen the development of specialist methods for testing multimedia products both Internet/Intranet based and CD-ROM. She believes that the structured, disciplined testing approaches used in non-multimedia development should be developed and applied to all media.