World Of Technology and Science 02 10 2014 Hoe stel je een testplan op Dora Deboeure Manager Product Validation dora.deboeure@barco.com http://www.barco.com
1. Inleiding / Barco product gamma 2. Hoe en wanneer een testplan wordt opgesteld 3. Wat wordt erin afgechecked 4. Test fazes vs design fazes: In welke fazes van het design proces test je wat van je ontwerp of product. 5. Hoe heeft deze testing zijn effect op design keuzes, supplier selection, early field returns etc
Business areas & markets Projection Healthcare Advanced Visualization Defense & Aerospace Cinema Venues & Hospitality Healthcare OEM Siemens GE, Utilities, Security & Surveillance Corporate AV
Technology Display technology Projection technology Connectivity Collaboration
Cinema Product portfolio Projection Sound in 3D Digital signage CineCare 2K and 4K resolution Auro 11.1 by Barco Theater infotainment Training and service
Venues & Hospitality Product portfolio Projection LED Lighting Image processing Rental and staging Full range of LED tiles and creative LED for rental and fixed applications Digital lights Automated luminaires Lighting controllers Presentation switchers Matrix switchers
Where will you find us? Car shows Concerts Shopping malls Conference & meeting rooms Sport stadiums Houses of worship Branding
Healthcare Product portfolio Mammography displays Diagnostic displays Clinical review displays Digital OR systems Point-of-care solutions High-resolution (>5MP) grayscale displays Nio and Coronis display families for image creation and interpretation Reviewing diagnostic images and clinical information Nexxis digital OR and highaccuracy surgical displays to meet ever-changing imaging requirements Smart bedside terminals and mobile tablets to enhance patient comfort and clinical efficiency Nexxis digital OR* MediCal QAWeb
Corporate AV Product portfolio V-Series 0 & M-Series LDX-Series Corporate AV projectors LED display solutions indoor & outdoor installations fixed install & rental applications LED-lit rear-projection video walls LCD technology with LED backlights 3D projectors ClickShare Single-click presentation & collaboration system
Utilities, Security & Surveillance Product portfolio Rear-projected video walls LED-based Lamp-based LCD video walls Near-seamless LCD LCD displays Networked visualization platform Control room design services
Defense & Aerospace Product portfolio ATC displays Rugged displays Cockpit displays Simulation systems Main displays Auxiliary displays Display servers Consoles Computers Workstations Control display units Mission displays Flight critical displays Modular software platform 360 dome displays Mini-domes Customized simulators
Testplan establishment Master Testplan template TSM template MID template D&A template DC template VLS Indoor template SIM template DS template VLS Outdoor template Divisional Testplan Templates Project Testplans DP2K-32B Testplan DP2K-23B Testplan DP2K-19B Testplan..
What is the Testplan? The Testplan: Contains a list of tests that will be executed during the development PLC phases according to well defined test procedures Provides the traceability between the product requirement and the applied test procedure Provides evidence between the applied test procedure and the test result Provides evidence of approval between R&D, NPI management and Product validation Provides test statistics that will serve for KPI calculation Functional testing is excluded from the testplan. Should be executed separately by R&D!
15 Product Validation challenges
Pro-active R&D Quality Management track To increase our product reliability by improved confidence and qualification testing Target: To reach First Pass Yield on Qualification Tests of 80 % by end 2011 and 90% by end 2012 Reliability is maintaining quality over time (MTBF hours)
Confidence testing Lower Operating Upper Operating Limit Operational Specs Limit Confidence Qualification Confidence Stress Reach specification (solve each failure) Reach confidence margins (solve each failure)
Confidence testing Stress Stress Failure Failure Analyze all malfunctions & failures Know the limitations of the equipment Overstress with regards to qualification testing Stress is indicated in the testplan Increase stress Increase stress Improve Improve every round every round Analyse Analyse Lower Operating Limit Upper Operating Limit Stress
Qualification testing Qualification testing Implement lessons learned from previous confidence tests and analyses Qualification should be a walk in the park!
How Introduction of a formal Standard TestPlan per product Proven allignment between requirements and TestPlan Improve confidence & qualification testing on products Set-up for KPI monitoring Coaching of the testplan implementation Training plan for engineering
Testplan establishment Master Testplan template TSM template MID template D&A template DC template VLS Indoor template SIM template DS template VLS Outdoor template Divisional Testplan Templates Project Testplans DP2K-32B Testplan DP2K-23B Testplan DP2K-19B Testplan..
What is the Testplan? The Testplan: Contains a list of tests that will be executed during the development PLC phases according to well defined test procedures Provides the traceability between the product requirement and the applied test procedure Provides evidence between the applied test procedure and the test result Provides evidence of approval between R&D, NPI management and Product validation Provides test statistics that will serve for KPI calculation Functional testing is excluded from the testplan. Should be executed separately by R&D!
Testplan syntax CQTP_DIV_ProjectName_ProjectNr.xls CQTP: Confidence / Qualification Test Plan DIV: SIM, VLS, DC, DS, MID, DEF, AVD, TSM ProjectName: fi. DP2K-32B or FLX24 or SIM10 etc ProjectNr: E01100166 or E092N0041 or E01300226
Who completes / reviews / approves the Testplan? A Testplan template will be established for each division NPI Project Manager Creation of project/product specific Testplan Testplan owner R&D Manager Approval of the Testplan PVG Manager Approval of the Testplan
TestPlan Views
TestPlan (Technical Specification part / Plan View) (1) Completed by NPI Project Manager (2) Completed by PVG
TestPlan (Technical Specification part / Plan View) No rows shall be deleted! If a test should not be executed => Type NA in Test Resp. column Provide justification why test will not be executed Rows for additional tests may be added
TestPlan (Technical Specification part / Plan View) Extra margin during confidence testing Specific margins are indicated in the Testplan Field marked in light green Parameters for the procedure Field marked in yellow Information / fixed parameters for the procedure Field marked in white
TestPlan (Test results part) Test responsible must complete line: Pass or Fail + Date Number of iterations until pass Remarks / itrack Nr Test report reference(s) itrack report should contain: Observed during Conf / Qual testing Test procedure reference Failure description or reference to a report Fail date + iteration number Addressed to the NPI Project Manager
TestPlan (Test Status part) Status: Based on Pass / Fail iteration information Provided for IDR / CDR and FQR Indication of First Pass Yield To be used by R&D for KPI calculation
Filtering of tests Select the tests of interest (row filter) Default = Show all tests Possibilities: Show all tests Hide all NA tests Show all R&D tests Show all PVG tests Filter works on all views for corresponding stage gates: Plan view (works on IDR, CDR & FQR) Confidence view (works on IDR, CDR) Qualification view (works on FQR) Detailed view (works on IDR, CDR & FQR) Always shows tests where test responsible column is left open (depends upon selected view -> corresponding stage gates)
Filtering Hide all Working Area for -Plan view -Detailed view
Filtering Show R&D only Working Area for -Confidence view
Filtering Show PVG only Working Area for -Confidence view
Interaction with the standard PLC Testplan status at stage gates: Confidence Testplan approved at PDR (& IDR) Qualification Testplan drafted at PDR Confidence Testplan finished and test status approved at CDR Qualification Testplan approved at CDR Qualification Testplan finished and test status approved at FQR
Testplan approval process Testplan template per division NPI Project Manager Creation of project/product specific Testplan R&D Manager Approval of the Testplan PVG Manager Approval of the Testplan Approval via meeting with R&D, PVG and QA (Assessment of the approved Testplan by QA prior to the stage gate(s))
Testplan approval process within a project Approval For Confidence testplan (PDR) Intermediate approval (IDR) For Qualification testplan (CDR)
Interaction between R&D and PVG Test results Test results at IDR/CDR/FQR To be completed by Test responsible R&D or PVG Configuration management of Testplan done on BarcoZone Editable by R&D and PVG # iterations 0 -> First pass 1 -> Pass after first iteration X -> Pass after x iterations
Interaction between R&D and PVG Status
PVG on BarcoZone Home > Corporate R&D > Product Validation Services
PVG on BarcoZone Testplan (template) location Testplan Template & Procedure Configuration management with Approval process Divisional Testplan templates Testplan approval process Project Testplans Configuration management Check-in / Check-out process (No approval flow) [When posting: Division = attribute]
PVG on BarcoZone Test procedures Test procedures Referenced in Test plan Configuration management with approval flow on BarcoZone Unique name per procedure
Testplan First Pass Yield KPI Monitoring of KPI Corrective actions Preventive actions Improvements TestPlan Design Rules / Margins Target: First Pass Yield of 80% on Qualification Tests by end 2011
Check met test lab of specificaties van hun test apparatuur uw product aankan
Questions & Answers