NI Automotive Day (July 12th, 2006) Quality Management by Functional Testing. Jürgen Wölfle, Continental TEMIC

Transcription

1 NI Automotive Day (July 12th, 2006) Quality Management by Functional Testing Jürgen Wölfle, Continental TEMIC

2 Overview Introduction Requirements Engineering Test Process Test Automation 2 / Jürgen Wölfle / Continental AG

3 Overview Introduction Organisation Continental Temic Quality Management by Functional Testing Requirements Engineering Test Process Test Automation 3 / Jürgen Wölfle / Continental AG

4 Introduction: The Continental Corporation Division Structure Total Divisions Continental Corporation Automotive Systems Passenger and Light Truck Tires Commercial Vehicle Tires ContiTech ** Sales (BN ) 13,8 5,2 4,4 1,3 2,9* Employees * After consolidation of Phoenix for Nov. and Dec **Only Europe Database: Actual / Jürgen Wölfle / Continental AG

5 Introduction: Automotive Systems Business Structure Electronic Brake & Safety Systems (EBS) Foundation Brakes Brake Actuation Chassis & Powertrain Body Electronics Electric Drives Aftermarket 5 / Jürgen Wölfle / Continental AG

6 Introduction: BU Body Electronics - Matrix Organization Basis Development Mechanical Design Advanced Development Cross Section Funct. Customer Center DC Competence Center I Competence Center II Competence Center III Competence Center IV CC BMW CC VW-Group CC Europe CC Tier1-Customers Central Control / EE Architecture Door Control / PWR Closing Seat Control Security Systems Marketing & Business Development Regional Center USA RC Japan / Korea RC China Controlling Purchasing Quality Human Resources 6 / Jürgen Wölfle / Continental AG

7 Overview Introduction Organisation Continental Temic Quality Management by Functional Testing Requirements Engineering Test Process Test Automation 7 / Jürgen Wölfle / Continental AG

8 Introduction: Quality of a Product Requirements vs. Performance requirements on product performance of product high quality product customer: receives exactly what expected and is satisfied supplier: the effort correlates with the requirements high quality product and more customer: receives more than he has expected and is satisfied supplier: the effort is greater than necessary ( development costs) substandard product (bad quality) customer: receives less than expected and is unsatisfied supplier: the ressources are to less to realize the requirements requirements not clarified product not fully developed requirements and product not clarified 8 / Jürgen Wölfle / Continental AG

9 Introduction: About Quality Definition of Quality (ISO 8402) The totality of characteristics of an entity that bear on ist ability to satisfy stated and implied needs. Definition Qualität (DIN ) Qualität ist die Gesamtheit von Eigenschaften und Merkmalen eines Produkts oder einer Tätigkeit, die sich auf die Eignung zur Erfüllung gegebener Erfordernisse beziehen. The satisfaction of implied needs points to the analysis of requirements related on the product and can only be examined in testing, because 9 / Jürgen Wölfle / Continental AG

10 Introduction: About Quality Definition of Test (ISTQB) The process consiting of all life cycle activities of products to determine that they satisfy specified requirements, to demonstrate that they are fit for purpose and to detect defects. Definition Test (Spillner & Linz): Test(en) bezeichnet den gesamten Prozess, ein [Testobjekt] auf systematische Weise auszuführen, um die korrekte Umsetzung der Anforderungen nachzuweisen und um Fehlerwirkungen aufzudecken. The question of testability is directly addicted to the requirements analysis. Therefore the test process is belonging to the requirements engineering. 10 / Jürgen Wölfle / Continental AG

11 Introduction: About Quality Quality = Fulfillment of Requirements A not specified requirement prevents quality A not fulfilled requirement decreases quality Testing is a process of quality assurance 11 / Jürgen Wölfle / Continental AG

12 Introduction: Quality Assurance by Functional Testing Needs for a Satisfying Quality of a Product complete listing of all requirements on the product verification and detailled analysis of requirements and implementation in product testability of requirements specification of tests verification / test of product concerning requirements 12 / Jürgen Wölfle / Continental AG

13 Introduction: About Quality Another Definition of Quality from the View of a Supplier quality is, when the customers come back not the products 13 / Jürgen Wölfle / Continental AG

14 Overview Introduction Requirements Engineering Test Process Test Automation 14 / Jürgen Wölfle / Continental AG

15 Requirements Engineering: Initial Situation Customer: does not know what he wants but when he wants it knows perhaps what he wants but does not express it or does not know how to express knows (after delivery) if the product is the way he expected it to be Supplier: is not able plan accurately because of the lack of knowledge on what exactely has to be developed is forced to do incremental development processes due to the developing requirements Goal: at the contracted date stipulated, the customer is getting exactly what he had in mind at the start of the project supplier: the project was well planned and the costs efford was the way it was expected 15 / Jürgen Wölfle / Continental AG

16 Requirements Engineering: Scope Creep The Creeping Enlargement of the Product Scope extensions out of control not paid changes and enlargements paid changes and enlargements approved change requests reduced functionallity (i.e. because of lack of time) realized (original) functionality Not realized functionality customer spec. development finished product 16 / Jürgen Wölfle / Continental AG

17 Requirements Engineering: Definition RM & E Requirements elicitation, documentation and review Management of requirement changes (impact trace analyis) and maintanance of their specification 17 / Jürgen Wölfle / Continental AG

18 Requirements Engineering: Actual Situation User Requirements OEM DBs all data (requirements) within supplier requirements DB are in structured, textual (informal) form XML RIF supplier DB DOORS user requirements system requirements HW / SW requirements configurationand changemanagement OEM given (base) models part of product OEM given models part of test environment 18 / Jürgen Wölfle / Continental AG

19 Requirements Engineering: Data Model Structure inside Requirements Database User Requirements (USER) System Validation Block (SVAL) System Requirements (SYSR) SW Validation Block (SWVAL) SW Requirements (SWRQ) HW Requirements (HWRQ) HW Validation Block (HWVAL) User Requirements Product System Requirements SW Requirements Software Hardware Test Specification 19 / Jürgen Wölfle / Continental AG

20 Requirements Engineering: Data Model (complete) User Requirements System Req SW Req Test Specification Test Coverage 20 / Jürgen Wölfle / Continental AG

21 Requirements Engineering: Data Model (integrated in V) Just another Shape (Structure inside Requirements Database) User Requirements (USER) User Validation Block (SVAL) REQ DB System Requirements (SYSR) HW Requirements (HWRQ) SW Requirements (SWRQ) System Validation Block (SVAL) HW Validation Block (HWVAL) SW Validation Block (SWVAL) User Requirements System Requirements SW Requirements Test Specification product Software Hardware 21 / Jürgen Wölfle / Continental AG

22 Requirements Engineering: Actual Problems all requirements are structured text structured text and especially refinements in structured text are not easy to handle maybe more efficiency in using more formal formats at system level and below (e.g. UML) attempts with different tools (with no unified interfaces) 22 / Jürgen Wölfle / Continental AG

23 Overview Introduction Requirements Engineering Test Process Test Automation 23 / Jürgen Wölfle / Continental AG

24 Test Process: Integrated Management System (IMS) The IMS was introduced 2004 and meets the following standards ISO 9000:2000 TS (QS VDA 6.1) EG-ÖKO-Audit ISO Guidelines MM Management Manual PD Process Directives WI Work Instructions Supporting Documents Records, Notes, Reports, Forms, Statistics, Evaluations etc. 24 / Jürgen Wölfle / Continental AG

25 Test Process: Existing Processes at Continental Temic Business Process 25 / Jürgen Wölfle / Continental AG

26 Test Process: Existing Processes at Continental Temic Product Development (PD 43001) 26 / Jürgen Wölfle / Continental AG

27 Test Process: Existing Processes at Continental Temic Software Engineering (PD 43002) 27 / Jürgen Wölfle / Continental AG

28 Test Process: Existing Processes at Continental Temic Product Development Software Engineering 28 / Jürgen Wölfle / Continental AG

29 Test Process: V - Model Integration of Requirements Engieering and Test Engineering User Requirements (USER) System Validation Block (SVAL) Test List (man. Tests) Test Result REQ DB System Requirements (SYSR) HW Requirements (HWRQ) SW Requirements (SWRQ) User Requirements System Requirements SW Requirements Test Specification product System Validation Block (SVAL) HW Validation Block (HWVAL) SW Validation Block (SWVAL) Software Hardware Test Skript Test List (man. Tests) Test Skript Test List (man. Tests) Testmanagement DB test execution produkt entering test phases Test Result Test Result Test Result Test Result 29 / Jürgen Wölfle / Continental AG

30 Test Process: V - Model Test Engineering Issues in V - Modell System Validation Block (SVAL) Test List (man. Tests) Test Result product System Validation Block (SVAL) HW Validation Block (HWVAL) SW Validation Block (SWVAL) Software Hardware Test Skript Test List (man. Tests) Test Skript Test List (man. Tests) Testmanagement DB test execution produkt entering test phases Test Result Test Result Test Result Test Result 30 / Jürgen Wölfle / Continental AG

31 Test Process: Motivation TPI Automotive IEEE 829 Automotive Spice ISTQB comparison & harmonisation V-model is not considering all issues of the test process CAS test prozess build-up of test environment create a closed process model only on test issues ( outsourcing of testing) describe all activities and roles in testing 31 / Jürgen Wölfle / Continental AG

32 Test Process: Excluded from V - Modell Tool Support 32 / Jürgen Wölfle / Continental AG

33 Overview Introduction Requirements Engineering Test Process Test Automation 33 / Jürgen Wölfle / Continental AG

34 Test Automation Integration of Requirements Engieering and Test Engineering (tools view) System Validation Block (SVAL) HW Validation Block (HWVAL) SW Validation Block (SWVAL) instruction set (platform Independent) DB configuration-mm change-mm Requirements-MM Baselining and Traceability requirements vs. test cases test results change requests test specification test script test result DB testmanagement test script XML TAS to test automation 34 / Jürgen Wölfle / Continental AG

35 Test Automation: Two (Three) Main Plattforms of Test Execution One Unique Instruction Set for Describing Tests no matter what plattform Differences are Handled by Configuration Files open loop test environment XML script TestBench test specification test script HIL test environment TAS (script) TestStand wrapper test description for manual tests Test Center NI - hardware TestStand test list dspace 35 / Jürgen Wölfle / Continental AG

36 Quality Management by Functional Testing: End of Presentation Questions? Questions? Questions? Questions? Questions? 36 / Jürgen Wölfle / Continental AG