Validation & Verification of Safety Critical Systems in the Aerospace Domain. Workshop: Teststrategien und -techniken für Onboardsysteme in der Luft- und Raumfahrt 07.10.2008 Dipl. Ing. Jörg Hofmann 1
Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 2
Challenges Aerospace. 1990 s - 00 s 2000 1970 s - 80 s 1 GB 1958 1950 s - 60 s Radar Comm NAV Independent Avionics 64 KB DEDICATED SUBSYSTEMS Digital Fire Control/NAV PT-PT Wiring Mechanically Controlled Sensors/FLT Controls/ Displays Crew-Dominated Operation Radar Comm NAV Mission Mission Federated Avionics 1 MB FEDERATED SUBSYSTEMS Functionally Integrated Data Processing -NAV/WD/Air Data Sensors -Flight Control Beam Steering Sensors Fly By Wire Dedicated Digital Processing Crew-Assisted Operations - Weapon Delivery - Automated TF/TA - EW Response Comm EW Radar Integrated Avionics 100 MB INTEGRATED SYSTEMS Aircraft-Wide Information Integration - Sensors/Stores/ Vehicle/ Propulsion Modular Electronics Massive Data Bases - Terrain, Threat Digital Sensor Processing - Sensor Fusion - Hyperspectral Imaging Integrated Diagnostics/ System Fault Tolerance System Data Security Limited UAV Autonomy SYSTEM of SYSTEMS Platform Exploitation of Global Information - Information Mining - At-A-Distance Reconfiguration Autonomous Vehicle Emphasis - Air & Space Air Crew/ Ground Crew Monitoring & Management Automated Functions - ATR (Multi-Sensor) - Failure Prognostics - Route/ Sensor/ Weapon/ Vehicle Coordination - Bistatic Sensing (Air/ Space) - Threat Evasion Source: AFRL 3
Challenges Automotive. Elektronische Einspritzung Check Control Geschwindigkeitsregler Zentralverriegelung... Elektronische Getriebesteuerung Elektronische Klimaregelung ASC Anti Slip Control ABS Anti Blocking System Telefon Sitzheizungssteuerung Autom. Spiegelabblendung Navigationssystem CD-Wechsler ACC Active Cruise Control Airbags DSC Dynamic Stability Control Adaptive Getriebesteuerung Rollstabilisierung Xenon Licht BMW Assist RDS/TMC Spracheingabe Notruf ACC Stop&Go BFD ALC KSG Internet Portal GPRS, UMTS Telematics Online Services Blue-Tooth Car Office Local Hazard Warning Integrated Safety System Steer/Brake-By-Wire I-Drive Spurhalteunterstützung Personalisierung Force Feedback Pedal 1970 1980 1990 2000 4
Effort. System Definition System Decomposition HW Component Requirements Test Bed Requirements System-SW- Requirements HW Component Design Test Bed Design System-SW- Design Test Bed Implementation System-SW- Implementation HW Component Implementation Test Bed Qualification Test Bed Integration System-SWintegration System Level System-SW-Test HW Component Test Test Bed Domain HW Component Integration SW Domain Qualificat. Test System Test Integration Test 5
Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 6
Fields of Activities. Support Standardization Information management Safety and certification Requirements analysis Validation Stakeholder reqs. definition Trade studies Architectural design Modeling and simulation SW design Implementation Integration Configuration management Tooling Verification Project planning Project assessment Risk management Technical Project control Decision making process Project 7
Fields of Activities. Support Standardization Information management Safety and certification Requirements analysis Validation Stakeholder reqs. definition Trade studies Architectural design Modeling and simulation SW design Implementation Integration Configuration management Tooling Verification Project planning Project assessment Risk management Technical Project control Decision making process Project 8
Process. System Design&Implementation Contract System Function Item Spec Val Spec Val Spec Val Spec Val Code System Test&Integration Int Ver Int Ver Int Ver Int Ver Int 9
What to Deal With - Methods of Validation and Verification. Simulation Analysis, engineering judgement Similarity of requirements or design Demonstration, prototyping or mock-up Reviews or audits Inspection Test Operational trials Flight test Aircraft ground test System integration test HW-SW integration test (Bench) SW-SW integration test Coding unit test 10
Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 11
Let s Find an Optimized V&V Strategy. From Theory. To Experience 12
Requirements on an Optimized V&V Concept. Sufficient Test Coverage Sufficient Evidence of the System Safety Limitation of the Effort to Reasonable Budgets Consideration of the Project Development Phase 13
Elements of a Good V&V Strategy. Verify requirements &functions early Establish automated tests early Coordinate all test stages Use data bases and generators Realize the coherence of functions and test Realize end to end tests 14
Essential Columns of the V&V Strategy Focusing. Automate Tests Adequate to the Project Use the specific advantages of each test stage 15
Optimized Strategy (1). Use the specific advantages of each test stage Verify requirements&functions early Safe Money Realize end to end tests Coordinate all test stages Realize the coherence of functions and test Assure user's needs Integrated test concept Coverage and traceability 16
Optimized Strategy (2). Automate Tests Adequate to the Project Find out the project adequate automation method Establish automated tests early Use data bases and generators Reduction of initial and repetitive effort Reduction of repetitive effort Reduction of document effort 17
Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 18
Experience.. To Experience 19
Effort. System Definition System Decomposition HW Component Requirements Test Bed Requirements System-SW- Requirements HW Component Design Test Bed Design System-SW- Design Test Bed Implementation System-SW- Implementation HW Component Implementation Test Bed Qualification Test Bed Integration System-SWintegration System Level System-SW-Test HW Component Test Test Bed Domain HW Component Integration SW Domain Qualificat. Test System Test Integration Test 20
System Level All test stages perform moding and display tests (redundantly!) Bad Case. 21 Poor validation of requirements &design
System Level All stages perform primarily tests adequate to their specific capabilities (with controlled redundancy) SW Domain HW Domain Good Case. Early validation End to end test Test automation 22 Early validation of requirements&functions
Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 23
Example Early Verification - Terrain Referenced Navigation. 24
Example End-to-End Test EW Chain. Missile Control Emitter Locator Computer Sensor Core Computer Mission Computer EWTactical Display Navigation Flight Control Subsystem Subsystem 25
Two Automation Concepts. Requirements Model based tests e.g. UML Code generation Pool of automatic tests Manual tests Capture and replay 26
Vielen Dank für Ihre Aufmerksamkeit! 27