Validation & Verification of Safety Critical Systems in the Aerospace Domain.

Transcription

1 Validation & Verification of Safety Critical Systems in the Aerospace Domain. Workshop: Teststrategien und -techniken für Onboardsysteme in der Luft- und Raumfahrt Dipl. Ing. Jörg Hofmann 1

2 Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 2

3 Challenges Aerospace s - 00 s s - 80 s 1 GB s - 60 s Radar Comm NAV Independent Avionics 64 KB DEDICATED SUBSYSTEMS Digital Fire Control/NAV PT-PT Wiring Mechanically Controlled Sensors/FLT Controls/ Displays Crew-Dominated Operation Radar Comm NAV Mission Mission Federated Avionics 1 MB FEDERATED SUBSYSTEMS Functionally Integrated Data Processing -NAV/WD/Air Data Sensors -Flight Control Beam Steering Sensors Fly By Wire Dedicated Digital Processing Crew-Assisted Operations - Weapon Delivery - Automated TF/TA - EW Response Comm EW Radar Integrated Avionics 100 MB INTEGRATED SYSTEMS Aircraft-Wide Information Integration - Sensors/Stores/ Vehicle/ Propulsion Modular Electronics Massive Data Bases - Terrain, Threat Digital Sensor Processing - Sensor Fusion - Hyperspectral Imaging Integrated Diagnostics/ System Fault Tolerance System Data Security Limited UAV Autonomy SYSTEM of SYSTEMS Platform Exploitation of Global Information - Information Mining - At-A-Distance Reconfiguration Autonomous Vehicle Emphasis - Air & Space Air Crew/ Ground Crew Monitoring & Management Automated Functions - ATR (Multi-Sensor) - Failure Prognostics - Route/ Sensor/ Weapon/ Vehicle Coordination - Bistatic Sensing (Air/ Space) - Threat Evasion Source: AFRL 3

4 Challenges Automotive. Elektronische Einspritzung Check Control Geschwindigkeitsregler Zentralverriegelung... Elektronische Getriebesteuerung Elektronische Klimaregelung ASC Anti Slip Control ABS Anti Blocking System Telefon Sitzheizungssteuerung Autom. Spiegelabblendung Navigationssystem CD-Wechsler ACC Active Cruise Control Airbags DSC Dynamic Stability Control Adaptive Getriebesteuerung Rollstabilisierung Xenon Licht BMW Assist RDS/TMC Spracheingabe Notruf ACC Stop&Go BFD ALC KSG Internet Portal GPRS, UMTS Telematics Online Services Blue-Tooth Car Office Local Hazard Warning Integrated Safety System Steer/Brake-By-Wire I-Drive Spurhalteunterstützung Personalisierung Force Feedback Pedal

5 Effort. System Definition System Decomposition HW Component Requirements Test Bed Requirements System-SW- Requirements HW Component Design Test Bed Design System-SW- Design Test Bed Implementation System-SW- Implementation HW Component Implementation Test Bed Qualification Test Bed Integration System-SWintegration System Level System-SW-Test HW Component Test Test Bed Domain HW Component Integration SW Domain Qualificat. Test System Test Integration Test 5

6 Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 6

7 Fields of Activities. Support Standardization Information management Safety and certification Requirements analysis Validation Stakeholder reqs. definition Trade studies Architectural design Modeling and simulation SW design Implementation Integration Configuration management Tooling Verification Project planning Project assessment Risk management Technical Project control Decision making process Project 7

8 Fields of Activities. Support Standardization Information management Safety and certification Requirements analysis Validation Stakeholder reqs. definition Trade studies Architectural design Modeling and simulation SW design Implementation Integration Configuration management Tooling Verification Project planning Project assessment Risk management Technical Project control Decision making process Project 8

9 Process. System Design&Implementation Contract System Function Item Spec Val Spec Val Spec Val Spec Val Code System Test&Integration Int Ver Int Ver Int Ver Int Ver Int 9

10 What to Deal With - Methods of Validation and Verification. Simulation Analysis, engineering judgement Similarity of requirements or design Demonstration, prototyping or mock-up Reviews or audits Inspection Test Operational trials Flight test Aircraft ground test System integration test HW-SW integration test (Bench) SW-SW integration test Coding unit test 10

11 Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 11

12 Let s Find an Optimized V&V Strategy. From Theory. To Experience 12

13 Requirements on an Optimized V&V Concept. Sufficient Test Coverage Sufficient Evidence of the System Safety Limitation of the Effort to Reasonable Budgets Consideration of the Project Development Phase 13

14 Elements of a Good V&V Strategy. Verify requirements &functions early Establish automated tests early Coordinate all test stages Use data bases and generators Realize the coherence of functions and test Realize end to end tests 14

15 Essential Columns of the V&V Strategy Focusing. Automate Tests Adequate to the Project Use the specific advantages of each test stage 15

16 Optimized Strategy (1). Use the specific advantages of each test stage Verify requirements&functions early Safe Money Realize end to end tests Coordinate all test stages Realize the coherence of functions and test Assure user's needs Integrated test concept Coverage and traceability 16

17 Optimized Strategy (2). Automate Tests Adequate to the Project Find out the project adequate automation method Establish automated tests early Use data bases and generators Reduction of initial and repetitive effort Reduction of repetitive effort Reduction of document effort 17

18 Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 18

19 Experience.. To Experience 19

20 Effort. System Definition System Decomposition HW Component Requirements Test Bed Requirements System-SW- Requirements HW Component Design Test Bed Design System-SW- Design Test Bed Implementation System-SW- Implementation HW Component Implementation Test Bed Qualification Test Bed Integration System-SWintegration System Level System-SW-Test HW Component Test Test Bed Domain HW Component Integration SW Domain Qualificat. Test System Test Integration Test 20

21 System Level All test stages perform moding and display tests (redundantly!) Bad Case. 21 Poor validation of requirements &design

22 System Level All stages perform primarily tests adequate to their specific capabilities (with controlled redundancy) SW Domain HW Domain Good Case. Early validation End to end test Test automation 22 Early validation of requirements&functions

23 Structure. Challenges in Aerospace and Automotive Fields of Activities V&V Strategy Theory Requirements Elements of the Strategy Optimization V&V Strategy Experience Effort Bad Case Good Case Example Early Verification Example End-to-End Test 2 Automation Concepts 23

24 Example Early Verification - Terrain Referenced Navigation. 24

25 Example End-to-End Test EW Chain. Missile Control Emitter Locator Computer Sensor Core Computer Mission Computer EWTactical Display Navigation Flight Control Subsystem Subsystem 25

26 Two Automation Concepts. Requirements Model based tests e.g. UML Code generation Pool of automatic tests Manual tests Capture and replay 26

27 Vielen Dank für Ihre Aufmerksamkeit! 27