Evaluation of Model-Based Testing in 3G Mobile Networks Software Development. Agile and Automated Testing Seminar

Transcription

1 Evaluation of Model-Based Testing in 3G Mobile Networks Software Development Agile and Automated Testing Seminar

2 Agenda Introduction Tested software (Mobile Media Gateway) System Architecture System adapter UML Test Model of IMRA Study on Model Based Testing Questions Oy LM Ericsson Ab 2

3 Introduction Thesis subject: Evaluation of Model-Based Testing in 3G Mobile Networks Software Development Academic history Tampere University of Technology Master of Science in Communications Engineering Boston University Bachelor of Science in Computer Systems Engineering Soccer Professional experience Oy LM Ericsson Ab, Finland January Present Nokia Mobile Phones, Finland General Electric Corp., USA Oy LM Ericsson Ab 3

4 Thesis work System Under Test (SUT) IMRA (Interactive Messaging Resource Access) Test Tool (Conformiq Software Test Generator) UML state diagrams XML Test Logs Research work 1. Model-based testing tool integrated to Real-Time Operating System (SimCello) 2. State diagram test model of IM RA s basic use case 3. Do a qualitative study on Model-based testing Oy LM Ericsson Ab 4

5 Mobile Media Gateway Control Layer Signaling Payload MSC Server HLR GMSC Server TSC Server WCDMA WCDMA MGw/ SGw MGw/ SGw MGw/ SGw WCDMA WCDMA GSM GSM MGw/ SGw Backbone network TDM, ATM, IP MGw/ SGw GSM GSM ISDN/PSTN ISDN/PSTN MGw/ SGw MGw/ SGw MGw/ SGw ISDN/PSTN ISDN/PSTN Layered architecture Connectivity Layer Control Layer signaling information Connectivity Layer data transfer Oy LM Ericsson Ab 5

6 Interactive Messaging MSC (Media Gateway Controller) 4. Number you dialled can t be reached. Media Gateway CPF (Control Plane Functions) O&M DSP IM RA 1. Send Request 2. Configuration 3. Play Request Oy LM Ericsson Ab 6

7 System Architecture Library System Adapter Test Generator (CTG) TCP/IP C++ CTGTestPort TITAN (TTCN-3 RTE) Datum Signal OSETestPort OSE Delta Signal Real-Time Operating System IMRA System Under Test Oy LM Ericsson Ab 7

8 System Adapter WIN Solaris OSE CTG CTG Adapter CTG TestPort TITAN RTE OSE TestPort OSE Gateway IM RA CTGAdapter.cc Receive() (2) vector<osesignal> incomingmessages; Send () (5) Generate Datum Send to CTG CTGTestPort.cc mctgadapter Run() (1) Install_Handler () Event_Handler () (3) TITAN Polling 0,5 s mctgadapter Send () (4) Oy LM Ericsson Ab 8

9 UML Test Model of IMRA (Interactive Messaging Resource Access) IMRA Client Configuration Activate IMRA Oy LM Ericsson Ab 9

10 Educational Test Model While (this is true) { if (m_singleeventloopthead.ptr(true)) { send(m_ncolor = = GRAY){ m_ncolor = WHITE; } if { send(m_ncolor = GRAY_BRUSH); } } Wait for Signal 1 /env: signal(int1, int2, int3) Ready singleeventloop(?varaible,?variable2) 1) What is the test coverage of MBT? 2) Learning benefits? 3) Implementation? Oy LM Ericsson Ab 10

11 Educational Test Model 1. Group Study: 15 professional testers Written questionaire Group interview 2. Independent Consultant Expertise in software testing 3. M-MGw software architect Interviewed How testers and designers understand state diagram test model? Analyse the results using Qualitative research methods Oy LM Ericsson Ab 11

12 Qualitative Study Written Questionaire: 94 % answered 2 or more questions right Good learning curve in short time! (15 minutes) Question 3 not taken into account Question 1: What signal starts the test suite? Question 2: Who sends this signal (CTG or IM RA)? Question 3: Inside the CONFIGURATION -state there is yet two layers of states. Which state in these two layers is the most important state? Why? Question 4: How many total test cases are been run? Question 5: In the Passed case(s), what happens? Interviews: Positive reaction to the model Uncertainty of what is tested (More information: Evaluation of Model-Based Testing in 3G Mobile Networks Software Development Tampere University of Technology) Number of Testers Written Questionaire Right Answers Oy LM Ericsson Ab 12

13 Conclusion Proved that state diagrams can be used for testing 3G mobile networks functionality. Testers: Need to see the tool. Consultant: Model is clear and easy to understand. It is logical! Architect: The model was understandable, maybe even better than TTCN. Oy LM Ericsson Ab 13

14 Questions? Oy LM Ericsson Ab 14

15 Contact Markus Räisänen Systems Tester Oy LM Ericsson Ab, Finland Phone: +358-(0) Oy LM Ericsson Ab 15

16 Oy LM Ericsson Ab 16

17 Appendix MGC M-MGw IM RA O&M SUT DSP CPF Media Gateway Controller Mobile Media Gateway Interactive Messaging Resource Access Operations and Maintenance System Under Test Digital Signal Processor Control Plane Functions Oy LM Ericsson Ab 17

18 Appendix Model-based testing tools: TorX Leirios Test Generator Model-based testing languages: Abstract State Machine Language (AsmL) Test Generation with Verification (TGV) Oy LM Ericsson Ab 18