SW testing in large SW project Presentation for TTY course TIE-21200 Ohjelmistojen testaus Sanna Järvenpää 1 24/10/2014 Nokia 2014 NAdC / Leena Rasinaho
Nokia Networks business in Finland 2 24/10/2014 Nokia 2014 NAdC / Leena Rasinaho
Networks business in Finland Head office in Espoo; other offices in Oulu and in Tampere One of the main R&D locations for Networks Full range of operations including manufacturing of base station products in Oulu Key customers: Nationwide operators Elisa and TeliaSonera; Finnish Railway Administration (GSM-R) 3 24/10/2014 Nokia 2014
Employees 6000 employees Over 10% of total Nokia employees 3700 R&D employees Approximately 400 manufacturing employees Employees by location: Espoo 3 000 Oulu 2 300 Tampere 700 4 24/10/2014 Nokia 2014
Locations Espoo Head office functions End-to-end Mobile Solution Center Oulu Radio Research & Design Center Base Station manufacturing Tampere End-to-end Network Operability Center 5 24/10/2014 Nokia 2014
Tampere SoC Development, Operations Support Systems and Customer Experience Center Highlights End to end Operability, User Experience and Process Automation Operations Support Systems GSM Base Station Controller and WCDMA Radio Network Controller SW maintenance services Real-time data processing for CEM via Traffica Shared Reference Network lab and Global OSS Lab Technology Expertise System integration competences for OSS and end-to-end operability Customer experience management, Traffica, Service assurance GSM / WCDMA Controller Specification, SW and I&V System Modules, System on Chip development 6 24/10/2014 Nokia 2014 Ecosystem Local universities providing access to latest technologies which utilized via coop projects and thesis workers for our R&D projects Lots of user experience and process automation expertise in local companies. Coop projects with TUT, UTA, TAKK and TAMK Close, regular and trustful relationship with Tampere City officials and mayor to discuss the future plans mutually. Visible e.g. via Tampere spirit Training where public funding available
SW testing in Nokia NetAct product 7 24/10/2014 Nokia 2014 NAdC / Leena Rasinaho
General Architecture in NetAct 3 RD party tool Alarms Configurations Measurements NetAct MVI Other vendors NEs GSM WCDMA LTE 8 24/10/2014 Nokia 2014
What to test NetAct functionality New features Regression testing for functionality in old releases Network element support in NetAct Basic support Regression testing for functionality in old releases New feature support 9 24/10/2014 Nokia 2014
Test Planning FC = Feature Component US = User Story iterative process FC analyze/design phase FC / US definition into backlog FC Test Plan definition FC / US implementation and testing Development team + architect(s) + spec people + documentation people 10 24/10/2014 Nokia 2014
Validation: Building right product - Verification: Building product right Component testing Unit testing Junits first level of regression testing Integration testing How components work together System Testing Functional WHAT Testing in development teams, Network Verification, System Verification Non-functional HOW Performance, Reliability, Load, Sequrity, Usabilility Acceptance testing Customer pilots, development teams defined SAT cases (SAT = System Acceptance Test) 11 24/10/2014 Nokia 2014
Static Dynamic testing Static testing code review specification review test case review documentation review Dynamic testing black-box testing ~ specification based, use cases white-box testing ~ implementation based experience based testing ~ regression testing, add-hoc testing 12 24/10/2014 Nokia 2014
Building one NetAct product NetAct product contains several building blocks that needs to work together 1. Each building block runs there own test 2. System verification tests that all building blocks work together 3. Network verification tests that network elements work together with NetAct (1) (2) FM ison PM CM SWM Trace NetAct (3) 13 24/10/2014 Nokia 2014
TestAutomation in NetAct 14 24/10/2014 Nokia 2014 NAdC / Leena Rasinaho
Test environment installation System component upgrade Pre-tests Reporting NetAct installation NetAct 15 24/10/2014 Nokia 2014
Test Automation in system component build creation Jenkins-builds Fix for the faulty component. Failing Success Copy to System build Upgrade to CI lab Execute smoke cases Execute weekly regression cases Responsible team to check and fix Execute regression cases Automatic promotion to NetAct product 16 24/10/2014 Nokia 2014 Execute daily regression cases Responsible team to check and fix
Building one NetAct product NetAct 17 24/10/2014 Nokia 2014
Different Testautomation types Smoke Regression Daily regression Weekly regression Purpose Can system component build be installed to system component test environments Can system component build be included to NetAct build Is the basic functionality working with system component build Tested against daily installed newest system component Is the basic functionality working with system component build Tested against weekly installed system component Number of tests Execution time 32 ~ 15 min 39 ~ 15 min 118 + 87 + 320 +143 Several runs during week 4 parallel runs ~ 8 h 18 24/10/2014 Nokia 2014
Test Automation reporting 19 24/10/2014 Nokia 2014
20 24/10/2014 Nokia 2014