Acctesting Test Campaign Edition Continuous Delivery

Transcription

1 Acctesting Test Campaign Edition Continuous Delivery Turcu Cristina TE-MPE On behalf of the TE-MPE-MS Software Team Technical meeting

2 Content Acctesting Test Campaign Edition -Situation -Improvements -New Features -Outlook Continuous Delivery -Deployment before -Deployment now -Summary -Outlook Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 2 K. Fuchsberger TE-MPE-TM, , Acctesting Motivation, Overview and First Experience 2

3 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 3 Situation Accelerator testing

4 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 4 Situation Tests 3 steps for validating a test: Test execution Test analysis Test signing Test-Phases.

5 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 5 What is a Campaign? Campaign: contains the necessary tests in order to determine if a system/circuit is safe for running. Test Plan: defines which tests have to be executed for which systems during one test campaign.

7 Test Campaign Edition Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 7 Why we need it? Before Edit the test plan by directly editing the Database (DB) Security or consistency problems More flexibility needed Improvements: Editing the test plan without directly editing the DB Impose restrictions on editing the DB, using Role Base Access Control (RBAC) Allows many campaigns and keeps the history of them Allows different system types, not only Circuits as before

8 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 8 Status GUI Panel GUI Panel New GUI Panel Core Layer Persistence Layer Old DB (LSA account owned by CO) Data Migration New DB (dedicated DB account)

10 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 10 Acctesting - new features Campaign history Campaign browsing Display and edit old campaigns

11 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 11 Acctesting - new features Create, Delete and Edit selected campaign

12 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 12 Acctesting - new features Enable/Disable single test

13 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 13 Acctesting - new features Systems are grouped and can be activated/deactivated by test types

15 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 15 Acctesting Outlook Next Steps: Waiting for user feedback Will be used for this Hardware commissioning Server is operational in development (dev) environment, but the GUI parts can t be release for the moment waiting for some release features from CO

17 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 17 Continuous Delivery What it is? represents a series of practices to ensure the code can be rapidly and safely deployed for operation by delivering every change to a production-like environment after all the necessary tests passed. Why do we need it? To always have the latest product version potentially deliverable For a simple and fast deployment.

19 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 19 Project dependencies Common build 45 projects Respect order Time: ½ day

21 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 21 Continuous Delivery Commit on Revision control software (SVN) Automatic build using a Continuous integration server Manually deployment dev pro Junit: Unit tests Integration tests Functional tests Acceptance tests Continuous delivery: Used by many companies Has proven its efficiency

22 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 22 Commit a server change Commit on SVN Automatic build using a Continuous integration server Manually deployment dev pro Commit to SVN Junit: Unit tests Integration tests Functional tests Acceptance tests generate a snapshot of the application (Tarball (.tar)) use to deployment on the node (development /production) attaches version of the DB and the server to the Tarball usefull in case of a rollback, so we know which version of the server is compatible with witch version of DB

23 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 23 Bamboo Commit on SVN Continuous integration server. Automatic build using a Continuous integration server Manually deployment Builds the project and runs the tests whenever a developer commits an update Continuously tests the software dev pro Source Control Developers Agents

24 Bamboo Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 24

25 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 25 Bamboo The system is working when all the builds are green a problem can be spotted quickly provides the root cause of the error stack traces Provides statistics build duration number of failures /build successful buils/time time to fix, etc

26 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 26 Bamboo Integration Jira (able to associate task with builds), Fisheye(a source history with hooks into Jira), Crucible (assists in code reviews), Clover (monitors code coverage in the build) Build systems: Ant, Maven, Make, Command Line

27 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 27 Bamboo Crucible - assists in code reviews

28 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 28 Unit Tests Commit on SVN Automatic build using Bamboo Manually deployment dev pro JUnit framework for writing tests Unit tests: Test small unit of functionality Everything is done in the memory(no DB, no network) Uses mocks Junit: Unit tests Integration tests Functional tests Acceptance tests Benefits Formalize requirements Write and debug code easily, fewer bugs More maintainable code

29 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 29 Integration Tests Commit on SVN Automatic build using Bamboo Manually deployment dev pro Junit: Unit tests Integration tests Functional tests Acceptance tests Integration tests Test of how well classes work together Environment(accessing DB, connecting to server..) Purpose find bugs that unit tests can't detect To verify Functionality Performance Reliability

30 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 30 Functional & Acceptance Tests Commit on SVN Automatic build using Bamboo Manually deployment dev pro Junit: Unit tests Integration tests Functional tests Acceptance tests Functional tests check a particular feature for correctness by comparing with the specification don't concern on intermediate results Acceptance tests particular type of functional test illustrate the user stories ensure that all the software features are complete

31 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 31 Deployment Commit on SVN Automatic build using Bamboo Manually deployment dev pro Junit: Unit tests Integration tests Functional tests Acceptance tests Information about the state of the server: what version of the DB it is used what version of the server has been deployed What we improved possibility to specify the environment to deploy the server: pro / dev ability to see all succesful deployments.

32 Deployment Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 32

35 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 35 Deployment aaa Four Steps (done automatically): 1. Stop server 2. Migrate the DB 3. Deploy the server 4. Start server

37 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 37 Summary Commit on SVN Build using Bamboo Deploy using Bamboo dev pro generate a Tarball (.tar) attaches version of the DB and the server to the Tarball Junit: Unit tests Integration tests Functional tests Acceptance tests Stop server Migrate the DB Deploy the server Start server Automatically Manually selecting the environment, the release and starting the deployment.

39 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 39 Outlook In place for: Acctesting server To be extended to: RDA3 server PC Interlock server System management server Analysis server Plan: Have continuous delivery for the GUI Improve DB rollback

40 Turcu Cristina TE-MPE Acctesting Test Campaign Edition & Continuous Delivery 40 Thank you for your Attention! Questions?