SC KICK-OFF METRICS PROJECT

Size: px

Start display at page:

Download "SC KICK-OFF METRICS PROJECT"

Valerie Wilkinson
8 years ago
Views:

1 SC KICK-OFF METRICS PROJECT

2 Vision and mission of the metrics theme The vision of the project is to identify and implement the key measurement practices, for maximizing the performance of companies The mission of the project is to provide a generic metrics portfolio, to the product development organizations of the involved companies, by identifying the most useful/valuable metrics. We also work on the specific questions related to productivity measurements in software projects (10x better productivity measurements)

3 Sprint #8 achievements Metrics day at Volvo Cars Visits SEB, SAAB Linköping, Ericsson Linköping, Linköpings universitet Survey and structuring of the metrics portfolio Application of ReRaM and preliminary integration with Systemweaver

4 Metrics portfolio aka reference measurement program Metrics portfolio a set of metrics to be used in a modern Sw. dev. company Pilot study Number of metrics: 50 1st survey Number of metrics: 30 Number of metrics:? Literature study Number of metrics: 388

5 Sprint #8 achievements (Vard requirements) Statement about SystemWeaver Application of ReRaM Integrated with IBM Rational DOORS (Grundfos) Integrated with SystemWeaver (Volvo Cars) Manual use (Saab)

6 Papers in sprint #8 1. V. Antinyan, M. Staron, J. Derehag, M. Runsten, E. Wikström, W. Meding, A. Henriksson, J. Hansson, Identifying Complex Functions by Investigating Various Aspects of Code Complexity, Science and Information Conference 2015, London, UK 2. Staron, Miroslaw; Niesel, Kent; Meding, Wilhelm, Selecting the Right Visualization of Indicators and Measures Dashboard Selection Model, International conference on Software Measurement (Mensura) 3. Staron, Miroslaw; Meding, Wilhelm, Measurement-as-a-Service A new Way of Organizating Measurement Programs in Large Software Development Companies, International Conference on Software Measurement (Mensura) 4. Rana, Rakesh; Staron, Miroslaw, When Do Software Issues and Bugs get Reported in Large Open Source Software Projects, International Conference on Software Measurement 5. Rana, Rakesh; Staron, Miroslaw; Berger, Christian, Improving Dependability of Embedded Software Systems using Fault Bypass Modelling (FBM), Polish National Software Engineering Conference 6. Staron, Miroslaw; Meding, Wilhelm; Niesel, Kent; Söder, Ola; Role of measurement systems in industrial decision support industrial experiences and a research roadmap, chapter accepted for publication in Research Handbook on Global Supply Chain Management, IGI Publishing, R. Rana, M. Staron, C. Berger, J. Hansson, M. Nilsson and F. Törner, Early Verification and Validation According to ISO by Combining Fault Injection and Mutation Testing, invited chapter in Communications in Computer and Information Science" (CCIS) Series, Springer-Verlag, D. Durisic, M. Staron, M. Tichy, ARCA - Automated Analysis of AUTOSAR Meta-Model Changes, Procedings of the 7 th International Workshop on Models in Software Engineering (MiSE), ICSE, E. Knauss, M.Staron, W. Meding, O. Söder, A. Nilsson, M. Castell, Supporting Continuous Integration by Code-Churn Based Test Selection, Proceedings of the 2 nd International Workshop on Rapid and Continuous Software Engineering (RCoSE), ICSE 2015, Italy. 10. D. Durisic, M. Staron, M. Tichy, Identifying Optimal Sets of Standardized Architectural Features - A Method and its Automotive Application, 11th International Conference on the "Quality of Software Architectures" (QoSA 2015) co-located with CompArch 2015 in Montreal, CA.

7 Sprint #9 Metrics day/seminar at SAAB Linköping Preparations for Mensura 2017 Strategy workshop for SC (metrics project) Finalize reference measurement program Using metrics to communicate between two companies (VCC and QRTech) Support building dashboards in Grundfos and VGTT 10x productivity continue the work Measurement of technical risks associated with tests (Vard) Application of ReRaM (Vard) Complexity survey

8 Sprint #9 rationale Metrics day/seminar at SAAB Linköping Dissemination of results and learning Strategy workshop for SC (metrics project) Goal alignment Using metrics to communicate between two companies (VCC and QRTech) To understand the practical value of sw development metrics in customer-supplier relationships Support building dashboards in Grundfos and VGTT To increase the impact of metrics in the companies Increase the utilization of metrics as a means of getting insight into performance 10x productivity continue the work (all companies in the theme) Quantify the success of the implementation of research projects in the organizations Measurement of technical risks associated with tests (Vard, E///) Continue with the risk assessment in the next dev. phase (addressing the whole dev. process)

9 Sprint #9 research questions Reference measurement program How to increase operational performance of sw. dev. organizations by using best-in-class metrics? How to optimize the cost-benefit of measurement process (at different levels) of the organization? How to decrease the cost of measurement by providing basic, reusable base/derived measures for different levels of the organization? How to develop an efficient dashboard (Grundfos, Volvo GTT) for visualizing the reference measures through Jenkins? 10x productivity improvement measurements How to define operational performance for software development organizations? How to define a generic framework for measuring operational performance improvements in software development/research projects? Which elements should the framework consist of? How should we distinguish between static and non-static elements of the framework? Measurement of technical risks associated with tests How can we automatically identify test cases which are hard to maintain or are ineffective in detecting bugs? How effective unit and component tests are generally and comparably? Application of ReRaM How can we apply ReRaM for continuous improvement of textual requirements?

10 Agenda for 1.5h presentation Vard s complexity survey presentation (30 minutes) Measurement reference model which metrics we have in each category (30 minutes) Jupiter, room 421

11 MIROSLAW STARON

METRICS RESEARCH ENABLING ACTIONABLE SOFTWARE METRICS IN MODERN COMPANIES

METRICS RESEARCH ENABLING ACTIONABLE SOFTWARE METRICS IN MODERN COMPANIES RESEARCH ENABLING ACTIONABLE SOFTWARE METRICS IN MODERN COMPANIES ESTABLISHING CUTTING EDGE METRICS RESEARCH AND DEVELOPMENT ENVIRONMENT MIROSLAW STARON WILHELM MEDING KENT NIESEL ANDERS HENRIKSSON CHRISTOFFER