Empirical Model Building and Methods Exercise

Size: px

Start display at page:

Download "Empirical Model Building and Methods Exercise"

Pamela Payne
10 years ago
Views:

1 Exercise Liliana Guzmán Introduction

2 Outline Purpose Organization Schedule Literature Administrative information Slide 1-2

3 Purpose Discussing and complementing the content of the lecture Gathering experience in the empirical evaluation of software technologies Learning to document and review empirical evaluations Preparing the examination Slide 1-3

of software technologies Learning to document and review

4 Organization Overview At the beginning of the semester, students will build teams of 4 members. During the semester, each team will be responsible for: Planning and designing an empirical evaluation of a software technology Taking part in an empirical evaluation of a software technology Analyzing empirical data Presenting and documenting their results The planning and design of an empirical evaluation (along with the submission of the corresponding reports) during the semester time is mandatory for being allowed to take the exam. Slide 1-4

part in an empirical evaluation of a software technology Analyzing empirical data Presenting and documenting their results The planning

5 Organization How to? Exercise sheet will be published 1 week before the exercise class Teams are expected to: Solve the assigned tasks Document their results using the predefined templates Present their solutions during the exercise class Students and tutor will discuss the proposed solutions together in the exercise class. Teams are expected to enhance their solutions based on the previous discussions Slide 1-5

assigned tasks Document their results using the predefined templates Present their solutions during the

6 Schedule Administrative Information and topic assignments Research plan (1): Problem statement: Understanding object of study and quality focus Research plan (II): Problem statement: Research purpose, research goal, hypotheses and preliminary operationalization Research design I: Problem statement, sampling strategy, study selection and overview of evaluation design (Postpone to ) Research design II: Concrete Design. Separates deadlines for each team. (15/22/ ) 22/ and Submission of final version of research plan and design Empirical evaluation Data analysis(2 session) and summary of the lecture. Slide 1-6

2012 Research design I: Problem statement, sampling strategy, study selection and overview of evaluation design (Postpone to 01.06.2012) 08.06.2012 Research design II: Concrete Design.

7 Literature Books available in university library: Wohlin, C., Runeson, P., Höst, M., Ohlsson, M., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: An Introduction, Kluwer Academic Publishers, 2000 Boehm, Rombach, Zelkowitz (Eds): Foundations of Empirical Software Engineering Legacy of Victor R. Basili, Springer Berlin Heidelberg New York, 2005 Juristo, N., and Moreno, A.: Basics of Software Engineering Experimentation, Kluwer Academic Publishers, 2001 Slide 1-7

: Experimentation in Software Engineering: An Introduction, Kluwer Academic Publishers, 2000 Boehm, Rombach, Zelkowitz

8 Administrative information Exercise class Tutor: Liliana Guzmán Contact: Location: Building 32 Room 426 Website: Slide 1-8

de Location: Building 32 Room 426 Website:

9 Exercise Liliana Guzmán Topics for study design

10 Topics Project management Case 1: Effort estimation Characterizing expert estimation of software development effort with respect to the factors used and accuracy from the perspective of a project manager in the context of incremental software development Case 2: Project control approach Evaluating SPECULA with respect to its usability and ease to use from the perspective of project manager and software developers in the context of software development Slide 1-10

incremental software development Case 2: Project control approach Evaluating SPECULA with respect to its usability

11 Topics Process modeling Case 3: Process modeling technique Evaluating the Software & Systems Process Engineering Meta- Model (SPEM) with respect to its understandability and process compliance for modeling software development processes from the perspective of quality manager in the context of software development Case 4: Process models Comparison of SPEM models and MVP-L models with respect to the generality from the perspective of quality managers in the context of software development Case 5: Process models Comparison of SPEM models and MVP-L models with respect to the changeability from the perspective of quality managers in the context of software development Slide 1-11

Comparison of SPEM models and MVP-L models with respect to the generality from the perspective of quality managers in the context of software development Case 5: Process

12 Topics Software improvement and measurement Case 6: GQM+ tool Evaluating GQM+ tool with respect to its usability for modeling measureable goals and its impact on the collaboration during the modeling process from the perspective of a quality manager in the context of software organizations Slide 1-12

its impact on the collaboration during the modeling process from the

13 Topics Safety modeling Case 7: Safety modeling techniques Characterizing safety modeling techniques with respect to their state of the practice in the context of embedded systems in the avionic domain from the perspective of project manager in the context of the development of software-based safety critical systems Case 8: Safety models Comparison of safety models (i.e. Fault trees and Component fault trees models) with respect to their impact on the communication among stakeholders from the perspective of software and system engineers in the context of the development of software-based safety critical systems Slide 1-13

14 Topic assignment Case 1: Effort estimation S. Lutsch, S.A. Scherr, S. Hupp and M. Koch Case 2: Project control approach Z. Dai, M. Mlitat and A. Guschkwoski Case 3: Process modeling technique A. Selleri Rocha and A. Bogo Case 6: GQM+ tool P. Iraguha and B. Palanisamy Case 7: Safety modeling techniques A. Atalar and A. C. Kurur Case 8: Safety models D, Krovachenko, A. Schärer and P. Feth Slide 1-14

Guschkwoski Case 3: Process modeling technique A. Selleri Rocha and A. Bogo Case 6: GQM+ tool P.

15 First exercise sheet Purpose: Specification of the study object Specification of the quality focus (preliminary draft) Documentation: Template will be published on April 23 Presentation ( ) 10 minutes presentation per team Slide 1-15

draft) Documentation: Template will be published on April 23

Empirical Software Engineering Introduction & Basic Concepts

Empirical Software Engineering Introduction & Basic Concepts Dietmar Winkler Vienna University of Technology Institute of Software Technology and Interactive Systems [email protected]