Exercise Liliana Guzmán Introduction
Outline Purpose Organization Schedule Literature Administrative information Slide 1-2
Purpose Discussing and complementing the content of the lecture Gathering experience in the empirical evaluation of software technologies Learning to document and review empirical evaluations Preparing the examination Slide 1-3
Organization Overview At the beginning of the semester, students will build teams of 4 members. During the semester, each team will be responsible for: Planning and designing an empirical evaluation of a software technology Taking part in an empirical evaluation of a software technology Analyzing empirical data Presenting and documenting their results The planning and design of an empirical evaluation (along with the submission of the corresponding reports) during the semester time is mandatory for being allowed to take the exam. Slide 1-4
Organization How to? Exercise sheet will be published 1 week before the exercise class Teams are expected to: Solve the assigned tasks Document their results using the predefined templates Present their solutions during the exercise class Students and tutor will discuss the proposed solutions together in the exercise class. Teams are expected to enhance their solutions based on the previous discussions Slide 1-5
Schedule 20.04.2012 Administrative Information and topic assignments 27.04.2012 Research plan (1): Problem statement: Understanding object of study and quality focus 11.05.2012 Research plan (II): Problem statement: Research purpose, research goal, hypotheses and preliminary operationalization 25.05.2012 Research design I: Problem statement, sampling strategy, study selection and overview of evaluation design (Postpone to 01.06.2012) 08.06.2012 Research design II: Concrete Design. Separates deadlines for each team. (15/22/29.06.2012) 22/29.06.2012 and 06.07.2012 Submission of final version of research plan and design. 06.07.2012 Empirical evaluation 13.07.2012 Data analysis(2 session) and summary of the lecture. Slide 1-6
Literature Books available in university library: Wohlin, C., Runeson, P., Höst, M., Ohlsson, M., Regnell, B., Wesslén, A.: Experimentation in Software Engineering: An Introduction, Kluwer Academic Publishers, 2000 Boehm, Rombach, Zelkowitz (Eds): Foundations of Empirical Software Engineering Legacy of Victor R. Basili, Springer Berlin Heidelberg New York, 2005 Juristo, N., and Moreno, A.: Basics of Software Engineering Experimentation, Kluwer Academic Publishers, 2001 Slide 1-7
Administrative information Exercise class Tutor: Liliana Guzmán Contact: guzman@cs.uni-kl.de Location: Building 32 Room 426 Website: http://wwwagse.informatik.unikl.de/teaching/ese/ss2012/ Slide 1-8
Exercise Liliana Guzmán Topics for study design
Topics Project management Case 1: Effort estimation Characterizing expert estimation of software development effort with respect to the factors used and accuracy from the perspective of a project manager in the context of incremental software development Case 2: Project control approach Evaluating SPECULA with respect to its usability and ease to use from the perspective of project manager and software developers in the context of software development Slide 1-10
Topics Process modeling Case 3: Process modeling technique Evaluating the Software & Systems Process Engineering Meta- Model (SPEM) with respect to its understandability and process compliance for modeling software development processes from the perspective of quality manager in the context of software development Case 4: Process models Comparison of SPEM models and MVP-L models with respect to the generality from the perspective of quality managers in the context of software development Case 5: Process models Comparison of SPEM models and MVP-L models with respect to the changeability from the perspective of quality managers in the context of software development Slide 1-11
Topics Software improvement and measurement Case 6: GQM+ tool Evaluating GQM+ tool with respect to its usability for modeling measureable goals and its impact on the collaboration during the modeling process from the perspective of a quality manager in the context of software organizations Slide 1-12
Topics Safety modeling Case 7: Safety modeling techniques Characterizing safety modeling techniques with respect to their state of the practice in the context of embedded systems in the avionic domain from the perspective of project manager in the context of the development of software-based safety critical systems Case 8: Safety models Comparison of safety models (i.e. Fault trees and Component fault trees models) with respect to their impact on the communication among stakeholders from the perspective of software and system engineers in the context of the development of software-based safety critical systems Slide 1-13
Topic assignment Case 1: Effort estimation S. Lutsch, S.A. Scherr, S. Hupp and M. Koch Case 2: Project control approach Z. Dai, M. Mlitat and A. Guschkwoski Case 3: Process modeling technique A. Selleri Rocha and A. Bogo Case 6: GQM+ tool P. Iraguha and B. Palanisamy Case 7: Safety modeling techniques A. Atalar and A. C. Kurur Case 8: Safety models D, Krovachenko, A. Schärer and P. Feth Slide 1-14
First exercise sheet Purpose: Specification of the study object Specification of the quality focus (preliminary draft) Documentation: Template will be published on April 23 Presentation (27.04.2012) 10 minutes presentation per team Slide 1-15