# Chapter 6 Experiment Process

Save this PDF as:

Size: px
Start display at page:

## Transcription

1 Chapter 6 Process ation is not simple; we have to prepare, conduct and analyze experiments properly. One of the main advantages of an experiment is the control of, for example, subjects, objects and instrumentation. This ensures that we are able to draw more general conclusions. Other advantages include ability to perform statistical analysis using hypothesis testing methods and opportunities for replication. To ensure that we make use of the advantages, we need a process supporting us in our objectives in doing experiments correctly (the notion of experiments include quasi-experiments, unless clearly stated otherwise). The basic principles behind an experiment are illustrated in Fig The starting point is that we have an idea of a cause and effect relationship, i.e. we believe that there is a relationship between a cause construct and an effect construct. We have a theory or are able to formulate a hypothesis. A hypothesis means that we have an idea of, for example, a relationship, which we are able to state formally in a hypothesis. In order to evaluate our beliefs, we may use an experiment. The experiment is created, for example, to test a theory or hypothesis. In the design of the experiment, we have a number of treatments (values that the studied variable can take, see below) over which we have control. The experiment is performed and we are able to observe the outcome. This means that we test the relationship between the treatment and the outcome. If the experiment is properly set up, we should be able to draw conclusions about the relationship between the cause and the effect for which we stated a hypothesis. The main objective of an experiment is mostly to evaluate a hypothesis or relationship, see also Sect Hypothesis testing normally refers to the former, and the latter is foremost a matter of building a relational model based on the data collected. The model may be derived using multivariate statistical methods, for example, regression techniques and then we evaluate it in an experiment. The focus in this book is primarily on hypothesis testing. Multivariate statistical methods are treated by, for example, Kachigan [90, 91] and Manly [118]. The experiment process presented in this chapter is formulated to make sure that the proper actions are taken to ensure a successful experiment. It is unfortunately not C. Wohlin et al., ation in Software Engineering, DOI / , Springer-Verlag Berlin Heidelberg

2 74 6 Process objective Theory Cause construct cause-effect construct Effect construct Observation Treatment treatment-outcome construct Output Independent variable Dependent variable operation Fig. 6.1 principles (Adapted from Trochim [171]) uncommon that some factor is overlooked before the experiment, and the oversight prevents us from doing the planned analysis and hence we are unable to draw valid conclusions. The objective, of having a process, is to provide support in setting up and conducting an experiment. The activities in an experiment are briefly outlined in this chapter and treated in more detail in the following chapters, see Chaps Variables, Treatments, Objects and Subjects Before discussing the experiment process, it is necessary to introduce a few definitions in order to have a vocabulary for experimentation. When conducting a formal experiment, we want to study the outcome when we vary some of the input variables to a process. There are two kinds of variables in an experiment, independent and dependent variables, see Fig Those variables that we want to study to see the effect of the changes in the independent variables are called dependent variables (or response variables). Often there is only one dependent variable in an experiment. All variables in a process that are manipulated and controlled are called independent variables. Example. We want to study the effect of a new development method on the productivity of the personnel. We may have chosen to introduce an object-oriented design method instead of a function-oriented approach. The dependent variable in

3 6.1 Variables, Treatments, Objects and Subjects 75 Independent variables Process Dependent variable Fig. 6.2 Illustration of independent and dependent variables Treatment Independent variables design Process Dependent variable Independent variables with fixed levels Fig. 6.3 Illustration of an experiment the experiment is the productivity. Independent variables may be the development method, the experience of the personnel, tool support, and the environment. An experiment studies the effect of changing one or more independent variables. Those variables are called factors. The other independent variables are controlled at a fixed level during the experiment, or else we cannot say if the factor or another variable causes the effect. A treatment is one particular value of a factor. Example. The factor for the example experiment above, is the development method since we want to study the effect of changing the method. We use two treatments of the factor: the old and the new development method. The choice of treatment, and at which levels the other independent variable shall have, is part of the experiment design, see Fig design is described in more detail in Chap. 8. The treatments are being applied to the combination of objects and subjects. An object can, for example, be a document that shall be reviewed with different inspection techniques. The people that apply the treatment are called subjects. 1 The characteristics of both the objects and the subjects can be independent variables in the experiment. 1 Sometimes the term participant is used instead of the term subject. The term subject is mainly used when people are considered with respect to different treatments and with respect to the analysis and the term participant mainly when it deals with how to engage and motivate people in a study.

4 76 6 Process Example. The objects in the example experiment are the programs to be developed and the subjects are the personnel. An experiment consists of a set of tests (sometimes called trials) where each test is a combination of treatment, subject and object. It should be observed that this type of test should not be confused with the use of statistical tests, which is further discussed in Chap. 10. The number of tests affects the experimental error, and provides an opportunity to estimate the mean effect of any experimental factor. The experimental error helps us to know how much confidence we can place in the results of the experiment. Example. A test can be that person N (subject) uses the new development method (treatment) for developing program A (object). In human-oriented experiments, humans are the subjects, applying different treatments to objects. This implies several limitations to the control of the experiment. Firstly, humans have different skills and abilities, which in itself may be an independent variable. Secondly, humans learn over time, which means that if one subject applies two methods, the order of application of the methods may matter, and also the same object cannot be used for both occasions. Thirdly, human-oriented experiments are impacted by all sorts of influences and threats, due to the subject s ability to guess what the experimenter expects, their motivation for doing the tasks etc. Hence it is critical for the outcome of the experiment how subjects are selected and treated. Technology-oriented experiments are easier to control, since the technology may be made deterministic. The independent variable out of control in this type of experiments may instead be the objects selected for the experiment. One tool or technique may be well suited for one type of programs, and not for another. Hence it is critical for the outcome how objects are selected. 6.2 Process A process provides steps that support an activity, for example, software development. Processes are important as they can be used as checklists and guidelines of what to do and how to do it. To perform an experiment, several steps have to be taken and they have to be in a certain order. Thus, a process for how to perform experiments is needed. The process presented is focused on experimentation, but the same basic steps must be performed in any empirical study, as illustrated for the case study process in Sect The main difference is the work within a specific activity, for example, the design of a survey, experiment and case study differ, but they all need to be designed. Further, as case studies are flexible design studies, there are several iterations over the process steps, while experiments and surveys, as fixed design studies, primarily execute the steps once. Thus, the basic process may be used for

5 6.2 Process 77 idea scoping planning process operation Analysis & interpretation Presentation & package report Fig. 6.4 Overview of the experiment process other types of studies than experiments, but it has to be tailored to the specific type of study being conducted, for example, a survey using or a case study of a large software project. The process is as it is presented, however, suited for both randomized experiments and quasi-experiments. The latter are often used in software engineering when random samples of, for example, subjects (participants) are infeasible. The starting point for an experiment is insight, and the idea that an experiment would be a possible way of evaluating whatever we are interested in. In other words, we have to realize that an experiment is appropriate for the question we are going to investigate. This is by no means always obvious, in particular since empirical studies are not frequently used within computer science and software engineering [170, 181]. Some argumentation regarding why computer scientist should experiment more is provided by Tichy [169]. If we assume that we have realized, that an experiment is appropriate then it is important to plan the experiment carefully to avoid unnecessary mistakes, see Sect The experiment process can be divided into the following main activities. Scoping is the first step, where we scope the experiment in terms of problem, objective and goals. Planning comes next, where the design of the experiment is determined, the instrumentation is considered and the threats to the experiment are evaluated. Operation of the experiment follows from the design. In the operational activity, measurements are collected which then are analyzed and evaluated in analysis and interpretation. Finally, the results are presented and packaged in presentation and package. The activities are illustrated in Fig. 6.4 and further elaborated below,

6 78 6 Process and then each of the activities is treated in-depth in Chaps An overview of the experiment process including the activities, is presented in Fig The process is not supposed to be a true waterfall model; it is not assumed that an activity is necessarily finished prior to that the next activity is started. The order of activities in the process primarily indicates the starting order of the activities. In other words, the process is partly iterative and it may be necessary to go back and refine a previous activity before continuing with the experiment. The main exception is when the operation of the experiment has started, then it is not possible to go back to the scoping and planning of the experiment. This is not possible since starting the operation means that the subjects are influenced by the experiment, and if we go back there is risk that it is impossible to use the same subjects when returning to the operation phase of the experiment process. Scoping. The first activity is scoping. The hypothesis has to be stated clearly. It does not have to be stated formally at this stage, but it has to be clear. Furthermore, the objective and goals of the experiment must be defined. The goal is formulated from the problem to be solved. In order to capture the scope, a framework has been suggested [13]. The framework consists of the following constituents: Object of study (what is studied?), Purpose (what is the intention?), Quality focus (which effect is studied?), Perspective (whose view?), and Context (where is the study conducted?). These are further discussed in Chap. 7. Planning. The planning activity is where the foundation for the experiment is laid. The context of the experiment is determined in detail. This includes personnel and the environment, for example, whether the experiment is run in a university environment with students or in an industrial setting. Moreover, the hypothesis of the experiment is stated formally, including a null hypothesis and an alternative hypothesis. The next step in the planning activity is to determine variables (both independent variables (inputs) and the dependent variables (outputs). An important issue regarding the variables is to determine the values the variables actually can take. This also includes determining the measurement scale, which puts constraints on the method that we later can apply for statistical analysis. The subjects of the study are identified. Furthermore, the experiment is designed, which includes choosing a suitable experiment design including, for example, randomization of subjects. An issue closely related to the design is to prepare for the instrumentation of the experiment. We must identify and prepare suitable objects, develop guidelines if necessary and define measurement procedures. These issues are further discussed in Chap. 8. As a part of the planning, it is important to consider the question of validity of the results we can expect. Validity can be divided into four major classes: internal,

7 6.2 Process 79 idea process 7. scoping Goal definition 8. planning 8.1 Context selection 8.2 Hypothesis formulation 8.3 Variables selection 8.4 Selection of subjects 8.5 Choice of design type 8.6 Instrumentation 8.7 Validity evaluation design 9. operation 9.1 Preparation 9.2 Execution 9.3 Data validation data 10. Analysis & interpretation 10.1 Descriptive statistics 10.2 Data set reduction 10.3 Hypothesis testing Conclusions 11. Presentation & package report Fig. 6.5 Overview of the experiment process and artefacts with references to chapters and sections of this book external, construct and conclusion validity. Internal validity is concerned with the validity within the given environment and the reliability of the results. The external validity is a question of how general the findings are. Many times, we would like to state that the results from an experiment are valid outside the actual context in which the experiment was run. The construct validity is a matter of judging if the treatment reflects the cause construct and the outcome provides a true picture of the effect

8 80 6 Process construct, see Fig The conclusion validity is concerned with the relationship between the treatment and the outcome of the experiment. We have to judge if there is a relationship between the treatment and the outcome. The planning is a crucial step in an experiment to ensure that the results from the experiment become useful. Poor planning may ruin any well-intended study. Operation. The operation consists in principle of three steps: preparation, execution and data validation. In the preparation step, we are concerned with preparing the subjects as well as the material needed, for example, data collection forms. The participants must be informed about the intention; we must have their consent and they must be committed. The actual execution is normally not a major problem. The main concern is to ensure that the experiment is conducted according to the plan and design of the experiment, which includes data collection. Finally, we must try to make sure that the actually collected data is correct and provide a valid picture of the experiment. The operation activity is discussed in Chap. 9. Analysis and interpretation. The data collected during operation provide the input to this activity. The data can now be analyzed and interpreted. The first step in the analysis is to try to understand the data by using descriptive statistics. These provide a visualization of the data. The descriptive statistics help us to understand and interpret the data informally. The next step is to consider whether the data set should be reduced, either by removing data points or by reducing the number of variables by studying if some of the variables provide the same information. Specific methods are available for data reduction. After having removed data points or reduced the data set, we are able to perform a hypothesis test, where the actual test is chosen based on measurement scales, values on the input data and the type of results we are looking for. The statistical tests together with a more detailed discussion of descriptive statistics and data reduction techniques can be found in Chap. 10. One important aspect of this activity is the interpretation. That is, we have to determine from the analysis whether the hypothesis was possible to reject. This forms the basis for decision-making and conclusions concerning how to use the results from the experiment, which includes motivation for further studies, for example, to conduct an enlarged experiment or a case study. Presentation and package. The last activity is concerned with presenting and packaging of the findings. This includes primarily documentation of the results, which can be made either through a research paper for publication, a lab package for replication purposes or as part of a company s experience base. This last activity is important to make sure that the lessons learned are taken care of in an appropriate way. Moreover, an experiment will never provide the final answer to a question, and hence it is important to facilitate replication of the experiment. A comprehensive and thorough documentation is a prerequisite to achieve this objective. Having said that, the use of lab packages should done with care since using the same experimental design and documents may carry over some systematic problems and biases from

9 6.4 Exercises 81 the original experiment, as discussed in Sect Independently, we must take some time after the experiment to document and present it in a proper way. The presentation of an experiment is further elaborated in Chap Overview The steps in this experiment process are described in more detail subsequently, and to support the understanding of the process, an example is presented in Chap. 12. The objective of the example is to closely follow the defined process in order to illustrate the use of it. A summarizing overview of the experiment process can be found in Fig Exercises 6.1. What is a cause and effect relationship? 6.2. What is a treatment, and why is it sometime necessary to apply treatments in a random order? 6.3. What are dependent and independent variables respectively? 6.4. What are quasi-experiments? Explain why these are common in software engineering Which are the main steps in the experiment process, and why is it important to have distinct steps?

10

### C. Wohlin, "Is Prior Knowledge of a Programming Language Important for Software Quality?", Proceedings 1st International Symposium on Empirical

C. Wohlin, "Is Prior Knowledge of a Programming Language Important for Software Quality?", Proceedings 1st International Symposium on Empirical Software Engineering, pp. 27-36, Nara, Japan, October 2002.

### 1.1 Research in Geography [Meaning & Importance]

Department of Geography GEO 271 Everything is related to everything else, but near things are more related than distant things. - Waldo Tobler s First Law of Geography 1.1 Research in Geography [Meaning

### Testing Scientific Explanations (In words slides page 7)

Testing Scientific Explanations (In words slides page 7) Most people are curious about the causes for certain things. For example, people wonder whether exercise improves memory and, if so, why? Or, we

### HOW TO DO A SCIENCE PROJECT Step-by-Step Suggestions and Help for Elementary Students, Teachers, and Parents Brevard Public Schools

HOW TO DO A SCIENCE PROJECT Step-by-Step Suggestions and Help for Elementary Students, Teachers, and Parents Brevard Public Schools 1. Get an Idea for Your Project Find an area that interests you. You

### Investigation in Learning and Teaching of Graphs of Linear Equations in Two Unknowns

Investigation in Learning and Teaching of Graphs of Linear Equations in Two Unknowns Arthur Man Sang Lee The University of Hong Kong Anthony Chi Ming Or Education Infrastructure Division, Education Bureau

### Software Engineering. Introduction. Software Costs. Software is Expensive [Boehm] ... Columbus set sail for India. He ended up in the Bahamas...

Software Engineering Introduction... Columbus set sail for India. He ended up in the Bahamas... The economies of ALL developed nations are dependent on software More and more systems are software controlled

### The Role of Controlled Experiments in Software Engineering Research

The Role of Controlled Experiments in Software Engineering Research Victor R. Basili 1 The Experimental Discipline in Software Engineering Empirical studies play an important role in the evolution of the

### well as explain Dennett s position on the arguments of Turing and Searle.

Perspectives on Computer Intelligence Can computers think? In attempt to make sense of this question Alan Turing, John Searle and Daniel Dennett put fourth varying arguments in the discussion surrounding

### 13 Empirical Research Methods in Web and Software Engineering 1

13 Empirical Research Methods in Web and Software Engineering 1 Claes Wohlin, Martin Höst, Kennet Henningsson Abstract. Web and software engineering are not only about technical solutions. It is to a large

### Sample Size and Power in Clinical Trials

Sample Size and Power in Clinical Trials Version 1.0 May 011 1. Power of a Test. Factors affecting Power 3. Required Sample Size RELATED ISSUES 1. Effect Size. Test Statistics 3. Variation 4. Significance

### PROJECT MANAGEMENT METHODOLOGY OF OBJECT- ORIENTED SOFTWARE DEVELOPMENT

PROJECT MANAGEMENT METHODOLOGY OF OBJECT- ORIENTED SOFTWARE DEVELOPMENT Ing. David BEDNÁŘ, Doctoral Degree Programme (2) Dept. of Information Systems, FIT, BUT E-mail: bednar@fit.vutbr.cz Supervised by:

### Algorithmic Thinking: The Key for Understanding Computer Science

Algorithmic Thinking: The Key for Understanding Computer Science Gerald Futschek Vienna University of Technology Institute of Software Technology and Interactive Systems Favoritenstrasse 9, 1040 Vienna,

### Chapter Four. Data Analyses and Presentation of the Findings

Chapter Four Data Analyses and Presentation of the Findings The fourth chapter represents the focal point of the research report. Previous chapters of the report have laid the groundwork for the project.

### Aim To help students prepare for the Academic Reading component of the IELTS exam.

IELTS Reading Test 1 Teacher s notes Written by Sam McCarter Aim To help students prepare for the Academic Reading component of the IELTS exam. Objectives To help students to: Practise doing an academic

### Integrating Business and Software Development Models. Christina Wallin, Fredrik Ekdahl, and Stig Larsson, ABB

focus the business of software engineering Integrating Business and Software Models Christina Wallin, Fredrik Ekdahl, and Stig Larsson, ABB Today, software product development cannot generally be regarded

### Measurement. First Grade. Formative Assessment Lesson. Formative Assessment Lesson ALPHA Grade 1 Measurement 1

Formative Assessment Lesson ALPHA Grade 1 Measurement 1 Measurement First Grade Formative Assessment Lesson Designed and revised by Kentucky Department of Education Mathematics Specialists Field- tested

### GUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES

GUIDELINES FOR REVIEWING QUANTITATIVE DESCRIPTIVE STUDIES These guidelines are intended to promote quality and consistency in CLEAR reviews of selected studies that use statistical techniques and other

### Performance-based contracts: Main steps in competitive bidding

Performance-based contracts: Main steps in competitive bidding This section summarizes the main procurement steps for PPPs comprising maintenance, management and performance-based contracts. Maintenance,

### Note-Taking Skills. Overview: This lesson adds to the learners note-taking skills. This is a

xxx Lesson 14 Note-Taking Skills Overview: This lesson adds to the learners note-taking skills. This is a lesson that can be repeated on Tuesday of Week Three or can be taught in two segments. Learners

### Practical Research. Paul D. Leedy Jeanne Ellis Ormrod. Planning and Design. Tenth Edition

Practical Research Planning and Design Tenth Edition Paul D. Leedy Jeanne Ellis Ormrod 2013, 2010, 2005, 2001, 1997 Pearson Education, Inc. All rights reserved. Chapter 1 The Nature and Tools of Research

### doing a literature review

doing a literature review Students often start producing a Literature Review without knowing its purpose, what it consists of and how it can be set out. why this approach might be helpful for students:

### Chapter 1 Introduction. 1.1 Introduction

Chapter 1 Introduction 1.1 Introduction 1 1.2 What Is a Monte Carlo Study? 2 1.2.1 Simulating the Rolling of Two Dice 2 1.3 Why Is Monte Carlo Simulation Often Necessary? 4 1.4 What Are Some Typical Situations

### Hypothesis Testing: General Framework 1 1

Hypothesis Testing: General Framework Lecture 2 K. Zuev February 22, 26 In previous lectures we learned how to estimate parameters in parametric and nonparametric settings. Quite often, however, researchers

### NON-PROBABILITY SAMPLING TECHNIQUES

NON-PROBABILITY SAMPLING TECHNIQUES PRESENTED BY Name: WINNIE MUGERA Reg No: L50/62004/2013 RESEARCH METHODS LDP 603 UNIVERSITY OF NAIROBI Date: APRIL 2013 SAMPLING Sampling is the use of a subset of the

### G544: Examination feedback

G544: Examination feedback Section A: Questions: Q1: State the NULL hypothesis for your practical project (3) For 3 marks both the IV and DV must be operationalised Frequent cause of lost marks: Few students

### Introduction to Hypothesis Testing

I. Terms, Concepts. Introduction to Hypothesis Testing A. In general, we do not know the true value of population parameters - they must be estimated. However, we do have hypotheses about what the true

### Brown Hills College of Engineering & Technology Machine Design - 1. UNIT 1 D e s i g n P h i l o s o p h y

UNIT 1 D e s i g n P h i l o s o p h y Problem Identification- Problem Statement, Specifications, Constraints, Feasibility Study-Technical Feasibility, Economic & Financial Feasibility, Social & Environmental

### Hypothesis: the essential tool for research Source: Singh (2006), Kothari (1985) and Dawson (2002)

Hypothesis: the essential tool for research Source: Singh (2006), Kothari (1985) and Dawson (2002) As I mentioned it earlier that hypothesis is one of the fundamental tools for research in any kind of

### Research Design and Research Methods

CHAPTER 3 Research Design and Research Methods Overview This chapter uses an emphasis on research design to discuss qualitative, quantitative, and mixed methods research as three major approaches to research

### RUT - development manual 3.26 Introduction to project management v 2.0 - en

2007-01-16 LiTH RUT - development manual 3.26 Introduction to project management v 2.0 - en Erling Larsson Summary The purpose is to give a concise explanation of what a project leader should be aware

### SQ3R Modified for Math

SQ3R Modified for Math Overview: Math classes are very difficult for most people. Part of the reason why is that the text can be extremely complex to read. By using the SQ3R reading strategy modified for

### The Principles of Selling Outsourcing Pretium Partners, Inc.

The Principles of Selling Outsourcing Pretium Partners, Inc. Selling outsourcing is different, perhaps more challenging, than product, service or solution sales. The past 10 years of outsourcing expansion

### Experimental (quantitative) studies: An overview and general issues by Stephanie Tierney

Experimental (quantitative) studies: An overview and general issues by Stephanie Tierney (stephanie.tierney@manchester.ac.uk) Experimental designs are said to be the approach for obtaining information

### Guidelines and criteria for drafting a PhD proposal

Guidelines and criteria for drafting a PhD proposal November 2012 Contents 1. Why a PhD proposal?... 2 2. The criteria used by the doctoral committee... 2 2.1 General criteria... 2 2.2 Specific criteria...

### Statistical Foundations:

Statistical Foundations: Hypothesis Testing Psychology 790 Lecture #9 9/19/2006 Today sclass Hypothesis Testing. General terms and philosophy. Specific Examples Hypothesis Testing Rules of the NHST Game

### Writing Thesis Defense Papers

Writing Thesis Defense Papers The point of these papers is for you to explain and defend a thesis of your own critically analyzing the reasoning offered in support of a claim made by one of the philosophers

### High School Science Project 1 Expectations

High School Science Project 1 Expectations Project Completion Date: 1 st Monday in February Suggested Sequence of Events, Checklist & Timeline Purchase composition notebook to use as a science project

### Observing and describing the behavior of a subject without influencing it in any way.

HOW TO CHOOSE FROM THE DIFFERENT RESEARCH METHODS* The design is the structure of any scientific work. It gives direction and systematizes the research. The method you choose will affect your results and

### Chapter 4 Software Lifecycle and Performance Analysis

Chapter 4 Software Lifecycle and Performance Analysis This chapter is aimed at illustrating performance modeling and analysis issues within the software lifecycle. After having introduced software and

### Research Design. Relationships in Nonexperimental Research. Nonexperimental Research Designs and Survey Research. Katie Rommel-Esham Education 504

Nonexperimental Research Designs and Survey Research Katie Rommel-Esham Education 504 Research Design Research design deals with the ways in which data are gathered from subjects Relationships in Nonexperimental

### Nonexperimental Research Designs and Survey Research. Katie Rommel-Esham Education 604

Nonexperimental Research Designs and Survey Research Katie Rommel-Esham Education 604 Research Design Research design deals with the ways in which data are gathered from subjects Relationships in Nonexperimental

### 3.4.1 Definitions of Enterprise Architecture

32 3 Positioning Enterprise Architecture Fig. 3.7 Applications for enterprise architecture Solution architecture Use enterprise architecture to create the high level design of an actual step in the enterprise

### Running head: HOW TO WRITE A RESEARCH PROPOSAL 1. How to Write a Research Proposal: A Formal Template for Preparing a Proposal for Research Methods

Running head: HOW TO WRITE A RESEARCH PROPOSAL 1 How to Write a Research Proposal: A Formal Template for Preparing a Proposal for Research Methods Insert Name Here Dallas Baptist University HOW TO WRITE

### Demonstrating a DATA Step with and without a RETAIN Statement

1 The RETAIN Statement Introduction 1 Demonstrating a DATA Step with and without a RETAIN Statement 1 Generating Sequential SUBJECT Numbers Using a Retained Variable 7 Using a SUM Statement to Create SUBJECT

### 1/10. Descartes 2: The Cogito and the Mind

1/10 Descartes 2: The Cogito and the Mind Recap: last week we undertook to follow Descartes path of radical doubt in order to attempt to discover what, if anything, can be known for certain. This path

### Comparison of Research Designs Template

Comparison of Comparison of The following seven tables provide an annotated template to guide you through the comparison of research designs assignment in this course. These tables help you organize your

### Chapter 2 Conceptualizing Scientific Inquiry

Chapter 2 Conceptualizing Scientific Inquiry 2.1 Introduction In order to develop a strategy for the assessment of scientific inquiry in a laboratory setting, a theoretical construct of the components

### Thesis Proposal Template/Outline 1. Thesis Proposal Template/Outline. Abstract

Thesis Proposal Template/Outline 1 Thesis Proposal Template/Outline Abstract The main purpose of a thesis proposal is to demonstrate that the author: has studied and knows the current status of work in

### Notes on Complexity Theory Last updated: August, 2011. Lecture 1

Notes on Complexity Theory Last updated: August, 2011 Jonathan Katz Lecture 1 1 Turing Machines I assume that most students have encountered Turing machines before. (Students who have not may want to look

Chapter IX. Data quality and metadata This draft is based on the text adopted by the UN Statistical Commission for purposes of international recommendations for industrial and distributive trade statistics.

### Five High Order Thinking Skills

Five High Order Introduction The high technology like computers and calculators has profoundly changed the world of mathematics education. It is not only what aspects of mathematics are essential for learning,

### Solving Linear Equations in Two Variables

CONCEPT DEVELOPMENT Mathematics Assessment Project CLASSROOM CHALLENGES A Formative Assessment Lesson Solving Linear Equations in Two Variables Mathematics Assessment Resource Service University of Nottingham

### Uses of Empirical Modelling in a frisbee simulation

Uses of Empirical Modelling in a frisbee simulation Abstract This paper shall describe how Empirical Modelling was used in constructing a small simulation of a frisbee game. The purpose of the paper is

### Distributions: Population, Sample and Sampling Distributions

119 Part 2 / Basic Tools of Research: Sampling, Measurement, Distributions, and Descriptive Statistics Chapter 9 Distributions: Population, Sample and Sampling Distributions In the three preceding chapters

### Software Development Methodologies in Industry. By: Ahmad Deeb

Software Development Methodologies in Industry By: Ahmad Deeb Methodologies Software Development Methodologies in Industry Presentation outline SDM definition Project and analysis approach Research methods

### Penalized regression: Introduction

Penalized regression: Introduction Patrick Breheny August 30 Patrick Breheny BST 764: Applied Statistical Modeling 1/19 Maximum likelihood Much of 20th-century statistics dealt with maximum likelihood

### MAT2400 Analysis I. A brief introduction to proofs, sets, and functions

MAT2400 Analysis I A brief introduction to proofs, sets, and functions In Analysis I there is a lot of manipulations with sets and functions. It is probably also the first course where you have to take

### Non-random/non-probability sampling designs in quantitative research

206 RESEARCH MET HODOLOGY Non-random/non-probability sampling designs in quantitative research N on-probability sampling designs do not follow the theory of probability in the choice of elements from the

### Chapter 8: Interval Estimates and Hypothesis Testing

Chapter 8: Interval Estimates and Hypothesis Testing Chapter 8 Outline Clint s Assignment: Taking Stock Estimate Reliability: Interval Estimate Question o Normal Distribution versus the Student t-distribution:

### Introduction to Statistics for Computer Science Projects

Introduction Introduction to Statistics for Computer Science Projects Peter Coxhead Whole modules are devoted to statistics and related topics in many degree programmes, so in this short session all I

### INFORMATIVE WRITING?

INFORMATIVE WRITING? clear opening general information about the topic more specific information summarising conclusion interesting, easy to read layout or third person (depends on topic can be personal)

### Writing a Formal Report

Memorial University of Newfoundland Department of Physics and Physical Oceanography Writing a Formal Report A formal report describes the results of a scientific investigation. Thousands of papers are

### Fairfield Public Schools

Mathematics Fairfield Public Schools AP Statistics AP Statistics BOE Approved 04/08/2014 1 AP STATISTICS Critical Areas of Focus AP Statistics is a rigorous course that offers advanced students an opportunity

### Project-Based Inquiry Science: Vehicles in Motion Storyline

Project-Based Inquiry Science: Vehicles in Motion Storyline Targeted Performance Expectations: MS-PS2-1 MS-PS2-2 MS-PS3-2 MS-ETS1-1 MS-ETS1-2 MS-ETS1-3 MS-ETS1-4 Unit Goals: Plan and carry out investigations

### Variables and Hypotheses

Variables and Hypotheses When asked what part of marketing research presents them with the most difficulty, marketing students often reply that the statistics do. Ask this same question of professional

### Pythagorean Triples. Chapter 2. a 2 + b 2 = c 2

Chapter Pythagorean Triples The Pythagorean Theorem, that beloved formula of all high school geometry students, says that the sum of the squares of the sides of a right triangle equals the square of the

### Time needed. Before the lesson Assessment task:

Formative Assessment Lesson Materials Alpha Version Beads Under the Cloud Mathematical goals This lesson unit is intended to help you assess how well students are able to identify patterns (both linear

### Gender Sensitive Data Gathering Methods

Gender Sensitive Data Gathering Methods SABINA ANOKYE MENSAH GENDER AND DEVELOPMENT COORDINATOR GRATIS FOUNDATION, TEMA, GHANA sabinamensah@hotmail.com Learning objectives By the end of this lecture, participants:

### Guidelines for the mid term evaluation of rural development programmes 2000-2006 supported from the European Agricultural Guidance and Guarantee Fund

EUROPEAN COMMISSION AGRICULTURE DIRECTORATE-GENERAL Guidelines for the mid term evaluation of rural development programmes 2000-2006 supported from the European Agricultural Guidance and Guarantee Fund

### 7.1 Inference for comparing means of two populations

Objectives 7.1 Inference for comparing means of two populations Matched pair t confidence interval Matched pair t hypothesis test http://onlinestatbook.com/2/tests_of_means/correlated.html Overview of

### GUIDE FOR WRITING A RESEARCH PROTOCOL

RESEARCH GRANTS PROGRAM GUIDE FOR WRITING A RESEARCH PROTOCOL Research Grants Program (RGP) Research Coordination (HDP/HDR) Division of Health and Human Development (HDP) Pan American Health Organization

### Mathematical goals. Starting points. Materials required. Time needed

Level N of challenge: B N Mathematical goals Starting points Materials required Time needed Ordering fractions and decimals To help learners to: interpret decimals and fractions using scales and areas;

### Purpose of Hypothesis Testing

Large sample Tests of Hypotheses Chapter 9 1 Purpose of Hypothesis Testing In the last chapter, we studied methods of estimating a parameter (μ, p or p 1 p 2 ) based on sample data: point estimation confidence

### Science Fair Handbook Agapé Jr. Academy. 186 New Hope Road Lawrenceville, GA Phone:

Science Fair Handbook Agapé Jr. Academy 186 New Hope Road Lawrenceville, GA 30046 Phone: 678 376-0883 www.agapejracademy.us 2016-2017 SCIENCE FAIR PROJECTS OBJECTIVES: The primary purpose of science projects

### Empirical Research on Influencing Factors of Human Resources Management Outsourcing Degree *

ibusiness, 2013, 5, 168-174 http://dx.doi.org/10.4236/ib.2013.53b036 Published Online September 2013 (http://www.scirp.org/journal/ib) Empirical Research on Influencing Factors of Human Resources Management

### Developing Techniques for Using Software Documents: A Series of Empirical Studies

Developing Techniques for Using Software Documents: A Series of Empirical Studies Ph.D. Thesis Proposal Forrest J. Shull University of Maryland Abstract This proposal presents an empirical method for developing

### 11.2 POINT ESTIMATES AND CONFIDENCE INTERVALS

11.2 POINT ESTIMATES AND CONFIDENCE INTERVALS Point Estimates Suppose we want to estimate the proportion of Americans who approve of the president. In the previous section we took a random sample of size

### March 2010 BLOOM'S TAXONOMY AND CRITICAL THINKING

March 2010 BLOOM'S TAXONOMY AND CRITICAL THINKING Critical Thinking across the Curriculum Page 2 of 7 Contents Bloom's Taxonomy and Critical Thinking... 3 Bloom s in a group ICT project -... 4 Learning

### Missing Data. A Typology Of Missing Data. Missing At Random Or Not Missing At Random

[Leeuw, Edith D. de, and Joop Hox. (2008). Missing Data. Encyclopedia of Survey Research Methods. Retrieved from http://sage-ereference.com/survey/article_n298.html] Missing Data An important indicator

### Usability metrics for software components

Usability metrics for software components Manuel F. Bertoa and Antonio Vallecillo Dpto. Lenguajes y Ciencias de la Computación. Universidad de Málaga. {bertoa,av}@lcc.uma.es Abstract. The need to select

### STAT303 Spring 2014 Exam #2 Form A

1 STAT303 Spring 2014 Exam #2 Form A March 6, 2014 1. Don t even open this until you are told to do so. 2. Remember to turn your phone off now. 3. Please turn your hats around backwards or take them off.

### Teaching writing. Guide for Years 1 3. December 2009

150624 Contents Building a supportive writing community 1 The teaching focus... 2 Planning modelled writing lessons 3 Before writing... 3 Step 1: Identifying the writing task in context and... 3 Step 2:

### 1. Current situation Describe the problem or opportunity (the need for your proposal).

Generic Grant Outline Always check with the sponsor for specific proposal guidelines (and follow them closely), but also become familiar with the generic proposal structure to better understand what information

### Checklists and Examples for Registering Statistical Analyses

Checklists and Examples for Registering Statistical Analyses For well-designed confirmatory research, all analysis decisions that could affect the confirmatory results should be planned and registered

### Data Analysis. Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) SS Analysis of Experiments - Introduction

Data Analysis Lecture Empirical Model Building and Methods (Empirische Modellbildung und Methoden) Prof. Dr. Dr. h.c. Dieter Rombach Dr. Andreas Jedlitschka SS 2014 Analysis of Experiments - Introduction

### BACKGROUND OF THE PROBLEM SECTION WHAT DO YOU NEED TO CONSIDER?

BACKGROUND OF THE PROBLEM SECTION WHAT DO YOU NEED TO CONSIDER? This section is like the free style competition in gymnastics. While there are certain things that you must do, the manner in which you prepare

### Using an Instructional Systems Development Model as a Framework for Research on Scale Up 1

Using an Instructional Systems Development Model as a Framework for Research on Scale Up 1 Michael R. Vitale East Carolina University Nancy R. Romance Florida Atlantic University Abstract This paper presents

### PASS Sample Size Software. Linear Regression

Chapter 855 Introduction Linear regression is a commonly used procedure in statistical analysis. One of the main objectives in linear regression analysis is to test hypotheses about the slope (sometimes

### Use Your Master s Thesis Supervisor

Use Your Master s Thesis Supervisor This booklet was prepared in dialogue with the heads of studies at the faculty, and it was approved by the dean of the faculty. Thus, this leaflet expresses the faculty

### LESSON 2 OVERCOMING BARRIERS TO EFFECTIVE COMMUNICATION STRUCTURE 2.0 OBJECTIVES 2.1 INTRODUCTION 2.2 BARRIERS TO EFFECTIVE COMMUNICATION

LESSON 2 OVERCOMING BARRIERS TO EFFECTIVE COMMUNICATION STRUCTURE 2.0 OBJECTIVES 2.1 INTRODUCTION 2.2 BARRIERS TO EFFECTIVE COMMUNICATION 2.2.1 FILTERING 2.2.2 PSYCHOLOGICAL FACTORS 2.2.3 DEFENSIVENESS

### 1.2 Investigations and Experiments

Science is about figuring out cause and effect relationships. If we do something, what happens? If we make a ramp steeper, how much faster will a car roll down? This is an easy question. However, the process

### B240 Principles and Practices of Management

B240 Principles and Practices of Management Sample materials 2 Learning OU Style Sample Materials What is management and what do managers do? Let s begin by thinking about what management is. We ll then

### STATISTICS 151 SECTION 1 FINAL EXAM MAY

STATISTICS 151 SECTION 1 FINAL EXAM MAY 2 2009 This is an open book exam. Course text, personal notes and calculator are permitted. You have 3 hours to complete the test. Personal computers and cellphones

### AUTHORISED ECONOMIC OPERATORS THE AEO COMPACT MODEL

EUROPEAN COMMISSION DIRECTORATE-GENERAL TAXATION AND CUSTOMS UNION Customs Policy Risk Management, Security and specific controls Brussels, 13 June 2006 WORKING DOCUMENT TAXUD/2006/1452 AUTHORISED ECONOMIC

### AP Statistics 1998 Scoring Guidelines

AP Statistics 1998 Scoring Guidelines These materials are intended for non-commercial use by AP teachers for course and exam preparation; permission for any other use must be sought from the Advanced Placement

### INTRODUCTION TO COACHING TEACHING SKILLS TEACHING/LEARNING. September 2007 Page 1

TEACHING SKILLS September 2007 Page 1 TEACHING SKILLS Being a teacher is one of the main roles a coach fulfils for their players. The ability to teach effectively, especially the technical skills of ice

### C. Wohlin and B. Regnell, "Achieving Industrial Relevance in Software Engineering Education", Proceedings Conference on Software Engineering

C. Wohlin and B. Regnell, "Achieving Industrial Relevance in Software Engineering Education", Proceedings Conference on Software Engineering Education & Training, pp. 16-25, New Orleans, Lousiana, USA,

### Science Fair Paper Format Due: Friday, February 15 th, 2013

Science Fair Paper Format Due: Friday, February 15 th, 2013 This packet will show your what your final Science Fair written report should look like. Include page numbers on each page of your paper. Each