Challenges and Implementation of Effort Tracking System

Similar documents
Independent t- Test (Comparing Two Means)

Case Study Call Centre Hypothesis Testing

SCHOOL OF HEALTH AND HUMAN SCIENCES DON T FORGET TO RECODE YOUR MISSING VALUES

Skewed Data and Non-parametric Methods

Chapter 2 Probability Topics SPSS T tests

Examining Differences (Comparing Groups) using SPSS Inferential statistics (Part I) Dwayne Devonish

Two-Sample T-Tests Assuming Equal Variance (Enter Means)

2 Sample t-test (unequal sample sizes and unequal variances)

A) B) C) D)

LAB 4 INSTRUCTIONS CONFIDENCE INTERVALS AND HYPOTHESIS TESTING

Stat 411/511 THE RANDOMIZATION TEST. Charlotte Wickham. stat511.cwick.co.nz. Oct

Lecture Notes Module 1

Analysing Questionnaires using Minitab (for SPSS queries contact -)

Good luck! BUSINESS STATISTICS FINAL EXAM INSTRUCTIONS. Name:

SIGNIFICANCE OF WORKING CAPITAL TURNOVER RATIO: A CASE STUDY OF BHEL AND CROMPTON GREAVES

Effect of Smart Classroom Learning Environment on Academic Achievement of Rural High Achievers and Low Achievers in Science

Projects Involving Statistics (& SPSS)

INTERPRETING THE ONE-WAY ANALYSIS OF VARIANCE (ANOVA)

An Introduction to. Metrics. used during. Software Development

Two-Sample T-Tests Allowing Unequal Variance (Enter Difference)

AGILE Burndown Chart deviation - Predictive Analysis to Improve Iteration Planning

A Case study based Software Engineering Education using Open Source Tools

Mind on Statistics. Chapter 13

Confidence Intervals for Cp

Chapter 2 Simple Comparative Experiments Solutions

Lesson 1: Comparison of Population Means Part c: Comparison of Two- Means

PTC Thermistor: Time Interval to Trip Study

CALCULATIONS & STATISTICS

An Introduction to Statistics Course (ECOE 1302) Spring Semester 2011 Chapter 10- TWO-SAMPLE TESTS

Difference of Means and ANOVA Problems

How To Test For Significance On A Data Set

Outline. Definitions Descriptive vs. Inferential Statistics The t-test - One-sample t-test

THE DEVELOPMENT OF WAREHOUSE MANAGEMENT SYSTEM BY RADIO FREQUENCY IDENTIFICATION (RFID) TECHNOLOGY: A CASE STUDY OF ELECTRIC APPLIANCE FACTORY

NCSS Statistical Software

A Six Sigma Approach for Software Process Improvements and its Implementation

Simple Linear Regression Inference

THE FIRST SET OF EXAMPLES USE SUMMARY DATA... EXAMPLE 7.2, PAGE 227 DESCRIBES A PROBLEM AND A HYPOTHESIS TEST IS PERFORMED IN EXAMPLE 7.

1. What is the critical value for this 95% confidence interval? CV = z.025 = invnorm(0.025) = 1.96

Comparing Means in Two Populations

Chapter 4 and 5 solutions

General Method: Difference of Means. 3. Calculate df: either Welch-Satterthwaite formula or simpler df = min(n 1, n 2 ) 1.

Part 3. Comparing Groups. Chapter 7 Comparing Paired Groups 189. Chapter 8 Comparing Two Independent Groups 217

ABSORBENCY OF PAPER TOWELS

12: Analysis of Variance. Introduction

Testing for differences I exercises with SPSS

Chapter 7 Notes - Inference for Single Samples. You know already for a large sample, you can invoke the CLT so:

Modeling Software Maintainability and Quality Assurance in the Agile Environment

Impact of Enrollment Timing on Performance: The Case of Students Studying the First Course in Accounting

SOFTWARE PERFORMANCE EVALUATION ALGORITHM EXPERIMENT FOR IN-HOUSE SOFTWARE USING INTER-FAILURE DATA

Module 4 (Effect of Alcohol on Worms): Data Analysis

Factors affecting online sales

Two-sample hypothesis testing, II /16/2004

Chapter 5 Analysis of variance SPSS Analysis of variance

Section 13, Part 1 ANOVA. Analysis Of Variance

TRINITY COLLEGE. Faculty of Engineering, Mathematics and Science. School of Computer Science & Statistics

Two-sample inference: Continuous data

THE FACTORS AFFECTING ADOPTION of CLOUD COMPUTING TECHNOLOGY in EDUCATION INSTITUTIONS

Confidence Intervals for Cpk

MULTIPLE CHOICE. Choose the one alternative that best completes the statement or answers the question.

Analysis of Variance ANOVA

Statistics Review PSY379

Paired 2 Sample t-test

Project Management Guidebook

Module 5: Statistical Analysis

Implementing Best Practices: The Procurement Maturity Model

Unit 31 A Hypothesis Test about Correlation and Slope in a Simple Linear Regression

Non-Inferiority Tests for Two Means using Differences

Human Resource Development Practices in Telecom Sector in Saudi Arabia: An Empirical Presentation

A Research Methodology For CRM A New Research Approach

Course Overview Lean Six Sigma Green Belt

Nonparametric Two-Sample Tests. Nonparametric Tests. Sign Test

Fairfield Public Schools

Optimization of Software Quality using Management and Technical Review Techniques

A Comparison of E-Learning and Traditional Learning: Experimental Approach

Confidence Intervals for the Difference Between Two Means

Analysis of Variance (ANOVA) Using Minitab

Analysis of Variance. MINITAB User s Guide 2 3-1

Foundation of Quantitative Data Analysis

EHR IMPLEMENTATION SURVEY: Proactive Consideration and Planning Lead to Successful EHR Implementation

Recall this chart that showed how most of our course would be organized:

Data Validation and Data Management Solutions

BA 275 Review Problems - Week 5 (10/23/06-10/27/06) CD Lessons: 48, 49, 50, 51, 52 Textbook: pp

Erik Parner 14 September Basic Biostatistics - Day 2-21 September,

HYPOTHESIS TESTING WITH SPSS:

Comparison of JSON and XML Data Interchange Formats: A Case Study

Data Analysis Tools. Tools for Summarizing Data

INTERNAL AUDIT REPORT ON THE FINANCIAL MANAGEMENT CONTROL FRAMEWORK FOR INITIATIVES RELATED TO CANADA S ECONOMIC ACTION PLAN (EAP) REPORT.

t Tests in Excel The Excel Statistical Master By Mark Harmon Copyright 2011 Mark Harmon

Consider a study in which. How many subjects? The importance of sample size calculations. An insignificant effect: two possibilities.

Stock Market Volatility during the 2008 Financial Crisis

ISyE 2028 Basic Statistical Methods - Fall 2015 Bonus Project: Big Data Analytics Final Report: Time spent on social media

Six Sigma in Project Management for Software Companies

Earned Value Management for Enterprise Resource Planning Implementations

A Robustness Simulation Method of Project Schedule based on the Monte Carlo Method

Cloud FTP: A Case Study of Migrating Traditional Applications to the Cloud

Use of Human Big Data to Help Improve Productivity in Service Businesses

Hypothesis Testing: Two Means, Paired Data, Two Proportions

Transcription:

Challenges and Implementation of Effort Tracking System Shalu Gupta Senior Technical Officer Nilesh Kumar Dokania Assistant Professor C-DAC Noida Guru Nanak Institute of Management C-56/1, Sector-62,Institutional Area, West Punjabi Bagh Noida, 17 New Delhi International Journal of Engineering Research & Technology (IJERT) ABSTRACT Software project tracking is a dense and demanding task. It is difficult to measure effort spent on a project to determine a valid and concrete status since manual system of tracking effort suffers from loopholes and miscalculations which lead to ambiguous results. Ambiguity in information cannot be used to make strategic decisions. Measurement of effort spent on project is essential to predict to progress. This will further help to analyze the success factor of the project. An attempt is made in this paper to present the challenges faced in measuring effort exhausted in the project. This paper explores the innovative thoughts implemented to measure the efforts by developing RFID based effort tracking system. Effort Tracking System is designed to provide a transparent view of the organizational effort on a software project. The paper discusses about the architecture of Effort Tracking System, the inputs and outputs generated from the system. This paper discusses and compares the manual system of tracking effort with the Effort Tracking System using test of hypothesis. Statistical analysis is performed on these two data sets to determine which system provides the actual efforts drawn from employees by software projects. We have tried to show how the system helps the project managers in estimation, planning, identifying the critical factor for the project. Finally this paper presents some of the lessons learnt and the major benefit achieved in cost, schedule, quality, customer satisfaction by the organization. Keywords Hypothesis Testing, 1. INTRODUCTION Software project tracking encompasses the measurement of efforts invested on a project by the expert team. Manpower utilization is an important aspect of an organization s goal for successful implementation and delivery of a software project. As the work force increases, the need to manage and monitor the work force becomes a critical task. Therefore it is necessary to ensure that the work is uniformly distributed among the employees to obtain high production. Additionally, the amount of time dedicated by an employee to his work is requisite to measure the performance in order to track the effort and progress of the software project. Thus a system to trace the employee activities and to determine project status is essential for large organizations. Organizational heads need a report format to view and make decisions based on the work progress which can be provided easily by Effort Tracking System. In this paper, Section 2 and 3 discusses about the need for Effort Tracking System and the challenges faced by the system respectively. Section 4 specifies the architecture of Effort Tracking System and Section 5 explains test of hypothesis to measure the effectiveness of system. Section 6 give details about the major benefit achieved from the system. 2272

2. NEED FOR EFFORT TRACKING SYSTEM Effort tracking play a significant role in project management. This activity is pain of approximately every project manager. Tracking of effort spent is an essential requirement from senior management. Tracking of effort will give clear picture about the utilization of manpower in various projects. Effort Tracking System has been designed to monitor and track the time and effort invested on projects and other organizational activities by an employee. 1. The system helps to gain more insights about the set of tasks in which the employee is currently involved. 2. Effort Tracking System can be used as a workload management system where heavy and complex modules of a project can be detected by the time spent by the employees on the module. Job assignments can be adjusted based on the workload. 3. Software changes are implemented incrementally which further leads to issue of accurate effort tracking in projects. 4. Predicting effort variance in a project manually does not give precise picture of project status and health of a project. Manual calculation of effort variance can misguide senior management. So corrective actions required to be taken in the project at right time will be missed which may impact project seriously. 5. The actual effort devoted by the employees can be compared with the estimated effort required for a task. Based on the comparison, effort variance can be determined which can be use for revising estimation of project. 6. Reports can be generated for the senior management to formulate appropriate decisions regarding manpower, project progress, cost invested and investment decision on upcoming project. 3. MAJOR CHALLENGES FACED Implementation of Effort tracking system faces some of major challenges which eventually lead to a further evolved system. 1. Major hurdle for designing and implementing effort tracking system is integration of data from different sources like RFID attendance system for capturing attendance, project plan from Microsoft plan. 2. There are short of experience of new project managers to prepare project plan in detail so that effort tracking will be more precise. 3. There is lack of understanding by team members to provide the efforts spent in the project accurately. 4. Team members fill efforts based on a summarized or abstract view of the project rather than breaking down the efforts to miniature level. 5. One of the major challenges is to guide project team to use effort tracking system because they are adapted to manual system. Implementation of system is successful only when it used by all project teams in the organization to fill the effort spent in project in precise manner. 2273

4. ARCHITECTURE OF EFFORT TRACKING SYSTEM The effort tracking system tracks employee working status using RFID attendance, Project PERT and timesheet as input and processes this data to generate Employee Utilization Report, Detailed Project Effort and Summarized Project Effort. This system will help quality assurance team and senior management to get the effort variance detail in each project in just few seconds. RFID Attendance Project PERT Working hours per employee per day Planned effort, schedule EFFORT TRACKING SYSTEM Data Retrieval and Processing Employee Utilization Report Detailed Project Effort Report Timesheet Actual effort and schedule Summarized Project Effort Report Figure 1: Architecture of Effort Tracking System Table 1: Relationship of Input and Output Items in Effort tracking system Input Sources Input data to Tracking System Database RFID Attendance System Working hours per employee per day Project PERT Timesheet Planned Effort and planned schedule Actual Effort 4.1 Input components of Effort tracking System The major input components of Effort tracking System are: 1. RFID Attendance Attendance of the employees is captured through RFID Attendance System which is linked to the Effort Tracking System. The attendance is fed into the system to get information on daily working hours of the employees. 2274

2. Project PERT Figure 2: RFID Attendance PERT chart is prepared by the Project Leaders to anticipate the effort and schedule required for a project. The Planned effort and schedule is achieved through the Project PERT which also provides insights about the project modules and tasks. Figure 3: PERT Chart 2275

3. Timesheet The actual effort in man-hours is filled by the employees individually through their login based on their role and project involved in. Thus the actual effort and schedule can be retrieved through timesheet application. 4.2 Output components of Effort tracking System Figure 4: Entry of efforts by employees in timesheet The major output components of Effort Tracking System are: 1. Employee Utilization Report Employee Utilization Report shows the number of hours worked on a task by an employee. This report not only depicts the productivity of the employee but also how much time similar tasks will need to complete. This report will help senior management to know the efficiency of a employee. Figure 5: Employee Utilization Report 2276

2. Detailed Project Effort Detailed Project Effort displays the total effort put in by all the team members in the project segregated module-wise. Some projects require onsite efforts, such tasks and jobs are also detailed in this report. This report is most critical outcome of Effort tracking system is to predicate effort spent in the project. Based on analysis of this report senior management will decide about the corrective action or any proactive approach is required in the system. Figure 6: Detailed Project Effort Report 3. Summarized Project Effort A summary report of efforts invested on a project is easy to understand that shows the total efforts invested in a given time frame on the project. Such reports are generally used by senior management to make strategic decisions regarding the flow of the project, re-adjustment of manpower. This report will guide project managers to revise estimation or reestimate the project if requires. This report will further contribute in calculating effort variance in a project module wise. Figure 7: Summarized Project Effort Report 2277

5. TEST OF HYPOTHESIS TO MEASURE THE EFFECTIVENESS OF SYSTEM Need of Test of Hypothesis is to statistically quantify the certainty of an observation or experiment. We conducted the hypothesis testing on effort variance data calculated manually or through Effort tracking system. Statistical analysis is performed on data using Normality test, F Test and T Test to ascertain the results of the observation and tests performed on data. 1. Normality Test: Normality test also called as Gaussian test, determines whether the data set follow normal distribution or not. Since various statistical tests (e.g. t-test) require that the data is normally distributed therefore violation of this assumption is verified first. When the p-value of the probability plot is greater than 0.05 then it is concluded that data set is normal. 2. Test for equal variances (F test): F-Test is performed on normally distributed data to test for two groups of data sets have equal standard deviation with specified confidence level. If the p-value is greater than 0.05 then there is no enough evidence to state that the groups have unequal variances. Thus, the next step is to perform the t-test. 3. Test for equal means (t test): 2 Sample t-tests is performed with data set retrieved for two groups of process size to test for equal means. This test compares the average difference between the two groups and when the p value is greater than 0.05 then there is no evidence of a difference in mean resulting in keeping both the groups of data sets in the same bucket. Step 1: Efforts invested by employees and calculated using manual method is denoted using B-1 and efforts calculated by the Effort Tracking System is denoted using B-2. Percent 99 95 90 80 70 60 50 40 Probability Plot of B-1 Normal Mean 19.86 StDev 5.721 N 21 AD 0.661 P-Value 0.073 Percent 99 95 90 80 70 60 50 40 International Journal of Engineering Research & Technology (IJERT) Probability Plot of B-2 Normal Mean 40.59 StDev 9.904 N 37 AD 0.353 P-Value 0.447 5 5 1 5 15 B-1 25 35 1 40 B-2 50 60 70 Figure 8: Probability Plot of Normality Test performed on B-1 and B-2 As per the normality graph with 95% of the Confidence Interval P value is coming 0.073 which is >0.05 therefore we can conclude that B1 data is following normal distribution. Similarly, the normality graph with 95% of the Confidence Interval p-value is coming 0.447 which is >0.05 therefore we can conclude that B2 data is following normal distribution. Step 2: Test for Equal Variances: Tests for Equal Variances for B1 and B2 is performed on data sets to determine whether both have same standard deviation with specified confidence level or not. 2278

Test for Equal Variances for B-1, B-2 B-1 B-2 F-Test Test Statistic 0.33 P-Value 0.011 Levene's Test Test Statistic 4.51 P-Value 0.038 4 6 8 12 95% Bonferroni Confidence Intervals for StDevs 14 B-1 B-2 Data 40 50 60 Figure 9: Test for Equal Variances for B1 and B2 and result of F-Test Therefore, as per the results of Test for Equal Variances with 95% of the Confidence Interval p- value is coming 0.011 which is <0.05 therefore we can conclude that B-1 and B-2 variances are unequal. Step 3: Test for Equal Means: B-1, B-2 Table 2: Result of Two-Sample T-Test Two-sample T for B-1 vs B-2 N Mean StDev SE Mean B-1 21 19.86 5.72 1.2 B-2 37 40.59 9.90 1.6 Difference = mu (B-1) - mu (B-2) Estimate for difference: -.74 95% CI for difference: (-24.85, -16.63) T-Test of difference = 0 (vs not =): T-Value = -.11 P-Value = 0.000 DF = 55 As per the results of Test for Equal Means with 95% of the Confidence Interval p-value is coming 0.000 which is <0.05 so it can be concluded B-1 does not show the real picture of efforts put in by the employees and B-2 means are unequal thereby holding the assumption true. The hypothesis testing outcome clearly shows that there is difference in effort variance data calculated manually or using effort tracking system. 6. BENEFITS OF EFFORT TRACKING SYSTEM Some benefits of using effort tracking system are: 1. Effort Tracking System aids in measuring the effectiveness of project health and progress. 2. It measures the efficiency of team and individuals in a project involved. 2279

3. It determines the lessons learnt based on the involvement and efforts spent in a software project. 4. The health and progress status helps the senior management to make critical project decisions. 7. CONCLUSION Effort Tracking System results into a clear picture of the involvement of organizational workforce on various projects and the individual efforts absorbed by these projects. Effort tracking in a project contributes to highlights the lessons learnt during project implementation which can be used to measure the effectiveness of the overall project progress. Implementation of automated tool helps in turning the stable process to mature capable process. 8. REFERENCES [1] Kazuhiro Esaki, Yuki Ichinose, Shigeru Yamada Statistical Analysis of Process Monitoring Data for Software Process Improvement and Its Application American Journal of Operations Research, 12. [2] K. Harihara Sudhan and Umesh Kumar Mishra" Improving Software Processes using Statistical Process Control and Experimental Design"CiiT International Journal of Software Engineering and Technology, Apr. 11, Coimbatore [3] Neville Turbit "Measuring Project Health" Project perfect white paper collection,sep.09 [4] S. Yamada and A. Kawahara, Statistical Analysis of Process Monitoring Data for Software Process Improvement, International Journal of Reliability, Quality and Safety Engineering, Vol. 16, No. 5, 09, pp. 435-451. [5] S. Yamada, T. Yamashita and A. Fukuta, Product Quality Prediction Based on Software Process Data with Development-Period Estimation, International Journal of Systems Assurance Engineering and Management, Vol. 1, No. 1,, pp. 72-76. [6] S. Yamada and T. Fukushima, Quality-Oriented Soft-ware Management, Morikita-Shuppan, Tokyo, 07. [7] T. Fukushima and S. Yamada, Improvement in Software Projects by Process Monitoring and Quality Evaluation Activities, Proceedings of the 15th ISSAT International Conference on Reliability and Quality in Design, 09, pp. 265-269. About Authors International Journal of Engineering Research & Technology (IJERT) Ms. Shalu Gupta is working as Scientist- C in C-DAC Noida. She is certified Project Management Professional. She has ten years of experience in software development and pursuing MTech. She has worked in the field of NMS, SNMP, Optical comm., DSLAM OCR and Quality Assurance. She has worked in various companies like C-DoT, Wipro Technology and Flextronics Software Systems. Currently she is associated with the Quality Assurance Group. She has published 9 international and national research papers. Her area of interest includes Software Quality Assurance and Software Metrics. Mr. Nilesh Kumar Dokania is working as an Assistant Professor in Guru Nanak Institute Of Management, Punjabi Bagh (New Delhi), affiliated by GGSIPU. He has eleven years of experience in Computer science and Information Technology. He has done B.E (C.S.E) with First Class with Distinction from SMIT and MTech.(C.S.E) Gold Medalist from Amity University. He has published various international and national research papers. He has also published various research articles in various Journals with good impact factor. He has also contributed to the study materials for IGNOU. He has guided various Master level students in their projects and research. His area of interest includes Digital image processing, Steganography, Software Quality Assurance, Software Testing. 2280