Institutionen för datavetenskap Department of Computer and Information Science

Transcription

1 Institutionen för datavetenskap Department of Computer and Information Science Final Thesis Developing a method for an ERP system user interface beta test program by Isak Eriksson Andreas Johansson LIU-IDA/LITH-EX-A--08/052--SE Linköpings universitet SE Linköping, Sweden Linköpings universitet Linköping

2

3 Linköping University Department of Computer and Information Science Final Thesis Developing a method for an ERP system user interface beta test program Isak Eriksson Andreas Johansson LIU-IDA/LITH-EX-A--08/052--SE Supervisor and examiner: Stefan Holmlid Supervisor at IFS: Kristina Sthengel-Lund

4

5 Abstract With this thesis we have been interested in how to utilise an user interface beta test period. Which activities are appropriate to be performed, with focus on how activities contribute to user interface validation, further user interface improvements, and improvements of the user interface roll out. Additionally we have tried to couple this to end user satisfaction and acceptance of this new user interface, since the usage of the system is mandatory for the end users. We have approached this by developing a method that is based on four different perspectives. Three perspectives are studied theoretically, and one perspective is based on empiric research. These perspectives are separate from each other; to combine them we have used a common denominator of increased system usage. This denominator is derived from a viewpoint upon end users and how user satisfaction, user acceptance, and behaviour incentives for usage affect the perspectives and consequently our result. This broad research has resulted in a self sustaining method that we describe both in an overview and in greater detail explain the beta period and the associated roles, the different activities and how they should be executed in relevance to time. For every activity a table of considerations, i.e. when, who, how, and why are presented together with an explanation how the activity can influence end users to use the system. We conclude that the result of this thesis will aid and guide vendor companies through the beta testing program of a new user interface. The resulting method determines which activities that can be of interest to carry out and how these will contribute to future development and/or improve roll out. By utilising this method as a framework we see the possibility to incorporate it in an existing usercentred development process, but it can also be used as a simple, straightforward, and self sustaining method.

6

7 Sammanfattning Med detta examensarbete har vårt intresse varit att ta reda på hur man kan nyttja ett betatestprogram för ett användargränssnitt. Med ett fokus på vilka aktiviteter som är lämpliga att genomföra och hur kan dessa aktiviteter möjligen kan bidra till gränssnittsvalidering, bidra till förbättringar av gränssnittet och bidra till att förbättra utrullningen av gränssnittet. Ytterligare har vi varit intresserade av att koppla dessa aktiviteter mot slutanvändares nöjdhet och acceptans av ett nytt användargränssnitt. Vi har adresserat detta genom att utveckla en metod som är baserad på fyra skiljda perspektiv, det vill säga fyra utgångspunkter att arbeta utifrån. Tre av dessa perspektiv har vi studerat litterärt och det fjärde har vi studerat genom insamling av empirisk data. Dessa perspektiv är skilda från varandra, och för att kunna sammanbinda dem har vi använt oss av en gemensam nämnare av ökat systemanvändande. Denna gemensamma nämnare kommer från en syn på slutanvändare och hur nöjdhet, acceptans och incitament för användande påverkar perspektiven och slutligen resultatet. Denna breda studie har givit resultat genom en fristående metod som beskriver betatestprogrammet både översiktligt och mer utförligt. Detta görs med hänsyn till de olika aktiviteterna, de roller som krävs för dessa samt att detta tillsammans är kopplat mot tiden. För varje aktivitet beskrivs när, hur, vem och varför i en samlad tabell tillsammans med en beskrivande och förklarande text. Dessutom beskrivs det i samband med detta hur aktiviteten kan influera slutanvändarna positivt eller negativt, kopplat till ett ökat systemanvändande. Vi drar slutsatsen att detta kommer underlätta och hjälpa företag att planera och genomföra betatestprogram för nya användargränssnitt. Den resulterande metoden underlättar valet av vilka aktiviteter som kan vara intressanta att genomföra samt hur dessa bidrar till framtida utveckling och/eller förbättrar utrullning. Genom att använda denna modell som ett ramverk, ser vi en möjlighet att den kan integreras mot en existerande användarcentrerad utvecklingsprocess. Men vi ser även att den kan användas som en enkel och fristående metod.

8

9 Acknowledgement Our work with this thesis begun in the beginning of June 2008, now approximately five months later the work is coming to an end. This thesis is executed on commission by IFS. The thesis has required a lot of effort and commitment and we wouldn t have been able to get the job done without the help of others. We want to thank the following persons for their support and feedback: Kristina Sthengel Lund, our supervisor at IFS, who guided us throughout our work, gave valuable feedback, made us feel welcome at IFS, and inspired us with her positive attitude. Stefan Holmlid, examiner and supervisor at Linköping University, for excellent guidance and comments. Rickard Bondesson, our opponent, for valuable feedback and comments. The employees at the Foundation1 department at IFS, for embracing us with a really friendly working environment and a lot of fun. Our interviewees, for gladly contributing with their input to the thesis. We also want to thank our family and friends for their continuous support! Linköping, 21 November 2008 Isak Eriksson Andreas Johansson

10

11 Table of Contents PART I Introduction Industrial and Financial Systems Enterprise Resource Planning systems Thesis background Problem discussion Thesis purpose Problem formulation Thesis perspectives Thesis structure Thesis contribution Academic contribution Contribution for IFS Directives and delimitations Directives Delimitations Target audience Methodology Research approach Exploratory Descriptive Explanatory Normative Our view Epistemology Positivism Hermeneutic Our view Credibility Validity Reliability Objectivity I

12 Our view Generalisation Our view Values and assumptions Our view Relation between theory and reality Inductive Deductive Our view Qualitative and quantitative Our approach Data collecting Interviews Literature study PART II The IFS perspective IFS Enterprise Explorer Top five time waster News in IFS Enterprise Explorer IFS Enterprise Explorer Alpha Test IFS Plans for the Early Adopter Program Program purpose Time schedule IFS feedback process openifs and openifs Wiki IFS Applications 7.5 beta testing in Poland Result from interviews with IFS consultants Increased system usage Antecedents to usage Mandatory use environment Combining user satisfaction and technology acceptance Common denominator Enterprise Resource Planning system perspective Implementation and roll out issues II

13 Critical success factors Most cited factors ERP system upgrade Reasons for upgrading Less problematic and more controllable Customer product testing perspective Software testing System testing Alpha test Beta test Existing beta test methods Interface and usability perspective User feedback and usability Feedback methods Usability testing and evaluation Combining Feedback methods Feedback focus Remote usability evaluation and feedback User initiated feedback How to choose participants Quantitative usability goals Qualitative usability goals Follow up studies PART III Method description for beta testing period Method description Pre beta Planning of beta testing program Introduction of the system Training and education Feedback methods Questionnaires Observations Combining feedback methods III

14 8.4. Feedback activities Training evaluation User satisfaction evaluation IT agility evaluation Usability testing Usability evaluation Combined feedback methods and activities User community User initiated feedback Other activities and considerations User groups Factors for considerations Post beta Project summary Input for new design Conclusion Discussion Feasibility and practicability Time, role, and activity The result of our method at IFS Bootstrap Generalisation Alternative approach Further research References Appendix I Interview template Fredric Travaglia Appendix II Interview template Johan Olofsson Appendix III Interview template for IFS consultants Appendix IV IFS Enterprise Explorer and the traditional Windows client Appendix V Component view of IFS Applications Appendix VI Role definitions Appendix VII Roles in the different phases IV

15 List of Figures FIGURE 1 CONCEPTUAL VIEW... 4 FIGURE 2 THESIS STRUCTURE OVERVIEW... 6 FIGURE 3 IFS FIVE TEST AND DEVELOPMENT STAGES FIGURE 4 EAP TIME PLAN FROM IFS SLIDE SHOW MATERIAL FIGURE 5 IFS FEEDBACK PROCESS FIGURE 6 TECHNOLOGY ACCEPTANCE MODEL FIGURE 7 RELATIONSHIP AMONG FACTORS FROM AMOAKO GYAMPAH'S RESEARCH FIGURE 8 RELATIONSHIP AMONG FACTORS FROM CALISIR & CALISIR'S RESEARCH FIGURE 9 WIXOM & TODD S INTEGRATED MODEL FIGURE 10 A MODEL OVER THE FEEDBACK PROCESS FIGURE 11 EXAMPLE OF TOPIC FIGURE 12 EXAMPLE OF CONTRIBUTING FACTORS FIGURE 13 EXAMPLE OF FEEDBACK METHOD FIGURE 14 METHOD OVERVIEW FIGURE 15 IFS ENTERPRISE EXPLORER SHOWING ENTERPRISE APPLICATION SEARCH FIGURE 16 IFS ENTERPRISE EXPLORER SHOWING NAVIGATION FILTER FIGURE 17 IFS ENTERPRISE EXPLORER SHOWING NOTES FIGURE 18 IFS ENTERPRISE EXPLORER SHOWING BREADCRUMBS FIGURE 19 IFS ENTERPRISE EXPLORER SHOWING RECENT SCREENS FIGURE 20 IFS ENTERPRISE EXPLORER SHOWING A VOUCHER ENTRY FIGURE 21 IFS TRADITIONAL WINDOWS CLIENT SHOWING A VOUCHER ENTRY FIGURE 22 IFS APPLICATIONS COMPONENT CHART FIGURE 23 ROLES DURING PRE BETA FIGURE 24 ROLES DURING PHASE FIGURE 25 ROLES DURING PHASE FIGURE 26 ROLES DURING PHASE FIGURE 27 ROLES DURING POST BETA V

16

17 List of Tables TABLE 1 DIFFERENCES IN FOCUS BETWEEN QUALITATIVE AND QUANTITATIVE RESEARCH TABLE 2 TOP FIVE TIME WASTERS ACCORDING TO IFS USABILITY SURVEY TABLE 3 LESSONS LEARNED FROM INTERVIEW WITH JOHAN OLOFSSON TABLE 4 FACTORS WITH DIFFERENT PERSPECTIVES ON ERP CSFS TABLE 5 ISSUES WITH USABILITY TESTING DURING A BETA TEST PROGRAM TABLE 6 OVERVIEW OF MAYHEW S FIVE FEEDBACK METHODS TABLE 7 COMPARISON BETWEEN ONLINE AND TRADITIONAL FOCUS GROUPS TABLE 8 REMOTE USABILITY TESTING AND EVALUATION METHODS TABLE 9 SEVERITY ESTIMATION OF USABILITY PROBLEMS TABLE 10 DIFFERENT TYPES OF PARTICIPANTS TABLE 11 MAYHEW'S USABILITY GOALS TABLE 12 ASSOCIATED ROLES TABLE 13 PLANNING OVERVIEW TABLE 14 INTRODUCTION OVERVIEW TABLE 15 TRAINING AND EDUCATION OVERVIEW TABLE 16 OBSERVATION OVERVIEW TABLE 17 TRAINING EVALUATION OVERVIEW TABLE 18 USER SATISFACTION OVERVIEW TABLE 19 IT AGILITY OVERVIEW TABLE 20 USABILITY TESTING OVERVIEW TABLE 21 EVALUATION MEASURES FROM THEORETICAL FRAMEWORK IN CHAPTER 7.2 AND TABLE 22 EASE OF LEARNING OVERVIEW TABLE 23 EASE OF USE OVERVIEW TABLE 24 USER COMMUNITY OVERVIEW TABLE 25 USER INITIATED FEEDBACK OVERVIEW TABLE 26 USER GROUPS OVERVIEW TABLE 27 PROJECT SUMMARY OVERVIEW TABLE 28 INPUT FOR NEW DESIGN OVERVIEW TABLE 29 ROLE DEFINITIONS VII

18

19 Abbreviations CTO CSF EAP EAS ERP IFS IS IT LCS MRP R&D PR SOA SP TAM Chief Technology Officer Critical Success Factors Early Adaptor Program Enterprise Application Search Enterprise Resource Planning Industrial and Financial Systems Information System Information Technology Life Cycle Support Material Resource Planning Research and Development Public Relations Service Oriented Architecture Service Pack Technology Acceptance Model IX

20

21 PART I In this part we introduce the reader to the subject of our thesis. The reader will be informed of the problem description, contribution, and purpose of this thesis. We will describe which methods we have used during our research, giving the reader academic background and a possibility to estimate our method for approaching the subject. After reading this first part the reader should feel conversant with our research approach as well as the purpose and goal of this thesis.

22

23 Introduction 1. Introduction The goal with this chapter is to give the reader background information about IFS and an introduction to the subject of our thesis. After reading this chapter the reader should understand the purpose with this thesis and the structure of it Industrial and Financial Systems IFS is an acronym and stands for Industrial and Financial Systems. IFS was founded in 1983 by five engineers from the Linköping University in Sweden. IFS first job required many man hours and working hours was not bound solely to daytime. Consequently the founders pitched up a tent right outside the customers head quarter so they could be accessed all the time. This is still one of IFS foundational customer approaches where IFS is: close to the customer. IFS is an Enterprise Resource Planning (ERP) vendor which in 1990 released their first complete ERP suite, IFS Applications and during the following ten years there was rapid growth of the company. This resulted in that IFS became represented on each continent in the world in In 2005 IFS got more than 500,000 users. In 2007 IFS reached 600,000 users on IFS Applications with 2,000 customers globally. (Söderström, Internet source, 2008 and Om IFS, Internet source, 2008) Accordingly to IFS global web page they phrase their business mission as following (Our business concept, Internet source, 2008): With its own resources, and in collaboration with partners, IFS develops, sells, and implements the component based business software, IFS Applications IFS as an ERP vendor focus their application suit on seven types of industries: Aerospace and Defence Automotive Constructing, Contracting and Service Management Manufacturing Process Industries Retail & Wholesale Utilities and Telecom (Söderström, Internet source, 2008) IFS Applications is a component based ERP suit built on SOA technology. From all IFS Applications components the customers can choose to implement a desired amount. This makes IFS Applications agile and flexible so that it can suit both large and small companies. Appendix V shows the components that make up IFS applications suit. The components are divided into different functional areas. Irrespective of which components that are selected the Foundation1 of IFS Applications has to be installed. The Foundation1 is the functional base of IFS 1

24 Introduction Applications that is needed in order for the rest of the components to operate and collaborate. This gives a short description of the software product that IFS develop, maintain, update, distribute, and implement Enterprise Resource Planning systems This chapter gives the reader not familiar with ERP systems a brief introduction to the subject. Enterprise Resource Planning (ERP) systems have its roots from the Material Requirements Planning (MRP) software that developed during the late 1970s. The MRP system planned requirements for parts or products according to the company s master production schedule. Therefore facilitating the extensive planning included in the production. In the 1980s the MRP was extended by synchronising the materials with the requirements for productions and including project management, distribution management, and more. This was called Manufacturing Resource Planning (MRPII) systems. (Rashid et al., 2002) Based on the MRP and MRPII the whole enterprise business process was integrated into one consistent system in the late 1980s and early 1990s. This new completely integrated solution relies on one central data base for the whole organisation and is called Enterprise Resource Planning (ERP) systems. ERP systems include manufacturing, distribution, accounting, finance, human resource management, project management, inventory management, and service and maintenance management. Later ERP systems functionality increased and is to be called extended ERP. Extended ERP includes advanced planning and scheduling capabilities and is often referred to as simply; ERP. This is the definition that we will use throughout this thesis. (Rashid et al., 2002) 1.2. Thesis background IFS is in progress of developing a new user interface for their ERP system: IFS Applications. IFS traditional user interface will be replaced by the new user interface called; IFS Enterprise Explorer, during The traditional interface is a Windows client while IFS Enterprise Explorer is based on rich web client. IFS Enterprise Explorer will have roughly the same functionality as the traditional interface but will provide a new look and an improved user interface. The new graphical user interface is one of the first deliverables from the IFS Aurora Program, which is the company s focus program for increased user productivity. (See chapter 3.1 and 3.2 for more information about IFS Enterprise Explorer) During late autumn in 2008 IFS will launch a beta testing program for IFS Enterprise Explorer called Early Adopter Program (EAP). Beta testing is the process where vendors externally test their product at customers real world and everyday environment (Patton, 2005 and Dolan & Matthews, 1993). A more detailed description of what a beta test is can be found in chapter The EAP allows a few IFS customers to run IFS Enterprise Explorer in their production environment, performing daily activities. IFS aim during the EAP is to ensure the 2

25 Introduction quality and functionality of IFS Enterprise Explorer by involving and collecting feedback from customers and end users. IFS wants to ensure that the introduction of IFS Enterprise Explorer on the market becomes a success by addressing end user problems before the production release. A system cannot be successful if it s not used by end users (Amoako Gyampah, 2007) neither can unused or misused systems improve organisational performance (Davis et al., 1989). Therefore it s essential to ensure system usage of IFS product Problem discussion In previous releases IFS have not worked with beta tests, with an exception for a beta test in Poland in 2007 (see chapter 3.6). Therefore IFS have no developed and well tried beta testing methodology. In this case the beta test concerns their new user interface IFS Enterprise Explorer, consequently it differs from the beta test held in Poland. Therefore IFS needs a method for testing their interface during the EAP. It s important to find out how the interface can be tested during the beta test, without reliance from a complete and well tried usability development process. Therefore the beta test process needs to be self sustaining, without dependencies from previous usability and design objectives and test results. The new user interface provides a completely new design and several new features and functions that do not exist in the traditional Windows interface. The business logic is not changed but this will still affect the end users and their everyday work. There is a need for IFS to test their interface and get feedback from the users and customers. Therefore feedback collecting activities should, if possible, be modified to increase the user satisfaction and decrease the resistance to change. However with limited resources it is important to find which activities that can be conducted and by whom. This gives incentives for a method that identifies roles and links them with feedback and testing activities Thesis purpose The purpose of this final thesis is to develop a method that describes how to utilise a user interface beta test program with focus on user interface validation, user interface improvements, and improvements of the user interface roll out Problem formulation In order to fulfil the thesis purpose we have concretised problems which need to be researched. Which activities are appropriate to perform? Who are involved in these activities? 3

26 Introduction When in time should the activities be performed? How does this affect the end users? 1.6. Thesis perspectives Figure 1 shows a conceptual picture over the parts that are included in our thesis. It visualise the different parts of the thesis and how they depend on each other. Increased system usage Interface and roll out improvements Feedback methods Timeframe and roles Topics of interest Figure 1 Conceptual view The Topics of interest represent the topics that we have found interesting to evaluate during a beta test period. The Timeframe and roles layer represents the different roles we have identified and the timeframe when they need to be used during a beta test period. The Feedback methods layer represents the different feedback methods that should be used and how these should be planned during a beta test period. The Interface and roll out improvements layer represents the part where we try to explain what activities can lead to feedback about the user interface or the roll out of the system. The Increased usage layer represents the viewpoint of how different activities can increase the end users usage of the system. We urge the reader to have the conceptual outline, from figure 1, in mind when reading further. This since we believe that the reader will get more out of this thesis by sharing our conceptual view. When developing a method for the Early Adopter Program (EAP) many different viewpoints or perspectives can be taken in order to comprehensively cover the 4

27 Introduction subject. To be able to succeed with our purpose of this thesis, we think it is vital to look on the research from different perspectives. This was not obvious at first but it became clearer with time that this was necessary for our report. During the early stages of our thesis work we had an interview with Fredric Travaglia at IFS. He has worked a lot with the IFS implementation method and briefed us about it. The interview will not be presented further in this thesis but we want to mention it as it has influenced us in our choice of perspectives. Our intent is to cover our purpose broadly and try to get information from different sources to be able to see how it s possible to utilise the EAP in a good way. The reader should be aware of that a broad picture of the subject is our goal and therefore only few interesting parts are investigated deeply. We have thus selected four different perspectives, presented in the bullet list below, for our future research. ERP implementation and roll out Customer product testing Interface and usability perspective The IFS perspective ERP implementation and roll out IFS Enterprise Explorer is, as mentioned before, the new interface for IFS Applications 7.5 and further releases. Thus the interface is a part of the ERP suite and will affect future implementations and roll outs of IFS ERP Suite. Therefore we have chosen to investigate which factors that could be of interest to examine from an ERP implementation and roll out perspective. Customer product testing The EAP is a beta testing period for IFS Enterprise Explorer, or in other words; a customer product testing period. Therefore it s important to include the customer product testing perspective into our research. Interface and usability perspective IFS Enterprise Explorer is the new user interface that the Early Adopter Program focus is on, therefore we have chosen to use interface and usability as one of our perspectives from which we perform our research. We have chosen this perspective to be able to investigate different feedback methods, i.e. what kind of information can be gained from them and when is it appropriate to use them. The IFS perspective In order to make suggestions for IFS we have to investigate and understand the activities that they have planned. We also have to get insights in how their normal implementing activities are carried out, since it might affect the progress of this thesis. This is due to the possibility for us to provide suggestions for future roll 5

28 Introduction outs. We believe that IFS employees has vast amount of useful knowledge. This knowledge may be used to find out how the EAP can be utilised. Further has McLure Wasko & Faraj (2000) found from their literature study that knowledge is the one of the company s most important resources, since it represents intangible assets and routines. Thus we have chosen to include this in one of our four perspectives. Increased system usage As mentioned before (See 1.2) system usage is vital. If the system is not used enough it can never reach its full potential. While studying the subject of increased usage we found that it s not suited to be a perspective. Several perspectives give us incentives and ways for how to render and sort our findings from a broad literature study. Therefore we have chosen to use the topic of increased system usage as the common denominator to analyse the collected data from Thesis structure Our thesis is structured after four perspectives and a point of view which is a way of looking upon the literature we have studied. What we learn from our different perspectives is to be systemised into a suggested method for the EAP. We have chosen to structure our thesis by three advance organisers formatted as parts. Each part is a short statement that introduces and summarise the following material. Together this is visualised in figure 2 and results in the following structure: The IFS perspective, ERP system perspective, Customer product testing perspective, and Interface and usability perspective Four perspectives Increased system usage Common denominator Method Systemised into a method Figure 2 Thesis structure overview 6

29 Introduction PART I Introduction Introduces the reader to the subject of this thesis and gives background on our client IFS. Methodology Describes how our research is done and also declares how we have handled empiric findings. This chapter is mostly aimed at readers with an academic interest of our thesis. PART II The IFS perspective This chapter goes through the EAP from an IFS perspective. This is the base for one of our perspectives, the IFS perspective. Here the reader can find information concerning IFS activities and knowledge. Increased system usage Here we go through the different aspects that lead to a concluding statement that many factors concerning end users beliefs, acceptance, and satisfaction finally imply on increased usage. Enterprise Resource Planning system perspective We aim at looking upon factors that can influence the likelihood for IFS to succeed with their roll out of IFS Enterprise Explorer from an ERP perspective. We made a cross examination of important key factors based on literature. This research has preliminarily worked as a catalyst which has influenced our continuous work progress. Customer product testing perspective We investigate the subject from a perspective of the EAP being a customer product testing period. Interface and usability perspective The last of our perspectives origin from the fact that IFS Enterprise Explorer is a new user interface; this gives us a new angle of approach. PART III Method description for beta testing period Here we combine our result with no regard to which perspective the information descend from, but with a mindset on increased usage. This chapter is a result after the systematisation of data from the research on perspectives and the common denominator of increased system usage. As a whole, this chapter should been seen as the method that we propose. 7

30 Introduction Conclusion In this chapter we present the conclusions of this thesis. Discussion Here we discuss our proposed method and go through important discussion subjects such as feasibility, generalisation, and further research on the subject Thesis contribution In this chapter we will present the contribution of this final thesis from two perspectives. One perspective is the academic contribution, which entails a description of why this thesis is of interest from an academic point of view. We also make an explanation of why this thesis is of interest for IFS Academic contribution The contribution to the academic world with this thesis is in the systematisation of factors from different areas of literature. Our systematisation has resulted in a method that is linked to the dependencies of time, role, and activity during a specific timeframe in the development of a software interface. Thus the method can support and bring forward further research in the subject that intersects software engineering, usability engineering and a mindset on increased system usage. As far as our knowledge reaches we do not know of any method that is structured in the way ours is. Therefore this method might give incentives for future research and empiric tests in this area Contribution for IFS The contribution for IFS of this final thesis is a proposed method for how the customer testing product program, the EAP, can be utilised. Further the utilisation of the EAP will give IFS insight of what they can expect of the different activities we propose. It gives IFS an overview of the necessary roles and when in time they are active in connection to the different activities. As a result IFS gets knowledge of what can be done during the EAP, why it should be done and the human resources needed for it. However IFS has to recognise the value of each activity and see the potential benefits and sort out which activities they are willing to conduct. Because of the limited timeframe it might not be advisable to attempt to conduct every step in our method Directives and delimitations Here we introduce directives that are determined by IFS and the delimitations we have issued. We have chosen to present them separated from each other to make the difference between them more distinct (Björklund & Paulsson, 2003). 8

31 Introduction According to Björklund and Paulsson (2003) it s important to explain why and what implications each delimitation entail Directives These directives are given to us by our IFS supervisor. This only considers IFS Enterprise Explorer as a core/standard package. The outcome should be simple and straightforward. This only relates to customers moving from the traditional IFS Applications Windows client user interface to IFS Applications with the IFS Enterprise Explorer user interface Delimitations Due to the nature of this final thesis the process of setting delimitations will be ongoing. Whenever new information is brought up some delimitation might be required to be set. Therefore this is an evolving phase of our thesis and is not able to be complete from the beginning. The delimitations will help us to get a congregated thesis that will demand commitment and engagement. We address the thesis problem from four major perspectives and in connection to a beta test program. These are to delimit the scope and vastness of the thesis. Other perspectives will not be addressed. We will not consider business process reengineering factors of IFS Enterprise Explorer implementation or any other organisational impacts unless they are connected to end user impact. This thesis will only concern the scope of a beta test, limited by the EAP. This delimitation is necessary so that the thesis framework have a delimitation that limits its scope in a suitable manner. Since the EAP only gives opportunities to study customers moving from IFS Applications Windows client to IFS Enterprise Explorer, it s logical for us to focus only on customers that already have IFS Applications installed Target audience We have identified two separate audience groups that will find interest in reading our thesis. Therefore we will have these two different groups in mind when writing. The first group is IFS employees who will take interest in this thesis. There might also exist interest from other employees in the same branch but from another ERP vendor than IFS. The second target audience group is students and teachers, or researchers that will find an interest in this thesis from an academic point of view. 9

32 Introduction Both groups consist of educated persons, therefore this thesis will be written to fit these types of readers. 10

33 Methodology 2. Methodology In this chapter we present some choices that can be made about methodology, methods and the practical procedure when researching a topic. We present some of the different views on knowledge and how to perform research. In the end of every sub chapter our views and our way of working during this thesis are presented. After reading this chapter the reader knows which methods we used for this thesis Research approach The amount of available knowledge in the research field can be important when selecting what kind of a study that is going to be performed (Björklund & Paulsson, 2003). Below are four different approaches presented together with our approach Exploratory Exploratory research is especially useful when trying to clarify the understanding of a problem. These forms of studies are also useful when trying to seek new insights, to ask questions and when trying to shed new light on a phenomena (Saunders et al., 2003). Exploratory studies are mainly used when there are little knowledge in the current field of research thus making thoughtfulness and creativity a vital part of the research (Patel & Davidson, 2003). According to Saunders et al. (2003) there are three principal ways of conducting exploratory research: A search of the literature Talking to experts in the subject Conducting focus group interviews According to Gustavsson (2004) for exploratory purposes qualitative methods are the best choice Descriptive Descriptive studies are used when there is basic understanding of the subject and the goal of the research is primarily to describe the subject in question (Björklund & Paulsson, 2003). According to Patel & Davidson (2003) descriptive research is focused on only some aspects of the phenomena that are of interest but these aspects are described thoroughly and the level of detail is high Explanatory Explanatory studies can be used when the aim is to both describe and explain the phenomena of interest (Björklund & Paulsson, 2003). According to Saunders et al. (2003) explanatory studies are characterised by establishing casual relationships 11

34 Methodology between variables. The same authors state that the emphasis in explanatory studies is to investigate a situation or a problem in order to explain the relationship between different variables. Quantitative methods are often the best choice for explanatory studies (Gustavsson, 2004) Normative Normative studies are used when there already exists some knowledge and understanding in the field of research and the aim is to give guidance and propose measures to take. (Björklund & Paulsson, 2003) Our view We believe that we have both a normative and an exploratory research approach. With existing knowledge and understanding in the research area we try to propose measures to take during a beta test period. This part of the study could be seen as to have a normative research approach. The part where we try to make use of a beta test in new ways could be seen as to have an exploratory research approach. We try to get insights about how to use a beta test in new ways and clarify how to use this information during roll out of the system and for interface improvements. We regard this to be an exploratory research approach Epistemology Two different epistemologies, perspectives of knowledge, dominate the literature: positivism and interpretivism. Interpretivism is also referred to as hermeneutic (Saunders et al., 2003). Epistemology is how the researcher views knowledge and the creation of knowledge (Björklund & Paulsson, 2003) Positivism A researcher adopting the principles of positivism tries to be an objective analyst, making interpretations about gathered data and tries to gather data in a valuefree manner (Saunders et al., 2003). Even though researchers have different views of positivism they share some fundamental aspects of what positivism means (Bryman, 2002). One of the things they have in common is that science should be objective. Another principle most positivist researchers share is the fact that one should use theory to generate hypothesis that could later be verified empirically through scientific methods. The researchers views and ideals should not influence the research, making it possible to replace the researcher without affecting the outcome of the research. (Patel & Davidson, 2003) Hermeneutic Hermeneutic could be seen as the opposite of positivism (Patel & Davidson, 2003). A bit simplified, this is due to the fact that a researcher adopting a hermeneutic view tries to understand reality and positivist researchers tries to explain reality (Arbnor & Bjerke, 1994). 12

35 Methodology Hermeneutic researchers believe that reality is a social construction. People place different interpretations on the situations they find themselves in and that these interpretations are likely to affect their actions and their social interactions with others. Thus in this sense people not only interact with their environment, they also tries to make sense of it through their own interpretations of different events and the meanings they draw from these. (Saunders et al., 2003) The hermeneutic researcher tries to interpret the research object in a subjective manner, thus the researcher own comprehension, thoughts, feelings and knowledge is a vital part of hermeneutic research (Patel & Davidson, 2003). According to Saunders et al. (2003) the role of the researcher is to understand the subjective reality of those they study in order to able to make sense of and understand their motives, actions and intentions in a way that is meaningful for these research participants Our view We believe that reality is a social construction; different people can interpret a situation differently. We also believe that it s hard to perform research that is truly objective and we believe that our own thoughts and pre comprehension about the subject will influence the research, as a result making our interpretations subjective. Our belief is also that other researchers that have a different backgrounds, knowledge and thoughts would not necessarily come to the same conclusions that we have. With all this in mind we conclude that we have a hermeneutic epistemology Credibility Validity, reliability and objectivity can be seen as a measurement of the credibility of scientific research. A researcher should always have these aspects in mind to improve the credibility of the research. (Björklund & Paulsson, 2003) Below are the three aspects and our view of them presented Validity Björklund & Paulsson (2003) define validity as in what extent the researcher really measure what is intended to be measured. According to Patel & Davidson (2003) the concern about validity is especially important when measuring abstract phenomena s. The same authors emphasise that one way of ensuring validity is to measure the same phenomena with different instruments and see if the result is the same. Björklund & Paulson (2003) agree and suggests that different perspectives should be used Reliability According to Saunders et al. (2003) reliability can be assessed by posing the three questions below. Will the measures yield the same results on other occasions? Will similar observations be reached by other observers? 13

36 Methodology Is there transparency in how sense was made from the raw data? Björklund & Paulsson (2003) suggest using several questions about the same thing when investigating a specific matter. This makes it possible to compare the answers and thus increase the reliability. The authors also suggest triangulation as a way to increase the reliability Objectivity Björklund & Paulsson (2003) define objectivity as to what extent the research is influenced by values. The same authors propose that the objectivity can be increased by clearly explaining the different choices done during the study and thus making it possible for the reader to assess the outcome of the research Our view A hermeneutic approach has some impact on the reliability of the research because a researcher trying to duplicate the research may not come to the same conclusions. We however try to explain the choices we have made for collecting data and how we have interpreted it, thus increasing the reliability. We believe that our research has been somewhat affected by our values, that comes with the hermeneutic approach. We have however tried to explain the different choices we have made, e.g. the perspectives chosen, and we believe that this makes it possible for the reader to assess our research. The objectivity is also increased by the fact that the research has its foundation in different academic theories. We believe that the validity of this kind of research is hard to define as it is not actually measuring something; it s more about systemising different sources and making sense out of these. With this said and the fact that one of the outcomes is a process method for a beta test period we believe that the feasibility of the method is more important. To ensure the validity we have only used academic literature and we have been supervised by senior and experienced people. We have been supervised from the university, thus it gives us a reassurance against the academic world. We have also been supervised from IFS, thus getting the view from the non academic world. Together we have worked as a team, discussed issues and therefore always get two views in each discussion. As a result we think that this improve the validity of this thesis. In order to ensure the reliability of this thesis we have used several academic sources to support our research. This gives us the chance to compare findings from these researchers findings, thus accordingly to Björklund & Paulsson (2003) increasing the reliability. 14

37 Methodology 2.4. Generalisation In chapter 2.6 we discussed the importance of a representative selection in quantitative research to be able to generalise the results to a broader population or a similar situation. According to Bryman (2002) it s possible to generalise the results to the population that the selection was taken from. He also states that, strictly speaking, it s not possible to generalise the results to any other population than the selection was taken from. Generalisation is often a difficult subject when it comes to qualitative research (Patel & Davidson, 2003). Qualitative researchers should try to make their descriptions about their research as thick as possible. These descriptions make it possible for others to understand how the research was performed and thus it s possible to determine how and if the results can be generalised to other situations. (Bryman, 2002) According to Patel & Davidson (2003) a qualitative analysis can lead to an understanding of a phenomena and its relation to a specific context. A generalisation can then possibly be made to similar phenomena or similar contexts (Patel & Davidson, 2003) Our view During this whole chapter we try to explain and describe how our research has been done and what choices we have made, thus making it possible for others to evaluate how our research has been performed. Together with this and with Patel & Davidson (2003) thoughts about generalisation in mind, we believe that some of our results can be generalised to similar contexts. To what extent and how generalisations can be made will be further discussed in chapter Values and assumptions Values are the researchers own personal opinions and feelings. Values can also include a person s assumption about a particular subject. The researcher s values and assumptions influence the scientific process in several of its stages, e.g. choice of method, interpreting and analysing data and the conclusions drawn from the data. Knowing that values and assumptions can influence the research, it is important for the researcher to think about how these will affect the research, thus making it more unlikely that the values and assumptions will affect the research negatively. (Bryman, 2002) Our view We believe that our research is influenced by our own values and assumptions; this is also a part of the hermeneutic perspective of knowledge. We have however, during the whole work with this thesis, tried to be aware of this and minimise the negative consequences of our values and assumptions. 15

38 Methodology 2.6. Relation between theory and reality The level of abstraction when performing research varies. The outer points in a scale of abstraction are theory and empirics (Björklund & Paulsson, 2003). Below are two different approaches presented with varying levels of abstraction Inductive A researcher working in an inductive manner begins with gathering empiric data about the research object. This is done without first studying existing theory in the field of research. With the help of the gathered empiric data the researcher creates a theory. The fact that the theory is formulated with the help of empiric data from a specific situation makes it hard to say anything about if the theory is general. (Patel & Davidson, 2003) Deductive A deductive way of working is characterised by using general principles and existing theories to draw conclusions about specific cases (Patel & Davidson, 2003). The researcher creates hypothesis by using existing theories and then test them using empiric data (Arbnor & Bjerke, 1994). The objectivity of the research is assumed to be high due to the fact that the research has its foundation in an existing theory. One problem with this approach is that the research is influenced by the existing theory and therefore some interesting new discoveries could be missed. (Patel & Davidson, 2003) Our view During our initial work with this thesis we tried to get as broad picture of the research area as possible. This was done by doing an extensive literature review to investigate factors that could be interesting to further investigate. The literature review resulted in a better understanding of the subject and ultimately in the perspectives that we have worked after. As we have created a model that has its foundation in different theories we have had a deductive way of working. We believe that by using different perspectives, to approach the purpose from, we have lessened the effect of a too strong influence by one theory which can be a risk when using a deductive way of working Qualitative and quantitative Research that can be measured or in some sense can be valued numerically is called quantitative research. Qualitative research is used when a deeper understanding of a subject, a situation or a specific event is the aim of the research. (Björklund & Paulsson, 2003) The table below tries to describe the differences on focus between qualitative and quantitative research (Bryman, 2002). 16

39 Methodology Table 1 Differences in focus between qualitative and quantitative research. Quantitative Numbers The researchers view Distance Testing theory Structured Generalization Macro Behaviour Qualitative Words The participants view Nearness Creating theory Unstructured Contextual meaning Micro Meaning In quantitative research the researcher is often interested in how the study can be generalized to include situations or events that are not included in the actual study. To be able to generalize the results it is important that the quantitative researcher makes a representative selection of people that is of interest in the study. With a representative selection it is easier for the quantitative researcher to claim that the result is also valid for the group of people in the population that the selection was taken from. (Bryman, 2002) Qualitative research is used, as stated above, when a deeper understanding of a subject is wanted. According to Björklund & Paulsson (2003) the qualitative research can be generalized, but to a lesser extent than quantitative research. Björklund & Paulsson (2003) states that it is the purpose of the study that determines if the study should be quantitative or qualitative. Observations and interviews are most suited for qualitative research and surveys and statistical models are most suited for quantitative research (Björklund & Paulsson, 2003). Both qualitative and quantitative research has it flaws. Qualitative research is by some seen as too subjective; the results are in a too large extent influenced by the view of the researcher of what is important and meaningful thus making the research less credible. Qualitative research is often impossible to redo thus making it hard to verify the findings. Quantitative research relies on different ways of measuring and procedures for measuring which makes it harder to relate the research with actual reality. The procedural manner of quantitative research can give it a false sense of reliability, it is not sure that the measurements really measure what they are intended to measure. (Bryman, 2002) Our approach During this thesis we have had a qualitative approach as a deeper understanding of the subject was wanted. The empiric data has been collected via interviews and have been semi structured to unstructured in its nature as this was deemed most 17