HOW TO ESTABLISH A SCALE THAT BEST FITS YOUR AGENDA: THE GUIDELINES TO BUILD A WEB SERVICE QUALITY SCALE



Similar documents
A Proposed Scale for Measuring E-service Quality

How Can E-Services Influence On Customers' Intentions toward Online Book Repurchasing (SEM Method and TPB Model)

Study of Determinants of e-crm in Influencing Consumer Satisfaction in B2C Websites

The Relationships between Perceived Quality, Perceived Value, and Purchase Intentions A Study in Internet Marketing

Does Trust Matter to Develop Customer Loyalty in Online Business?

E-service quality: a case study of Varaždin County

The Technology Acceptance Model with Online Learning for the Principals in Elementary Schools and Junior High Schools

Effects of Web Retail Service Quality and Product Categories on Consumer. Behavior: A Research Model and Empirical Exploration

Conceptualising and Modelling Virtual Experience for the Online Retailer: The 3D Technology

Ankara, Turkey,

Measurement of E-service Quality in University Website

Measurement of the Technology-Mediated E-Service Recovery Quality through Interactive Channels and the Effects on Intention to Value Co-Creation

The Online Banking Usage in Indonesia: An Empirical Study

Influencing Factors on Price Tolerance of Internet Customers

Exploring the Drivers of E-Commerce through the Application of Structural Equation Modeling

USING MULTIPLE GROUP STRUCTURAL MODEL FOR TESTING DIFFERENCES IN ABSORPTIVE AND INNOVATIVE CAPABILITIES BETWEEN LARGE AND MEDIUM SIZED FIRMS

An Examination of the Effect of Website Quality on Satisfaction and Customer Retention; the Case of Iranian Online Book Stores

The Investigation of the Influence of Service Quality toward Customer Engagement in Service Dominant Industries in Thailand

An Empirical Study on the Effects of Software Characteristics on Corporate Performance

Copyright subsists in all papers and content posted on this site.

General E-S-QUAL Scales Applied To Websites Satisfaction and

Attitude, Behavioral Intention and Usage: An Empirical Study of Taiwan Railway s Internet Ticketing System

SERVICE QUALITY IN ONLINE MARKETING: CUSTOMERS CENTRIC ANALYSIS

A Multiple-Item Scale for Assessing E-Government Service Quality

Application of Analytical Hierarchy Process (AHP) to Rank the Selected Branches of Sina Bank from the Perspective of E-Banking

IMPLICATIONS OF LOGISTIC SERVICE QUALITY ON THE SATISFACTION LEVEL AND RETENTION RATE OF AN E-COMMERCE RETAILER S CUSTOMERS

Enhancing Customer Relationships in the Foodservice Industry

Perceived e-service quality (PeSQ) Measurement validation and effects on consumer satisfaction and web site loyalty

A Study on consumers continuing to use online group-buying platforms: The impact of price performance expectations

Understanding the Continued Usage of Business e-learning Courses in HK Corporations

Issues in Information Systems Volume 16, Issue I, pp , 2015

Contextual factors that influence learning effectiveness: Hospitality students perspectives

A COMPARISON ANALYSIS ON THE INTENTION TO CONTINUED USE OF A LIFELONG LEARNING WEBSITE

Customer perceptions of e-service

Investigating the effect of online service quality of internet duty-free shops on trust and behavioral intention

An Empirical Study of Factors Influencing Behavioral Outcomes within Online Retailing Service Contexts

Factors affecting the Satisfaction of China s Mobile Services Industry Customer. Su-Chao Chang a, Chi-Min Chou a, *

BRAND TRUST AND BRAND AFFECT: THEIR STRATEGIC IMPORTANCE ON BRAND LOYALTY

Exploring Graduates Perceptions of the Quality of Higher Education

E-learning: Students perceptions of online learning in hospitality programs. Robert Bosselman Hospitality Management Iowa State University ABSTRACT

Pragmatic Perspectives on the Measurement of Information Systems Service Quality

E-S-QUAL. A Multiple-Item Scale for Assessing Electronic Service Quality. A. Parasuraman University of Miami

An Assessment of Services of Cell-phone Service Providers by Utilizing the SERVQUAL Model: A Study of Valsad District

Empirical Analysis of the Customer Loyalty Problem in the International Logistics Market

AN ASSESSMENT OF SERVICE QUALTIY IN INTERNATIONAL AIRLINES

Web-based Factors Influencing Online Purchasing in B2C Market; View of ICT Professionals

Journal of Internet Banking and Commerce

Investigating the Effect of Consumer Traits on the Relative Importance of TAM Constructs in an E-Commerce Context

INFLUENCE OF INTERNET MARKET ORIENTATION ON SHOPPING WEBSITES SUCCESS AN EMPIRICAL STUDY OF ONLINE SHOP BUSINESS IN TAIWAN ABSTRACT

A STRUCTURAL EQUATION MODEL ASSESSMENT OF LEAN MANUFACTURING PERFORMANCE

The Impact of Customer Perceptions and Satisfaction on E-Loyalty

MAGNT Research Report (ISSN ) Vol.2 (Special Issue) PP:

PERSONALITY FACETS AND CUSTOMER LOYALTY IN ONLINE GAMES

An Empirical Study on the e-crm Performance Influence Model for Service Sectors in Taiwan

Investigating the Determinants of e-banking Loyalty for Large Business Customers: Two Empirical Models

The Impact of Consumer Interactions in Social Networking Sites on Brand Perception

Understanding the online channel extension of traditional retailers: Online-offline and online-prototypical congruence

Understanding Retailers Acceptance of Virtual Stores

Service Quality Issues in Financial Services

The Effect of Perceived Value on Customer Loyalty in a Low-Priced Cosmetic Brand of South Korea: The Moderating Effect of Gender

UNLEASH POTENTIAL THROUGH EFFECTIVE SERVICE QUALITY DETERMINANTS

Assessment of customer s satisfaction in e-commerce services. Ocena satysfakcji konsumenta w usługach handlu elektronicznego

MEASURING PERCEIVED WEBSITE USABILITY

Kittipat Laisasikorn Thammasat Business School. Nopadol Rompho Thammasat Business School

Strategic Supply Chain for Global Customer Relationship in e-business Management

ISSN: International Journal Of Core Engineering & Management (IJCEM) Volume 2, Issue 9, December 2015

Journal of Internet Banking and Commerce

What Keeps Online Customers Repurchasing through the Internet?

SERVICE QUALITY AND ITS IMPACT ON CUSTOMER SATISFACTION TOWARDS LIFE INSURANCE IN DHARMAPURI

THE RELATIONSHIPS BETWEEN CLIENT AND CONSULTANT OBJECTIVES IN IT PROJECTS

DEVELOPING MASS CUSTOMIZATION CAPABILITY THROUGH SUPPLY CHAIN INTEGRATION. Administration; Chinese University of Hong Kong, Shatin, N.T.

Examining the Marketing - Sales Relationships and its Implications for Business Performance

Constructing a Technology Readiness Scale for Sports Center RFID Door Security System Users

Empirical Study of the Effect of Website Information Architecture on Customer Loyalty

Online Trust and Health Information Websites

SEM Analysis of the Impact of Knowledge Management, Total Quality Management and Innovation on Organizational Performance


Applications of Structural Equation Modeling in Social Sciences Research

Impact of Service Recovery on Customer Loyalty: A Study of E-Banking in Spain

The inference of stickiness to trust repair in virtual community

Impact of Knowledge Management and Organizational Learning on Different Dimensions of Organizational Performance: A Case Study of Asian Food Industry

Assessing a theoretical model on EFL college students

Relationship Quality as Predictor of B2B Customer Loyalty. Shaimaa S. B. Ahmed Doma

The Impact Of Internet Banking Service Quality On Business Customer Commitment. Nexhmi (Negji) Rexha, Curtin University of Technology.

Evaluation Factors Influencing Corporate Website Effectiveness

Evaluation of Relationship Marketing Using Service Profit Chain Model to Improve Customer Loyalty

E-loyalty in fashion e-commerce an investigation in how to create e-loyalty

Overview of Factor Analysis

SEYED MEHDI MOUSAVI DAVOUDI*; HAMED CHERATI**

Factors Affecting Customer s Perception of Service Quality: Comparing Differences among Countries - Case study: Beauty salons in Bandung and Tokyo

INTERNATIONAL JOURNAL OF MANAGEMENT RESEARCH AND REVIEW

Measuring Banks Automated Service Quality: A Confirmatory Factor Analysis Approach

ABSTRACT INTRODUCTION

Brand management model of vocational high schools in Taiwan

Perceptions on quality customer service in the hospitality industry in Papua New Guinea: an evaluation

The Study of Implementation and Assessment of a Cloud Computer Room. Pai-shu Huang, Shih-hao Shen. WuFeng University, Taiwan

A revalidation of the SET37 questionnaire for student evaluations of teaching

ASIAN JOURNAL OF MANAGEMENT RESEARCH Online Open Access publishing platform for Management Research

CUSTOMER RELATIONSHIP MANAGEMENT AND FIRM PERFORMANCE: AN EMPIRICAL STUDY OF FREIGHT FORWARDER SERVICES

Knowledge Management and Organizational Learning in Food Manufacturing Industry

Transcription:

346 International Journal of Electronic Business Management, Vol. 9, No. 4, pp. 346-354 (2011) HOW TO ESTABLISH A SCALE THAT BEST FITS YOUR AGENDA: THE GUIDELINES TO BUILD A WEB SERVICE QUALITY SCALE Chia-Chi Chang 1*, Chia-Yi Chen 2 and Yi-Hsuan Chiang 1 1 Department of Management Science National Chiao Tung University Hsinchu (30010), Taiwan 2 Department of Business Administration National Pingtung University of Science and Technology Pingtung (91201), Taiwan ABSTRACT As the Web-based commerce booms rapidly, it is crucial for companies to develop comprehensive yet customized measurement of Website service quality in order to formulate their winning strategies. However, no single exiting scale can be globally effective to capture Websites service quality because service quality dimensions can differ according to the various characteristics of the websites. Therefore, managers and engineers need to cultivate their own abilities to develop a scale that can be more effectively evaluating service quality of their Websites. Accordingly, this article aims to provide guidelines for managers and/or engineers to adjust current measures or build new scales for Website service quality that best fits their agenda. This paper firstly discusses how to use literature review and focus group interview to identify possible dimensions of Website service quality. Next, item generation and selection techniques are introduced. Last, statistical methods for refining items and accessing reliability and validity of the scale are described. An example from previously published paper is also provided for readers reference. Keywords: Scale Development, Service Quality, Structural Equation Modeling, Website Service Quality * 1. INTRODUCTION The invention of the Internet is heavily changing the way a company manages its business. To date, Websites have become an important channel for organizations to make transaction and provide service to customers. In recent years, the applications of information technology have provided an even more powerful platform for new Website applications [4, 14-16, 35]. Most of the marketing implications and new services of the Internet are based on the Websites, such as an online map and social networking. As the Web-based commerce becomes increasingly important, managing the service quality of Websites is crucial to the viability of organizations. In order to deliver the most superior service quality through a Website, managers must first understand how exiting and potential consumers perceive and evaluate the service quality of their Websites. For this * Corresponding author: chiachi801@gmail.com purpose, companies should develop a comprehensive measurement system for the service quality of their Websites in order to identify its strengths and weaknesses and formulate strategies for improvement [8, 34]. Customer perception (s) of the service quality of corporations is/are based on a comparison of the level of service they expected versus the level of service they perceived [12, 22, 36]. Service quality can thus be defined as the difference between customer expectations of service and perceived service. If expectations are greater than performance, then perceived quality is less than satisfactory and hence customer dissatisfaction occurs [23, 31]. In order to maintain customer satisfaction, it is critical for firms to develop an appropriate approach for assessing the quality of a firm's service. In previous literature, the dimensions and measurement of service quality of psychical environments have been well established by Parasuraman et al. [31-33]. Based on cross industry analysis, they develop a multiple-item instrument naming SERVQUAL to assess the

C. C. Chang et al.: How to Establish a Scale That Best First Your Agenda 347 service quality of a company. The SERVQUAL assessment is widely used to measure consumer perceptions of an organization s service quality in various industries [19, 50]. The SERVQUAL scale consists of five dimensions: reliability, responsiveness, assurance, empathy, and tangibles. However, as the e-commerce market booms, customers transact and communicate with firms through Websites on the Internet instead of contacting companies directly through physical channels. Conceivably, factors determining service quality of e-commerce are different from those for traditional channels [45]. Thus, whether the items of SERVQUAL (e.g., tangibles) can be compatible to the e-commerce environment is in doubt. As a result, many scholars attempt to develop advanced scales to measure the quality of e-commerce or e-service on Websites. In the past, many scales have been developed in the literature to assess the service quality of Websites [24, 26, 30, 40, 42, 43, 46]. However, none of them is globally effective to capture the service quality of Websites due to several reasons. First, because there are various types of Websites, factors influencing customer perceptions of Website service quality differ due to the idiosyncrasy of the websites. For example, security/privacy plays an important role in determining the overall quality of E-bay but has less impact on the quality of Google s web search service. Accordingly, scales assessing service quality of transaction-based Websites (e.g. e-bay, Best Buy.com) are conceivably unable to adequately measure the service quality of search engines (e.g. Google, Yahoo). Thus, an established scale is only valid in measuring service quality for Website providing a specific service. Consequently, lots of studies have proposed refined service quality scales for certain type of Websites, such as electronic commerce Websites [44], software houses [11], virtual communities [20], Web portals [45], airline Websites [38], technical support Website [6], government Websites [29] and home appliance enterprises Websites[49]. In addition, because information technology evolves so rapidly, new Website-based services on the Internet are more and more disruptive and revolutionary. The determinants of Website service quality have become increasingly diversified and complex. For instance, social networking and microblogging services (e.g. Facebook, Plurk, Twitter) are blooming since 2010. How customers evaluate the service quality of social networking remains unclear and needs further research. It is predicable that the composite of Website service quality will become increasingly complicated as more innovation launches Website service to unimagined levels. As a result, a universal measure of Website service quality is even difficult to develop. Based on the foregoing discussion, this paper suggests that the dimensions of Website service quality highly depend on the types of service provided. To fully capture the Website service quality of an organization, it is critical for managers and engineers to understand the similarities and differences among exiting scales of Website service quality. More importantly, managers and engineers also need to cultivate their abilities to adjust exiting measurements or develop new scales to effectively assess the quality of Website services corresponding to their business and Website characteristics. Therefore, the purpose of this article is not to develop a new scale or criticize current measurements of Website service quality. We attempt to provide guidelines for managers and/or engineers to develop a more reliable and valid scale to evaluate the service quality of their Websites. In the following, a guidance of scale development process will be introduced with an example from Yang et al. [45]. 2. SCALE DEVELOPMENT GUIDELINE 2.1 Indentify Possible Factors Influencing Website Service Quality The first step to developing a Website service quality measurement is to identify possible factors influencing Website quality. In general, two approaches are commonly used to investigate dimensions of Website service quality. The first approach is by referencing exiting scales of Website service quality. The other way is to conduct a focus group interview with Website users. In the following, we first review some well-known measurements of Website service quality for readers reference. In the past literature, scales of Website service quality either focus on the Website design quality or concentrate on the online-transaction quality [45]. The Website design quality approaches emphasize the interface design and hardware performance of a Website. For example, Lociacono et al. [25] developed a measure called WEBQUAL to evaluate the interaction between a customer and a company s Website. This scale is composed of 12 dimensions which are: Information fit to task, Trust, Design, Visual appeal, Flow, Business process, Interaction, Response time, Intuitiveness, Innovativeness, Integrated communication, and Substitutability. The Website design quality approaches are more pertinent to interface design. Therefore, this approach neglected dimensions of a consumer s experience and service process, such as order fulfillment. Thus, scales based on this approach (e.g. WEBQUAL) are criticized as being unable to fully capture the service quality delivered through the Website [48].

348 International Journal of Electronic Business Management, Vol. 9, No. 4 (2011) The other research stream of Website service quality research focuses on measuring the customers perceptions of service quality during the transaction process deliver by online retailers. For example, Barnes and Vidgen [2] developed a WebQual scale which has five factors: usability, design, information, trust, and empathy. They also provide an index of an overall rating for an e-commerce Website. Another measurement focusing on the service quality of transaction-based Websites was proposed by Yoo and Donthu [47]. This scale called SITEQUAL has four dimensions: ease of use, aesthetic design, processing speed, and interactive responsiveness. The shortcoming of measurements based on transactional Websites is that they do not consider all aspects of the purchasing process, such as providing information and customer communication. Therefore, WebQual and SITEQUAL also do not fully constitute a comprehensive assessment of Website service quality [34]. To develop a more comprehensive scale of Website service quality, some scholars attempt to integrate these two streams of research. For example, Wolfinbarger and Gilly [43] developed a 14-item scale, called etailq, which has 4 dimensions: Web site design, Reliability/fulfillment, Privacy/security, and Customer service. Additionally, Parasuraman et al. [34] developed the e-servqual scale and further split it into two parts: E-S-QUAL (efficiency, reliability, fulfillment, privacy) and E-RecS-QUAL (responsiveness, compensation, contact). Apart from the academic research described above, some businesses have also conducted their own methods for measuring online retailers service quality, such as BizRate.com. A summery of detailed dimensions in some frequently cited Website quality scales is illustrated in Table 1. Existing Website service quality scales consist of dissimilar dimensions, and those dimensions are also named differently. To summarize the dimensions of the exiting scales of Website service quality, Zeithaml et al. [48] reviewed existing research and identified six underlining criteria (information availability and content, ease of use or usability, privacy/security, graphic style, fulfillment and others) that customers used in evaluating Website service quality. Dai et al. [7] proposed two additional dimensions system availability and recovery service. Based on this framework, Table 1 provides a summary of dimensions in exiting Website quality scales. Although literature review is an effective way to identify possible dimensions of Website service quality, the shortcoming of this approach is that it can only provide exiting dimensions. When new implications of Website lunches, there may be some unique dimensions that are never been identified. To explore possible new dimensions of Website service quality, focus group interview is a commonly used technique. Researchers generally conduct a focus group interviewing the Website s heavy users or experts to collect the first-handed information and to determine the dimension of Website service quality. For example, while Yang et al. [45] attempted to build a scale for IP Web portals, they first review exiting studies of Website service quality to identify possible dimensions. Then, they conducted a focus group of IT and marketing managers from a company with IP Web portal. By using both literature review and focus group interview, the major service quality dimensions of IP Web portals were thus formulated for further investigations. 2.2 Item Generation and Selection The objective of this step is to generate specific items for the proposed dimensions of Website service quality and to select the items that can have a good validity in terms of describing relevant Website service quality. To generate the items, one should conduct an extensive literature review focused on concepts related to the dimensions of Website service quality and used the selection process proposed by Tian et al. [41]. First, from the literature review, one would select or as many relevant items as possible, and some of the selected items need to be reworded in order to be appropriate. Second, at least five experts should be asked to allocate each item to one of the dedicated dimensions [21]. After this process, items can only remain if more than half of those experts classified them into the appropriate category. Third, another set of five experts should be asked to evaluate each of the remaining items as clearly representative, somewhat representative, or not representative of the dimension. In Saxe & Weitz s [37] study, they suggested that all retained items should be rated as clearly representative by at least 50% of the judges or the item should be deleted. The targeted sample will then be asked to respond to the Website service quality scale by using a seven-point Likert-type scale (1 = strongly disagree, and 7 = strongly agree ). In Yang et al. [45], the authors drafted a survey questionnaire and asked the managers and the users of IP Web portals to screen the items to refine them. 2.3 Item Refinement and Confirmation of the Dimensions It was necessary to at least collect two sets of samples in the process of developing the scale. First survey of sample. An exploratory factor analysis will be performed to reassign items and restructure dimensions in this survey. Using data obtained from the first sample, items with a loading value below 0.5 on any factor, or high cross-loadings on two or more factors, should be eliminated through the principal

C. C. Chang et al.: How to Establish a Scale That Best First Your Agenda 349 component factor analysis with a rotation of the first sample. The factor eigenvalues of Website service quality should be greater than 1. After Varimax rotation, a clean factor structure which explains most of all variance will emerge. A preliminary scale will be produced. Table 1: Summary of dimensions in different scales to measure website service quality In Yang et al. [45], they conducted a survey and collected a sample with 1992 effective respondents. They randomly select 996 respondents and conducted a principal component factor analysis with a Varimax rotation. They following the rules described above to eliminate items that do not load strongly on any factor (values below 0.5) or had cross-loadings. Second survey of sample. Then, in the second survey, a confirmatory factor analysis is needed to construct the final Website service quality scale. To build a strict factor structure, confirmatory factor analysis is performed by using data from the second survey and items are deleted when the loading is below 0.7. For example, Yang et al. [45] also conducted confirmatory factor analyses using the remaining 996 cases in the dataset. They delete items with unacceptably small loading (below 0.7) on its designated factor. 3. DATA ANALYSIS 3.1 Measurement of the Model Fit To determine which measurement model fit the data best, structural equation modeling should be used to conduct confirmatory factor analyses. After the second survey, confirmatory factor analyses needs to be performed by using statistic software, LISREL, in order to reveal model is the best model. If the major fit indices suggest a reasonable fit (see Table 2) [1, 17, 18]. At this stage, other analyses will also need to be performed in order to validate the scale, including reliability validity test. A brief summary of how it should be done will be included as follow. Table 2 Indices of SEM Indices of SEM Suggested standard χ 2 P > 0.05 χ 2 /df < 2 Goodness-of-Fit Index (GFI) > 0.90 Adjusted GFI (AGFI) > 0.90 Normed Fit Index (NFI) > 0.90 Non-Normed Fit Index (NNFI) > 0.90 Comparative Fit Index (CFI) > 0.95 Root Mean Square Residual (RMR) < 0.05 Root Mean Square Error of Approximation (RMSEA) < 0.05 Standardized Root Mean Square Residual (SRMR) <0.08

350 International Journal of Electronic Business Management, Vol. 9, No. 4 (2011) 3.2 Reliability Test Internal consistency reliability is used to analyze whether the context was homogeneous, stable and consistent. The most commonly used reliability assessment tool is Cronbach s α coefficient. According to Nunnally [28], α of each item needs to be above 0.7, or the item would be deleted. In addition to internal consistency of each item, the composite reliability is also usually used to evaluate the internal consistency of measurement model. All the values of composite reliability would be greater than the benchmark of 0.7 recommended by Hair [13] thus demonstrating that all measures have adequate reliability. 3.3 Validity Test Several validity testing steps should be taken is to ensure the completeness of Website service quality scale. 3.3.1 Test for Response Bias Moorman and Padsakoff [27] ascertain that respondents are prone to create a particular impression, which is a kind of response bias. Because respondents answer questions according to what they think the most acceptable to society instead of what they really think, the bias may occur. To check the possibility of social desirability bias, the respondents need to complete the Marlowe-Crowne Short-Form Social Desirability Scale [9]. If the correlation coefficient between Website service quality scale and Social Desirability Scale was low, then the effect of social desirability can be neglected. 3.3.2 Convergent Validity Convergent validity shows that the assessment is related to what it should theoretically be related to. There are many methods used to evaluate the degree to which measures show convergent associations. Average Variance Extracted (AVE) is the common and useful way to measure convergent validity. AVE was proposed by Fornell and Larker [10] as a measure of the shared or common variance in a latent variable, and the AVE for all measures should exceed the benchmark of 0.50 recommended. To test the convergent validity, Yang et al. [45] calculated average variances extracted (AVE) for each construct. All AVE values met the recommended minimum level of 0.5, thus supporting the convergent validity of the model. 3.3.3 Discriminant Validity Discriminant validity presumes that one can empirically differentiate a construct from other constructs that may be similar, and can determine what is unrelated to the construct. Because of their similarities and differences, correlation would be expected neither too high nor too low. If the correlation is too high, it means that the Website service quality scale is too similar to other service quality scale, and would lose its value as a new scale. In contrast, if the correlation is too low, the two scales lack any similarity. Hence, we extrapolate that the correlation would be not too high, although the new Website service quality scale would be significantly correlated with other service quality scale. To test discriminant validity, Yang et al. [45] constructed a SEM model by freeing the covariance between the factors and found significant difference in the Chi-square between the constrained and unconstrained models with one degree of freedom. The results support the discriminant validity among the constructs. 3.3.4 Criterion-related Validity Criterion-related validity refers to the extent to which the factors measured are related to pre-specified criteria [3]. For example, in this stream of research, the criterion-related validity could be assessed by performing a regression analysis to determine how Website service quality affects the customers satisfaction. To assess the criterion validity of the derived dimensions, Yang et al. [45] perform a regression analysis for the dependent variable (overall service quality of Website). They found that all proposed dimensions had significantly positive impacts on the overall service quality, thus confirming the criterion-related validity. 3.3.5 Nomological Validity Nomological validity is a form of construct validity. It is the degree to which a construct behaves as it should within a system of related constructs [39]. The antecedent factors which affect Website service quality and the subsequent factors which can be affected by Website service quality compose a nomological set. In Yang et al. [45], they tested whether their instruments for Web portal quality related to user satisfaction which it is theoretically interrelated. They showed that the overall portal quality had a positive, significant influence on user satisfaction and the nomological validity was confirmed. Although Yang et al. [45] have tested the nomological validly related with consequence factor of Website quality (user satisfaction), we suggest that a test of nomological validity with antecedents of Website service quality (e.g. usability of Website) is also needed for a more rigid study. 4. CONCLUSION The procedure is used to develop a measure of Website service quality scale, illustrated in Figure 1,

C. C. Chang et al.: How to Establish a Scale That Best First Your Agenda 351 largely follows the guidelines recommended by Saxe and Weitz [37], Tian and Bearden [41], and Chi, et al. [5]. The first step to develop a Website service quality scale is to identify possible factors influencing Website quality. In general, referring to the existing scales and having focus group interviews with persons who are related website service quality are common approaches researchers used. Identifying Website Service Quality Dimensions Development of an Item Pool Assessment of Items and Dimensions by Experts First Survey of Respondents to Select Best Items Second Survey of Respondents to Assess Scale Properties (1) Review existing Website service quality scales (2) Conduct focus group interviews with users Items be generated from previous research (1) There are at least five experts to allocate items to each dimension (2) More than five experts to judge item representative Exploratory factor analysis to reassign items and restructure dimensions as necessary Conducted confirmatory factor analysis and validity tests on the final Website service quality scale Figure 1: Process for developing the website service quality scale The next step is to generate an item pool by reviewing previous research and collecting information from focus group interview. After the item pool generated, there are two set of at least five experts to assess these items. One is to allocate items to suitable dimension, and only when more than half of the experts allocate the item into the same dimension, can the item be remained. After this process, another one set of experts is to judge item representative. By the same reason, if there are more than half of the judges consider the item as clearly representative, it would be remained. Therefore, a preliminary scale will be produced and the first samples will be asked to respond to the scale by using a seven-point Likert-type scale. Third, researchers should use structural equation modeling (SEM) to analyze the data. To begin with SEM, researchers would analyze data from the first survey by performing exploratory factor analysis. And the item would be deleted if its factor loading is below 0.5, and then the remained items make up a second questionnaire. The next step is to analyze the data from second survey by performing confirmatory factor analysis. The final scale will then be produced and subsequently a series of reliability and validity measurements should proceed: (1) measurement of model fit; (2) reliability test; (3) test for response bias; (4) convergent validity test; (5) discriminant validity test; (6)criterion-related validity test; and (7) nomological validity test. REFERENCES 1. Bagozzi, R. P. and Yi, Y., 1988, On the evaluation of structure equations models, Academic of Marketing Science, Vol. 16, No. 1, pp. 76-94. 2. Barnes, S. J. and Vidgen, R. T., 2002, An integrative approach to the assessment of e-commerce quality, Journal of Electronic Commerce Research, Vol. 3, No. 3, pp. 114-127. 3. Brakus, J. J. Bernd H. S. and Lia, Z., 2009, Brand experience: What is it? How is it measured? Does it affect loyalty? Journal of Marketing, Vol. 7, No.3, pp. 52-68. 4. Chen, T. F., 2009, Building a platform of business model 2.0 to creating real business value with Web 2.0 and accelerate the growth of highly value-added web information services industry, International Journal of Electronic Business Management, Vol. 7, No. 3, pp. 168-180. 5. Chi, N. W., Chen, H. Y., Yang, M. Y., Cheng F. C. and Tsai, W. C., 2008, The development of multidimensional person-job fit scale (MPJS), Journal of Management, Vol. 25, No.5, pp. 577-598. 6. Chu, P. Y., Chen, C. Y., Lin, Y. L. and Wu, W. C., 2009, Determinants of the service quality of technical support web sites: An empirical study of it companies in Taiwan, International Journal of Business and Information, Vol. 4, pp. 76-88. 7. Dai, L., Huang, L., Yi, Y. and Technological, N., 2005, How B2C service quality influences Website continuance, Pacific Asia Conference on Information Systems, pp. 1375-1381. 8. Davoli, P., 2006, Trustworthiness evaluation of web quality inspection tools, International Journal of Electronic Business Management, Vol. 4, No. 1, pp. 64-76.

352 International Journal of Electronic Business Management, Vol. 9, No. 4 (2011) 9. Edmund, R. T. and Florence, T. T. P., 2005, Reliability among senior managers of the Marlowe-Crowne short-form social desirability scale, Journal of Business and Psychology, Vol. 19, No. 4, pp. 541-554. 10. Fornell, C. and Larker, D. F., 1981, Evaluating structural equation models with unobservable variables and measurement error, Journal of Marketing Research, Vol. 18, No. 1, pp. 39-50. 11. Gounaris, S., 2005, An alternative measure for assessing perceived quality of software house services, Service Industries Journal, Vol. 25, No. 6, pp. 803-823. 12. Gronroos, C., 1982, Strategic Management and Marketing in the Service Sector, Swedish School of Economics and Business Administration, Helsingfors. 13. Hair, J. F., Anderson, R. E., Tatham, R. L. and Black, W. C., 1998, Multivariate Data Analysis, Prentice-Hall, New Jersey. 14. Hoffman, D. L., and Novak, T. P., 1996, Marketing in hypermedia computer-mediated environments: conceptual foundations, Journal of Marketing, Vol. 60, No. 3, pp. 50-68. 15. Hoffman, D. L. and Novak, T. P., 1997, A new marketing paradigm for electronic commerce, Information Society, Vol. 13, pp. 43-54. 16. Hoffman, D. L., Novak, T. P. and Chatterjee, P., 1995, Commercial scenarios for the web: Opportunities and challenges, Journal of Computer Mediated Communication, Vol. 1, No. 3, pp. 1-20. 17. Hu, L. T. and Bentler, P. M., 1999, Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives, Structural Equation Modeling, Vol. 6, No. 1, pp. 1-55. 18. Jöreskog, K. G. and Sörbom, D., 1993, LISREL8: Structural Equation Modeling with SIMPLIS Command Language, Scientific Software International Inc, Chicago. 19. Kettinger, W. J. and Lee, C. C., 1997, Pragmatic perspectives on the measurement of information systems service quality, MIS Quarterly, Vol. 21, No. 2, pp. 223-240. 20. Kuo, Y. F., 2003, A study on service quality of virtual community websites, Total Quality Management and Business Excellence, Vol. 14, No. 4, pp. 461-474. 21. Lawshe, C. H., 1975, A quantitative approach to content validity, Personnel Psychology, Vol. 28, pp. 564-575. 22. Lehtinen, U. and Lehtinen, J. R., 1982, Service quality: A Study of Quality Dimensions, Finland: Service Management Institute. 23. Lewis, R. C. and Booms, B. H., 1983, The marketing aspects of service quality, In: L.L. Berry, G. Shostack, & G. Upah, Emerging Perspectives in Service Marketing, pp. 99-107. Chicago: American Marketing Association. 24. Li, Y. N., Tan, K. C. and Xie, M., 2002, Measuring Web-based service quality, Total Quality Management, Vol. 13, No. 5, pp. 685-700. 25. Lociacono, E. T., 2000, WebQual: A Web site quality instrument, Working Paper, Worcester Polytechnic Institute. 26. Loiacono, E. T., Watson, R. T. and Goodhue, D. L., 2002, WebQual: A measure of Web site quality, 2002 Marketing Educators Conference: Marketing Theory and Applications. Vol. 13, pp. 432-437. 27. Moorman, R. H. and Podsakoff, P. M., 1992, A meta-analytic review and empirical test of the potential confounding effects of social desirability response sets in organizational behavior research, Journal of Occupational and Organizational Psychology, Vol. 65, No. 2, pp. 131-149. 28. Nunnally, J. C., 1978, Psychometric Theory, Mcgraw-Hill, New York. 29. Papadomichelaki, X. and Mentzas, G., 2009, A multiple-item scale for assessing e-government service quality, Electronic Government: Lecture Notes in Computer Science, Vol. 5693, pp. 163-175. 30. Parasuraman, A., Zeithaml, V. A. and Malhotra, A., 2005, E-S-QUAL: A multiple-item scale for assessing electronic service quality, Journal of Service Research, Vol. 7, No. 3, pp. 213-233. 31. Parasuraman, A., Zeithaml, V. A. and Berry, L. L., 1985, A conceptual model of service quality and its implications for future research, Journal of Marketing, Vol. 49, No. 4, pp. 41-50. 32. Parasuraman, A., Zeithaml, V. A. and Berry, L. L., 1988, SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality, Journal of Retailing, Vol. 64, No. 1, pp. 12-40. 33. Parasuraman, A., Zeithaml, V. A. and Berry, L. L., 1991, Understanding customer expectations of service, Sloan Management Review, Vol. 32, No. 3, pp. 39-48. 34. Parasuraman, A., Zeithaml, V. A. and Malhotra, A., 2005, ES-QUAL: a multiple-item scale for assessing electronic service quality, Journal of Service Research, Vol. 7, No. 3, pp. 213-233. 35. Peterson, R. A., Balasubramanian, S. and Bronnenberg, B. J., 1997, Exploring the implications of the internet for consumer

C. C. Chang et al.: How to Establish a Scale That Best First Your Agenda 353 marketing, Journal of the Academy of Marketing Science, Vol. 25, No. 4, pp. 329-346. 36. Sasser, W. E., Olsen, R. P. and Wyckoff, D. D., 1978, Management of Service Operations: Text, Cases, and Readings, Allyn and Bacon, Boston. 37. Saxe, R. and Weitz, B. A., 1982, The SOCO scale: A measure of the customer orientation of salespeople, Journal of Marketing Research, Vol. 19, No. 3, pp. 343-351. 38. Shchiglik, C. and Barnes, S. J., 2004, Evaluating website quality in the airline industry, Journal of Computer Information Systems, Vol. 44, No. 3, pp. 17-25. 39. Spiro, R. L. and Weitz, B. A., 1990, Adaptive selling: Conceptualization, measurement, and nomological validity, Journal of Marketing Research, Vol. 27, No. 1, pp. 61-69. 40. Tan, K. C., Xie, M. and Li, Y. N., 2003, A service quality framework for Web-based information systems, The TQM Magazine, Vol. 15, No. 3, pp. 164-172. 41. Tian, K. T., William, O. B. and Gary, L. H., 2001, Consumers' need for uniqueness: Scale development and validation, Journal of Consumer Research, Vol. 28, No. 1, pp. 50-66. 42. Wolfinbarger, M. and Gilly, M. C., 2003,.comQ: Dimensionalizing, Measuring and Predicting Quality of the E-Tail Experience, Working Paper, Cambridge: Marketing Science Institute. 43. Wolfinbarger, M. and Gilly, M. C., 2003, etailq: Dimensionalizing, measuring and predicting etail quality, Journal of Retailing, Vol. 79, No. 3, pp. 183-198. 44. Yang, M. H., Jian, Y. S., and Chen, H. L., 2006, Constructing the evaluation model for business-to-consumers electronic commerce from consumer s perception, International Journal of Electronic Business Management, Vol. 4, No. 1, pp. 38-47. 45. Yang, Z., Cai, S., Zhou, Z. and Zhou, N., 2005, Development and validation of an instrument to measure user perceived service quality of information presenting Web portals, Information & Management, Vol. 42, No. 4, pp. 575-589. 46. Yang, Z. and Jun, M., 2002, Consumer perception of e-service quality: From internet purchaser and non-purchaser perspectives, Journal of Business Strategies, Vol. 19, No. 1, pp. 19-41. 47. Yoo, B. and Donthu, N., 2001, Developing a scale to measure the perceived quality of an internet shopping site (SITEQUAL), Quarterly Journal of Electronic Commerce, Vol. 2, No. 1, pp. 31-45. 48. Zeithaml, V. A., Parasuraman, A. and Malhotra, A., 2002, Service quality delivery through web sites: a critical review of extant knowledge, Journal of the Academy of Marketing Science, Vol. 30, No. 4, pp. 362-375. 49. Zhuo, J., Xiao, J. Z. and Zhou, M., 2011, Development of website quality dimensions of home appliance enterprises based on exploratory factor analysis, Advanced Materials Research, Vol. 204, pp. 1920-1923. 50. Zumbehl, R. K. and Mayo, R. E., 1994, Customer focused quality for the maintenance and repair of air force facilities, Project Management Journal, Vol. 25, No. 4, pp. 32-36. ABOUT THE AUTHORS Chia-Chi Chang is an associate professor of Department of Management Science at National Chiao Tung University in Taiwan. She received her PhD degree from Purdue University. Her current research interests are in the areas of consumer behavior, consumer decision process, customization, sales management, and service marketing. Chia-Yi Chen is an assistant professor of Department of Business Administration at National Pingtung University of Science and Technology. He received his PhD degree from National Chiao Tung University in Taiwan. His current research interests are in the areas of brand management, consumer behavior, and service marketing. Yi-Hsuan Chiang is a PhD student of Department of Management Science at National Chiao Tung University in Taiwan. Her current research interests are in the areas of consumer behavior and sales management. (Received September 2010, revised January 2011, accepted April 2011)

354 International Journal of Electronic Business Management, Vol. 9, No. 4 (2011) 如 何 編 製 最 適 所 需 量 表 : 網 站 服 務 品 質 量 表 發 展 之 指 引 張 家 齊 * 陳 佳 誼 江 奕 萱 國 立 交 通 大 學 管 理 科 學 系 新 竹 市 大 學 路 1001 號 摘 要 隨 著 以 網 站 為 基 礎 之 商 務 蓬 勃 發 展, 企 業 為 能 制 訂 致 勝 策 略, 編 製 一 個 廣 泛 且 客 製 化 的 網 站 服 務 品 質 衡 量 方 法 是 十 分 重 要 的 然 而, 由 於 服 務 品 質 之 構 面 會 因 網 站 特 質 的 不 同 而 有 所 差 異, 至 今 尚 無 單 一 量 表 可 廣 泛 且 有 效 地 衡 量 網 站 服 務 品 質, 因 此 管 理 者 及 工 程 師 需 要 培 養 獨 立 編 製 量 表 的 能 力, 以 更 有 效 地 衡 量 其 網 站 之 服 務 品 質 據 此, 本 文 旨 在 提 供 管 理 者 與 工 程 師 編 製 新 量 表 或 修 改 既 有 量 表 之 指 引, 使 網 站 服 務 品 質 的 衡 量 能 最 適 其 所 需 本 文 首 先 討 論 如 何 利 用 文 獻 回 顧 及 焦 點 團 體 法 辨 識 網 站 服 務 品 質 之 構 面, 其 次 介 紹 問 項 發 展 與 篩 選 的 技 巧, 最 後 說 明 精 鍊 問 項 及 評 估 信 效 度 之 統 計 方 法, 並 佐 以 既 有 文 獻 中 之 範 例 供 讀 者 參 照 關 鍵 詞 : 量 表 發 展 服 務 品 質 結 構 方 程 模 式 網 站 服 務 品 質 (* 聯 絡 人 :chiachi801@gmail.com)