Appendix: Evaluating Cloud Services Using Methods of Supplier Selection Stefan Harnisch 1 and Peter Buxmann 1, 1 Technische Universität Darmstadt, Chair of Information Systems, Hochschulstraße 1, 64289 Darmstadt, Germany {harnisch,buxmann}@is.tu-darmstadt.de Table 1: Analyzed journals, ranking according to VHB Jourqual [17]. Journal Ranking Accessed via Hits (Relevant) Ebsco- Host WoK Operations Research A+ x 0 (0) Production and Operations Management A x 5 (0) OR Spectrum A x 1 (0) European Journal of Operational Research A x 29 (10) Operations Management Research B Springerlink 1 (0) Mathematics of Operations Research B x 0 (0) Journal of Operations Management B x 6 (0) Annals of Operations Research B x 2 (1) International Journal of Production Economics B x International Journal of Production Research B x 55 (26) 66 (27) Journal of Supply Chain Management B x 13 (4) Computers and Operations Research B x 12 (3) International Journal of Physical Distribution and B x 15 (2) Logistics Management Journal of the Operational Research Society B x 8 (4) Omega B x 10 (4) Decision Support Systems B x 2 (0) Long Range Planning B x 0 (0) Sum 225 (81)
Table 2: Occurrence of identified methods Method Count Percentage Fuzzy set theory 24 20,9% AHP 22 19,1% DEA 12 10,4% Other 9 7,8% Linear programming 9 7,8% Other mathematical programming methods 8 7,0% Genetic algorithms 6 5,2% Literature-based comparisons 5 4,3% ANP 4 3,5% Goal programming 4 3,5% Activity based costing 3 2,6% Grey relational analysis 3 2,6% Multivariate statistical analysis 2 1,7% Other statistical methods 2 1,7%
Table 3: Occurrence of identified methods Methods Source Lin. Math. Goal Genetivariate # Multi- AHP ANP Grey Fuzzy ABC DEA Review Statistical Other Progr. Progr. progr. Aissaoui et al. (2007) x 1 Akarte et al. (2001) x 1 Amid et al. (2006) x x 2 Amid et al. (2009) x 1 Amid et al. (2011) x 1 Araz & Ozkarahan (2007) x 1 Awasthi et al. (2009) x 1 Bottani & Rizzi (2008) x x 2 Büyüközkan (2012) x x 2 Cakravastia et al. (2002) x 1 Cao & Wang (2007) x 1 Chan (2003) x 1 Chan et al. (2008) x x 2 Chan et al. (2011) x 1 Che & Chiang (2012) x x 2 Che (2010) x 1 Che (2010) x x 2 Chen & Chen (2006) x 1 Chen & Wang (2009) x 1 Chen (2009) x 1 Chen et al. (2006) x 1 Chou et al. (2007) x 1 Current & Weber (1994) x 1 Degraeve & Roodhooft (1999) x 1 Degraeve et al. (2000) x 1 Demirtas & Üstün (2008) x x 2
Lin. Math. Goal Genetivariate # Multi- AHP ANP Grey Fuzzy ABC DEA Review Statistical Other Source Progr. Progr. progr. Dotoli & Falagario (2012) x 1 Faez et al. (2009) x x 2 Falagario et al. (2012) x 1 Farzipoor Saen (2009) x 1 Feng et al. (2011) x 1 Fuh-Hwa Franklin Liu & Hui Lin Hai (2005) x 1 Ge Wang et al. (2004) x x 2 Ghodsypour & O'Brien (1998) x x 2 Golmohammadi & Mellat-Parast (2012) x x 2 He et al. (2009) x x 2 Ho et al. (2010) x 1 Huang & Keskar (2007) x 1 Humphreys et al. (2006) x 1 Ishizaka et al. (2012) x 1 Jayaraman et al. (1999) x 1 Kaufmann et al. (2010) x 1 Kumar et al. (2006) x x 2 Kuo & Lin (2012) x x 2 Labib (2011) x x 2 Lam & Tang (2006) x 1 Lasch & Janker (2005) x 1 Lee (2009) x x 2 Li & Zabinsky (2011) x 1 Liao & Rittscher (2007) x x 2 Lin (2012) x x x 3 Mafakheri et al. (2011) x 1 Narasimhan et al. (2001) x 1 Ng (2008) x 1 Noorul Haq & Kannan (2006) x 1 Osman & Demirli (2010) x 1 Petroni & Braglia (2000) x 1
Lin. Math. Goal Genetivariate # Multi- AHP ANP Grey Fuzzy ABC DEA Review Statistical Other Source Progr. Progr. progr. Pitchipoo et al. (2012) x x 2 Rezaei & Davoodi (2012) x 1 Roodhooft & Fonings (1997) x 1 Sadeghieh et al. (2012) x x x 3 Saen (2007) x 1 Sen et al. (2010) x x 2 Sevkli et al. (2007) x x 2 Sucky (2007) x 1 Talluri et al. (2006) x 1 Tam & Tummala (2001) x 1 Tsai & Hung (2009) x x x 3 Tsai (2009) x 1 Ustun & Demirtas (2008) x x 2 Vahdani & Zandieh (2010) x 1 Wang et al. (2009) x x 2 Weber et al. (1991) x 1 Wu & Blackhurst (2009) x 1 Wu & Olson (2008) x 1 Wu et al. (2008) x 1 Wu et al. (2010) x x 2 Xia & Wu (2007) x x 2 Xu & Ding (2011) x x 2 Yu et al. (2012) x x 2 Zhang et al. (2012) x x x 3 Sum 22 4 3 24 9 9 3 12 4 6 5 2 2 10 AHP: Analytical Hierarchy Process ANP: Analytical Network Process Grey: Grey theory Fuzzy: Fuzzy theory Lin. Progr.: Linear Programming Math. Progr.: Mathematical Programming ABC: Activity Based Costing DEA: Data Envelopment Analysis Goal progr.: Goal Programming Genetic: Genetic Algorithms Review: Literature-based comparison Multivariate: Multivariate statistics Statistical: (Other) statistical methods Other: Everything else
References in the appendix 1. Aissaoui, N., Haouari, M., Hassini, E.: Supplier selection and order lot sizing modeling: A review. Computers & Operations Research 34, 3516 3540 (2007) 2. Akarte, M.M., Surendra, N.V., Ravi, B., Rangaraj, N.: Web based casting supplier evaluation using analytical hierarchy process. Journal of the Operational Research Society 52, 511 (2001) 3. Amid, A., Ghodsypour, S.H., O Brien, C.: Fuzzy multiobjective linear model for supplier selection in a supply chain. International Journal of Production Economics 104, 394 407 (2006) 4. Amid, A., Ghodsypour, S.H., O Brien, C.: A weighted max min model for fuzzy multi-objective supplier selection in a supply chain. International Journal of Production Economics 131, 139 145 (2011) 5. Amid, A., Ghodsypour, S.H., O Brien, C.: A weighted additive fuzzy multiobjective model for the supplier selection problem under price breaks in a supply Chain. International Journal of Production Economics 121, 323 332 (2009) 6. Araz, C., Ozkarahan, I.: Supplier evaluation and management system for strategic sourcing based on a new multicriteria sorting procedure. International Journal of Production Economics 106, 585 606 (2007) 7. Awasthi, A., Chauhan, S.S., Goyal, S.K., Proth, J.-M.: Supplier selection problem for a single manufacturing unit under stochastic demand. International Journal of Production Economics 117, 229 233 (2009) 8. Bottani, E., Rizzi, A.: An adapted multi-criteria approach to suppliers and products selection An application oriented to lead-time reduction. International Journal of Production Economics 111, 763 781 (2008) 9. Büyüközkan, G.: An integrated fuzzy multi-criteria group decision-making approach for green supplier evaluation. International Journal of Production Research 50, 2892 2909 (2012) 10. Cakravastia, A., Toha, I.S., Nakamura, N.: A two-stage model for the design of supply chain networks. International Journal of Production Economics 80, 231 (2002) 11. Cao, Q., Wang, Q.: Optimizing vendor selection in a two-stage outsourcing process. Computers & Operations Research 34, 3757 3768 (2007) 12. Chan, F.T.S.: Interactive selection model for supplier selection process: an analytical hierarchy process approach. International Journal of Production Research 41, 3549 3579 (2003) 13. Chan, F.T.S., Shukla, M., Tiwari, M.K., Shankar, R., Choy, K.L.: B2B multi-attribute e-procurement: an artificial immune system based goal programming approach. International Journal of Production Research 49, 321 341 (2011) 14. Chan, F.T.S., Kumar, N., Tiwari, M.K., Lau, H.C.W., Choy, K.L.: Global supplier selection: a fuzzy-ahp approach. International Journal of Production Research 46, 3825 3857 (2008) 15. Che, Z.H.: A genetic algorithm-based model for solving multi-period supplier selection problem with assembly sequence. International Journal of Production Research 48, 4355 4377 (2010) 16. Che, Z.H.: Using fuzzy analytic hierarchy process and particle swarm optimisation for balanced and defective supply chain problems considering WEEE/RoHS directives. International Journal of Production Research 48, 3355 3381 (2010) 17. Che, Z.H., Chiang, T.-A.: Designing a collaborative supply-chain plan using the analytic hierarchy process and genetic algorithm with cycle-time estimation. International Journal of Production Research 50, 4426 4443 (2012) 18. Chen, C.-T., Lin, C.-T., Huang, S.-F.: A fuzzy approach for supplier evaluation and selection in supply chain management. International Journal of Production Economics 102, 289 301 (2006) 19. Chen, C.-M.: A fuzzy-based decision-support model for rebuy procurement. International Journal of Production Economics 122, 714 724 (2009) 20. Chen, K.S., Chen, K.L.: Supplier selection by testing the process incapability index. International Journal of Production Research 44, 589 600 (2006) 21. Chen, L.Y., Wang, T.-C.: Optimizing partners choice in IS/IT outsourcing projects: The strategic decision of fuzzy VIKOR. International Journal of Production Economics 120, 233 242 (2009) 22. Chou, S.-Y., Shen, C.-Y., Chang, Y.-H.: Vendor selection in a modified re-buy situation using a strategy-aligned fuzzy approach. International Journal of Production Research 45, 3113 3133 (2007) 23. Current, J., Weber, C.: Application of facility location modeling constructs to vendor selection problems. European Journal of Operational Research 76, 387 392 (1994) 24. Degraeve, Z., Labro, E., Roodhooft, F.: An evaluation of vendor selection models from a total cost of ownership perspective. European Journal of Operational Research 125, 34 58 (2000) 25. Degraeve, Z., Roodhooft, F.: Effectively Selecting Suppliers Using Total Cost of Ownership. Journal of Supply Chain Management 35, 5 10 (1999) 26. Demirtas, E.A., Üstün, Ö.: An integrated multiobjective decision making process for supplier selection and order allocation. Omega 36, 76 90 (2008) 27. Dotoli, M., Falagario, M.: A hierarchical model for optimal supplier selection in multiple sourcing contexts. International Journal of Production Research 50, 2953 2967 (2012) 28. Faez, F., Ghodsypour, S.H., O Brien, C.: Vendor selection and order allocation using an integrated fuzzy case-based reasoning and mathematical programming model. International Journal of Production Economics 121, 395 408 (2009) 29. Falagario, M., Sciancalepore, F., Costantino, N., Pietroforte, R.: Using a DEA-cross efficiency approach in public procurement tenders. European Journal of Operational Research 218, 523 529 (2012) 30. Farzipoor Saen, R.: Supplier selection by the pair of nondiscretionary factors-imprecise data envelopment analysis models. Journal of the Operational Research Society 60, 1575 1582 (2009) 31. Feng, B., Fan, Z.-P., Li, Y.: A decision method for supplier selection in multi-service outsourcing. International Journal of Production Economics 132, 240 250 (2011)
32. Fuh-Hwa Franklin Liu, Hui Lin Hai: The voting analytic hierarchy process method for selecting supplier. International Journal of Production Economics 97, 308 317 (2005) 33. Ge Wang, Huang, S.H., Dismukes, J.P.: Product-driven supply chain selection using integrated multi-criteria decision-making methodology. International Journal of Production Economics 91, 1 15 (2004) 34. Ghodsypour, S.H., O'Brien, C.: A decision support system for supplier selection using an integrated analytic hierarchy process and linear programming. International Journal of Production Economics 56/57, 199 212 (1998) 35. Golmohammadi, D., Mellat-Parast, M.: Developing a grey-based decision-making model for supplier selection. International Journal of Production Economics 137, 191 200 (2012) 36. He, S., Chaudhry, S.S., Lei, Z., Wang Baohua: Stochastic vendor selection problem: chance-constrained model and genetic algorithms. Annals of Operations Research 168, 169 179 (2009) 37. Ho, W., Xu, X., Dey, P.K.: Multi-criteria decision making approaches for supplier evaluation and selection: A literature review. European Journal of Operational Research 202, 16 24 (2010) 38. Huang, S.H., Keskar, H.: Comprehensive and configurable metrics for supplier selection. International Journal of Production Economics 105, 510 523 (2007) 39. Humphreys, P., McCloskey, A., McIvor, R., Maguire, L., Glackin, C.: Employing dynamic fuzzy membership functions to assess environmental performance in the supplier selection process. International Journal of Production Research 44, 2379 2419 (2006) 40. Ishizaka, A., Pearman, C., Nemery, P.: AHPSort: an AHP-based method for sorting problems. International Journal of Production Research 50, 4767 4784 (2012) 41. Jayaraman, V., Srivastava, R., Benton, W.C.: Supplier Selection and Order Quantity Allocation: A Comprehensive Model. Journal of Supply Chain Management 35, 50 58 (1999) 42. Kaufmann, L., Carter, C.R., Buhrmann, C.: Debiasing the supplier selection decision: a taxonomy and conceptualization. International Journal of Physical Distribution & Logistics Management 40, 792 821 (2010) 43. Kumar, M., Vrat, P., Shankar, R.: A fuzzy programming approach for vendor selection problem in a supply chain. International Journal of Production Economics 101, 273 285 (2006) 44. Kuo, R.J., Lin, Y.J.: Supplier selection using analytic network process and data envelopment analysis. International Journal of Production Research 50, 2852 2863 (2012) 45. Labib, A.W.: A supplier selection model: a comparison of fuzzy logic and the analytic hierarchy process. International Journal of Production Research 49, 6287 6299 (2011) 46. Lam, S.W., Tang, L.C.: Multiobjective vendor allocation in multiechelon inventory systems: a spreadsheet model. Journal of the Operational Research Society 57, 561 578 (2006) 47. Lasch, R., Janker, C.G.: Supplier selection and controlling using multivariate analysis. International Journal of Physical Distribution & Logistics Management 35, 409 425 (2005) 48. Lee, A.H.I.: A fuzzy AHP evaluation model for buyer-supplier relationships with the consideration of benefits, opportunities, costs and risks. International Journal of Production Research 47, 4255 4280 (2009) 49. Li, L., Zabinsky, Z.B.: Incorporating uncertainty into a supplier selection problem. International Journal of Production Economics 134, 344 356 (2011) 50. Liao, Z., Rittscher, J.: A multi-objective supplier selection model under stochastic demand conditions. International Journal of Production Economics 105, 150 159 (2007) 51. Lin, R.-H.: An integrated model for supplier selection under a fuzzy situation. International Journal of Production Economics 138, 55 61 (2012) 52. Mafakheri, F., Breton, M., Ghoniem, A.: Supplier selection-order allocation: A two-stage multiple criteria dynamic programming approach. International Journal of Production Economics 132, 52 57 (2011) 53. Narasimhan, R., Talluri, S., Mendez, D.: Supplier Evaluation and Rationalization via Data Envelopment Analysis: An Empirical Examination. Journal of Supply Chain Management 37, 28 37 (2001) 54. Ng, W.L.: An efficient and simple model for multiple criteria supplier selection problem. European Journal of Operational Research 186, 1059 1067 (2008) 55. Noorul Haq, A., Kannan, G.: Design of an integrated supplier selection and multi-echelon distribution inventory model in a built-to-order supply chain environment. International Journal of Production Research 44, 1963 1985 (2006) 56. Osman, H., Demirli, K.: A bilinear goal programming model and a modified Benders decomposition algorithm for supply chain reconfiguration and supplier selection. International Journal of Production Economics 124, 97 105 (2010) 57. Petroni, A., Braglia, M.: Vendor Selection Using Principal Componet Analysis. Journal of Supply Chain Management 36, 63 69 (2000) 58. Pitchipoo, P., Venkumar, P., Rajakarunakaran, S.: A distinct decision model for the evaluation and selection of a supplier for a chemical processing industry. International Journal of Production Research 50, 4635 4648 (2012) 59. Rezaei, J., Davoodi, M.: A joint pricing, lot-sizing, and supplier selection model. International Journal of Production Research 50, 4524 4542 (2012) 60. Roodhooft, F., Fonings, J.: Vendor selection and evaluation An activity based costing approach. European Journal of Operational Research 96, 97 102 (1997) 61. Sadeghieh, A., Dehghanbaghi, M., Dabbaghi, A., Barak, S.: A genetic algorithm based grey goal programming (G ) approach for parts supplier evaluation and selection. International Journal of Production Research 50, 4612 4630 (2012) 62. Saen, R.F.: Suppliers selection in the presence of both cardinal and ordinal data. European Journal of Operational Research 183, 741 747 (2007) 63. Sen, C.G., Sen, S., Baslıgil, H.: Pre-selection of suppliers through an integrated fuzzy analytic hierarchy process and max-min methodology. International Journal of Production Research 48, 1603 1625 (2010) 64. Sevkli, M., Koh, S.C.L., Zaim, S., Demirbag, M., Tatoglu, E.: An application of data envelopment analytic hierarchy process for supplier selection: a case study of BEKO in Turkey. International Journal of Production Research 45, 1973 2003 (2007)
65. Sucky, E.: A model for dynamic strategic vendor selection. Computers & Operations Research 34, 3638 3651 (2007) 66. Talluri, S., Narasimhan, R., Nair, A.: Vendor performance with supply risk: A chance-constrained DEA approach. International Journal of Production Economics 100, 212 222 (2006) 67. Tam, M.C.Y., Tummala, V.M.R.: An application of the AHP in vendor selection of a telecommunications system. Omega 29, 171 (2001) 68. Tsai, W.C.: Fuzzy measures of supplier evaluation under lean concepts. Journal of the Operational Research Society 60, 105 1011 (2009) 69. Tsai, W.-H., Hung, S.-J.: A fuzzy goal programming approach for green supply chain optimisation under activity-based costing and performance evaluation with a value-chain structure. International Journal of Production Research 47, 4991 5017 (2009) 70. Ustun, O., Demı rtas, E.A.: An integrated multi-objective decision-making process for multi-period lot-sizing with supplier selection. Omega 36, 509 521 (2008) 71. Vahdani, B., Zandieh, M.: Selecting suppliers using a new fuzzy multiple criteria decision model: the fuzzy balancing and ranking method. International Journal of Production Research 48, 5307 5326 (2010) 72. Wang, Y.-M., Chin, K.-S., Leung, J.P.-F.: A note on the application of the data envelopment analytic hierarchy process for supplier selection. International Journal of Production Research 47, 3121 3138 (2009) 73. Weber, C.A., Current, J.R., Benton, W.C.: Vendor selection criteria and methods. European Journal of Operational Research 50, 2 18 (1991) 74. Wu, C.-W., Shu, M.H., Pearn, W.L., Liu, K.H.: Bootstrap approach for supplier selection based on production yield. International Journal of Production Research 46, 5211 5230 (2008) 75. Wu, D., Olson, D.L.: A comparison of stochastic dominance and stochastic DEA for vendor evaluation. International Journal of Production Research 46, 2313 2327 (2008) 76. Wu, D.D., Zhang, Y., Wu, D., Olson, D.L.: Fuzzy multi-objective programming for supplier selection and risk modeling: A possibility approach. European Journal of Operational Research 200, 774 787 (2010) 77. Wu, T., Blackhurst, J.: Supplier evaluation and selection: an augmented DEA approach. International Journal of Production Research 47, 4593 4608 (2009) 78. Xia, W., Wu, Z.: Supplier selection with multiple criteria in volume discount environments. Omega 35, 494 504 (2007) 79. Xu, J., Ding, C.: A class of chance constrained multiobjective linear programming with birandom coefficients and its application to vendors selection. International Journal of Production Economics 131, 709 720 (2011) 80. Yu, M.-C., Goh, M., Lin, H.-C.: Fuzzy multi-objective vendor selection under lean procurement. European Journal of Operational Research 219, 305 311 (2012) 81. Zhang, X., Lee, C.K.M., Chen, S.: Supplier evaluation and selection: a hybrid model based on DEAHP and ABC. International Journal of Production Research 50, 1877 1889 (2012)