appendix: evaluating cloud services using methods of ... · appendix: evaluating cloud services...

Appendix: Evaluating Cloud Services Using Methods of

Supplier Selection

Stefan Harnisch1 and Peter Buxmann1,

1 Technische Universität Darmstadt, Chair of Information Systems,

Hochschulstraße 1, 64289 Darmstadt, Germany

{harnisch,buxmann}@is.tu-darmstadt.de

Table 1: Analyzed journals, ranking according to VHB Jourqual [17].

Journal Rank-

ing Accessed via

Hits

(Rele-

vant)

Ebsco-

Host WoK

Operations Research A+ x

0 (0)

Production and Operations Management A x

5 (0)

OR Spectrum A

x 1 (0)

European Journal of Operational Research A x

29

(10)

Operations Management Research B Springerlink 1 (0)

Mathematics of Operations Research B x

0 (0)

Journal of Operations Management B x

6 (0)

Annals of Operations Research B

x 2 (1)

International Journal of Production Economics B x

55

(26)

International Journal of Production Research B x

66

(27)

Journal of Supply Chain Management B x

13 (4)

Computers and Operations Research B x

12 (3)

International Journal of Physical Distribution and

Logistics Management B x 15 (2)

Journal of the Operational Research Society B x

8 (4)

Omega B x

10 (4)

Decision Support Systems B x

2 (0)

Long Range Planning B x

0 (0)

Sum 225

(81)

Table 2: Occurrence of identified methods

Method Count Percentage

Fuzzy set theory 24 20,9%

AHP 22 19,1%

DEA 12 10,4%

Other 9 7,8%

Linear programming 9 7,8%

Other mathematical programming methods 8 7,0%

Genetic algorithms 6 5,2%

Literature-based comparisons 5 4,3%

ANP 4 3,5%

Goal programming 4 3,5%

Activity based costing 3 2,6%

Grey relational analysis 3 2,6%

Multivariate statistical analysis 2 1,7%

Other statistical methods 2 1,7%

Table 3: Occurrence of identified methods

Source

Methods

AHP ANP Grey Fuzzy Lin.

Progr.

Math.

Progr. ABC DEA

Goal

progr.

Gen-

etic Review

Multi-

variate Statistical Other

# Aissaoui et al. (2007)

x

1

Akarte et al. (2001) x

1 Amid et al. (2006)

x x

2

Amid et al. (2009)

x

1 Amid et al. (2011)

x

1

Araz & Ozkarahan (2007)

x 1 Awasthi et al. (2009)

x 1

Bottani & Rizzi (2008)

x

x 2 Büyüközkan (2012) x

x

2

Cakravastia et al. (2002)

x

1 Cao & Wang (2007)

x 1

Chan (2003) x

1 Chan et al. (2008) x

x

2

Chan et al. (2011)

x

1 Che & Chiang (2012) x

x

2

Che (2010)

x

1 Che (2010) x

x

2

Chen & Chen (2006)

x 1 Chen & Wang (2009)

x

1

Chen (2009)

x

1 Chen et al. (2006)

x

1

Chou et al. (2007)

x

1 Current & Weber (1994)

x

1

Degraeve & Roodhooft (1999)

x

1 Degraeve et al. (2000)

x

1

Demirtas & Üstün (2008)

x

x

2

Source AHP ANP Grey Fuzzy

Lin.

Progr.

Math.

Progr. ABC DEA

Goal

progr.

Gen-

etic Review

Multi-


# Dotoli & Falagario (2012)

x

1

Faez et al. (2009)

x

x

2 Falagario et al. (2012)

x

1

Farzipoor Saen (2009)

x

1 Feng et al. (2011)

x 1

Fuh-Hwa Franklin Liu & Hui Lin Hai

(2005) x

1 Ge Wang et al. (2004) x

x

2

Ghodsypour & O'Brien (1998) x

x

2 Golmohammadi & Mellat-Parast (2012)

x x

2

He et al. (2009)

x

x

2 Ho et al. (2010)

x

1

Huang & Keskar (2007)

x 1 Humphreys et al. (2006)

x

1

Ishizaka et al. (2012) x

1 Jayaraman et al. (1999)

x

1

Kaufmann et al. (2010)

x

1 Kumar et al. (2006)

x

x

2

Kuo & Lin (2012)

x

x

2 Labib (2011) x

x

2

Lam & Tang (2006)

x

1 Lasch & Janker (2005)

x

1

Lee (2009) x

x

2 Li & Zabinsky (2011)

x

1

Liao & Rittscher (2007)

x

x

2 Lin (2012)

x

x x

3

Mafakheri et al. (2011) x

1 Narasimhan et al. (2001)

x

1

Ng (2008)

x

1 Noorul Haq & Kannan (2006) x

1

Osman & Demirli (2010)

x

1 Petroni & Braglia (2000)

x

1

Source AHP ANP Grey Fuzzy

Lin.

Progr.

Math.

Progr. ABC DEA

Goal

progr.

Gen-

etic Review

Multi-


# Pitchipoo et al. (2012) x

x

2

Rezaei & Davoodi (2012)

x

1 Roodhooft & Fonings (1997)

x

1

Sadeghieh et al. (2012)

x

x

x

3 Saen (2007)

x

1

Sen et al. (2010) x x 2 Sevkli et al. (2007) x

x

2

Sucky (2007)

x 1 Talluri et al. (2006)

x

1

Tam & Tummala (2001) x

1 Tsai & Hung (2009)

x

x

x

3

Tsai (2009)

x

1 Ustun & Demirtas (2008)

x

x

2

Vahdani & Zandieh (2010)

x

1 Wang et al. (2009) x

x

2

Weber et al. (1991)

x

1 Wu & Blackhurst (2009)

x

1

Wu & Olson (2008)

x

1 Wu et al. (2008)

x 1

Wu et al. (2010)

x

x

2 Xia & Wu (2007) x

x

2

Xu & Ding (2011)

x

x 2 Yu et al. (2012) x

x

2

Zhang et al. (2012) x

x x

3

Sum 22 4 3 24 9 9 3 12 4 6 5 2 2 10

AHP: Analytical Hierarchy Process

ANP: Analytical Network Process

Grey: Grey theory

Fuzzy: Fuzzy theory

Lin. Progr.: Linear Programming

Math. Progr.: Mathematical Programming

ABC: Activity Based Costing

DEA: Data Envelopment Analysis

Goal progr.: Goal Programming

Genetic: Genetic Algorithms

Review: Literature-based comparison

Multivariate: Multivariate statistics

Statistical: (Other) statistical methods

Other: Everything else

References in the appendix

1. Aissaoui, N., Haouari, M., Hassini, E.: Supplier selection and order lot sizing modeling: A review. Computers & Operations

Research 34, 3516–3540 (2007)

2. Akarte, M.M., Surendra, N.V., Ravi, B., Rangaraj, N.: Web based casting supplier evaluation using analytical hierarchy

process. Journal of the Operational Research Society 52, 511 (2001)

3. Amid, A., Ghodsypour, S.H., O’Brien, C.: Fuzzy multiobjective linear model for supplier selection in a supply chain.

International Journal of Production Economics 104, 394–407 (2006)

4. Amid, A., Ghodsypour, S.H., O’Brien, C.: A weighted max–min model for fuzzy multi-objective supplier selection in a

supply chain. International Journal of Production Economics 131, 139–145 (2011)

5. Amid, A., Ghodsypour, S.H., O’Brien, C.: A weighted additive fuzzy multiobjective model for the supplier selection problem

under price breaks in a supply Chain. International Journal of Production Economics 121, 323–332 (2009)

6. Araz, C., Ozkarahan, I.: Supplier evaluation and management system for strategic sourcing based on a new multicriteria

sorting procedure. International Journal of Production Economics 106, 585–606 (2007)

7. Awasthi, A., Chauhan, S.S., Goyal, S.K., Proth, J.-M.: Supplier selection problem for a single manufacturing unit under

stochastic demand. International Journal of Production Economics 117, 229–233 (2009)

8. Bottani, E., Rizzi, A.: An adapted multi-criteria approach to suppliers and products selection—An application oriented to

lead-time reduction. International Journal of Production Economics 111, 763–781 (2008)

9. Büyüközkan, G.: An integrated fuzzy multi-criteria group decision-making approach for green supplier evaluation.

International Journal of Production Research 50, 2892–2909 (2012)

10. Cakravastia, A., Toha, I.S., Nakamura, N.: A two-stage model for the design of supply chain networks. International Journal

of Production Economics 80, 231 (2002)

11. Cao, Q., Wang, Q.: Optimizing vendor selection in a two-stage outsourcing process. Computers & Operations Research 34,

3757–3768 (2007)

12. Chan, F.T.S.: Interactive selection model for supplier selection process: an analytical hierarchy process approach.


13. Chan, F.T.S., Shukla, M., Tiwari, M.K., Shankar, R., Choy, K.L.: B2B multi-attribute e-procurement: an artificial immune

system based goal programming approach. International Journal of Production Research 49, 321–341 (2011)

14. Chan, F.T.S., Kumar, N., Tiwari, M.K., Lau, H.C.W., Choy, K.L.: Global supplier selection: a fuzzy-AHP approach.


15. Che, Z.H.: A genetic algorithm-based model for solving multi-period supplier selection problem with assembly sequence.


16. Che, Z.H.: Using fuzzy analytic hierarchy process and particle swarm optimisation for balanced and defective supply chain

problems considering WEEE/RoHS directives. International Journal of Production Research 48, 3355–3381 (2010)

17. Che, Z.H., Chiang, T.-A.: Designing a collaborative supply-chain plan using the analytic hierarchy process and genetic

algorithm with cycle-time estimation. International Journal of Production Research 50, 4426–4443 (2012)

18. Chen, C.-T., Lin, C.-T., Huang, S.-F.: A fuzzy approach for supplier evaluation and selection in supply chain management.


19. Chen, C.-M.: A fuzzy-based decision-support model for rebuy procurement. International Journal of Production Economics

122, 714–724 (2009)

20. Chen, K.S., Chen, K.L.: Supplier selection by testing the process incapability index. International Journal of Production

Research 44, 589–600 (2006)

21. Chen, L.Y., Wang, T.-C.: Optimizing partners’ choice in IS/IT outsourcing projects: The strategic decision of fuzzy VIKOR.


22. Chou, S.-Y., Shen, C.-Y., Chang, Y.-H.: Vendor selection in a modified re-buy situation using a strategy-aligned fuzzy

approach. International Journal of Production Research 45, 3113–3133 (2007)

23. Current, J., Weber, C.: Application of facility location modeling constructs to vendor selection problems. European Journal of

Operational Research 76, 387–392 (1994)

24. Degraeve, Z., Labro, E., Roodhooft, F.: An evaluation of vendor selection models from a total cost of ownership perspective.

European Journal of Operational Research 125, 34–58 (2000)

25. Degraeve, Z., Roodhooft, F.: Effectively Selecting Suppliers Using Total Cost of Ownership. Journal of Supply Chain

Management 35, 5–10 (1999)

26. Demirtas, E.A., Üstün, Ö.: An integrated multiobjective decision making process for supplier selection and order allocation.

Omega 36, 76–90 (2008)

27. Dotoli, M., Falagario, M.: A hierarchical model for optimal supplier selection in multiple sourcing contexts. International

Journal of Production Research 50, 2953–2967 (2012)

28. Faez, F., Ghodsypour, S.H., O’Brien, C.: Vendor selection and order allocation using an integrated fuzzy case-based

reasoning and mathematical programming model. International Journal of Production Economics 121, 395–408 (2009)

29. Falagario, M., Sciancalepore, F., Costantino, N., Pietroforte, R.: Using a DEA-cross efficiency approach in public

procurement tenders. European Journal of Operational Research 218, 523–529 (2012)

30. Farzipoor Saen, R.: Supplier selection by the pair of nondiscretionary factors-imprecise data envelopment analysis models.

Journal of the Operational Research Society 60, 1575–1582 (2009)

31. Feng, B., Fan, Z.-P., Li, Y.: A decision method for supplier selection in multi-service outsourcing. International Journal of

Production Economics 132, 240–250 (2011)

32. Fuh-Hwa Franklin Liu, Hui Lin Hai: The voting analytic hierarchy process method for selecting supplier. International Journal

of Production Economics 97, 308–317 (2005)

33. Ge Wang, Huang, S.H., Dismukes, J.P.: Product-driven supply chain selection using integrated multi-criteria decision-making

methodology. International Journal of Production Economics 91, 1–15 (2004)

34. Ghodsypour, S.H., O'Brien, C.: A decision support system for supplier selection using an integrated analytic hierarchy process

and linear programming. International Journal of Production Economics 56/57, 199–212 (1998)

35. Golmohammadi, D., Mellat-Parast, M.: Developing a grey-based decision-making model for supplier selection. International

Journal of Production Economics 137, 191–200 (2012)

36. He, S., Chaudhry, S.S., Lei, Z., Wang Baohua: Stochastic vendor selection problem: chance-constrained model and genetic

algorithms. Annals of Operations Research 168, 169–179 (2009)

37. Ho, W., Xu, X., Dey, P.K.: Multi-criteria decision making approaches for supplier evaluation and selection: A literature

review. European Journal of Operational Research 202, 16–24 (2010)

38. Huang, S.H., Keskar, H.: Comprehensive and configurable metrics for supplier selection. International Journal of Production

Economics 105, 510–523 (2007)

39. Humphreys, P., McCloskey, A., McIvor, R., Maguire, L., Glackin, C.: Employing dynamic fuzzy membership functions to

assess environmental performance in the supplier selection process. International Journal of Production Research 44, 2379–

2419 (2006)

40. Ishizaka, A., Pearman, C., Nemery, P.: AHPSort: an AHP-based method for sorting problems. International Journal of

Production Research 50, 4767–4784 (2012)

41. Jayaraman, V., Srivastava, R., Benton, W.C.: Supplier Selection and Order Quantity Allocation: A Comprehensive Model.

Journal of Supply Chain Management 35, 50–58 (1999)

42. Kaufmann, L., Carter, C.R., Buhrmann, C.: Debiasing the supplier selection decision: a taxonomy and conceptualization.

International Journal of Physical Distribution & Logistics Management 40, 792–821 (2010)

43. Kumar, M., Vrat, P., Shankar, R.: A fuzzy programming approach for vendor selection problem in a supply chain.


44. Kuo, R.J., Lin, Y.J.: Supplier selection using analytic network process and data envelopment analysis. International Journal of

Production Research 50, 2852–2863 (2012)

45. Labib, A.W.: A supplier selection model: a comparison of fuzzy logic and the analytic hierarchy process. International Journal

of Production Research 49, 6287–6299 (2011)

46. Lam, S.W., Tang, L.C.: Multiobjective vendor allocation in multiechelon inventory systems: a spreadsheet model. Journal of

the Operational Research Society 57, 561–578 (2006)

47. Lasch, R., Janker, C.G.: Supplier selection and controlling using multivariate analysis. International Journal of Physical

Distribution & Logistics Management 35, 409–425 (2005)

48. Lee, A.H.I.: A fuzzy AHP evaluation model for buyer-supplier relationships with the consideration of benefits, opportunities,

costs and risks. International Journal of Production Research 47, 4255–4280 (2009)

49. Li, L., Zabinsky, Z.B.: Incorporating uncertainty into a supplier selection problem. International Journal of Production

Economics 134, 344–356 (2011)

50. Liao, Z., Rittscher, J.: A multi-objective supplier selection model under stochastic demand conditions. International Journal of

Production Economics 105, 150–159 (2007)

51. Lin, R.-H.: An integrated model for supplier selection under a fuzzy situation. International Journal of Production Economics

138, 55–61 (2012)

52. Mafakheri, F., Breton, M., Ghoniem, A.: Supplier selection-order allocation: A two-stage multiple criteria dynamic

programming approach. International Journal of Production Economics 132, 52–57 (2011)

53. Narasimhan, R., Talluri, S., Mendez, D.: Supplier Evaluation and Rationalization via Data Envelopment Analysis: An

Empirical Examination. Journal of Supply Chain Management 37, 28–37 (2001)

54. Ng, W.L.: An efficient and simple model for multiple criteria supplier selection problem. European Journal of Operational

Research 186, 1059–1067 (2008)

55. Noorul Haq, A., Kannan, G.: Design of an integrated supplier selection and multi-echelon distribution inventory model in a

built-to-order supply chain environment. International Journal of Production Research 44, 1963–1985 (2006)

56. Osman, H., Demirli, K.: A bilinear goal programming model and a modified Benders decomposition algorithm for supply

chain reconfiguration and supplier selection. International Journal of Production Economics 124, 97–105 (2010)

57. Petroni, A., Braglia, M.: Vendor Selection Using Principal Componet Analysis. Journal of Supply Chain Management 36, 63–

69 (2000)

58. Pitchipoo, P., Venkumar, P., Rajakarunakaran, S.: A distinct decision model for the evaluation and selection of a supplier for a

chemical processing industry. International Journal of Production Research 50, 4635–4648 (2012)

59. Rezaei, J., Davoodi, M.: A joint pricing, lot-sizing, and supplier selection model. International Journal of Production Research

50, 4524–4542 (2012)

60. Roodhooft, F., Fonings, J.: Vendor selection and evaluation An activity based costing approach. European Journal of


61. Sadeghieh, A., Dehghanbaghi, M., Dabbaghi, A., Barak, S.: A genetic algorithm based grey goal programming (G ) approach

for parts supplier evaluation and selection. International Journal of Production Research 50, 4612–4630 (2012)

62. Saen, R.F.: Suppliers selection in the presence of both cardinal and ordinal data. European Journal of Operational Research

183, 741–747 (2007)

63. Sen, C.G., Sen, S., Baslıgil, H.: Pre-selection of suppliers through an integrated fuzzy analytic hierarchy process and max-min

methodology. International Journal of Production Research 48, 1603–1625 (2010)

64. Sevkli, M., Koh, S.C.L., Zaim, S., Demirbag, M., Tatoglu, E.: An application of data envelopment analytic hierarchy process

for supplier selection: a case study of BEKO in Turkey. International Journal of Production Research 45, 1973–2003 (2007)

65. Sucky, E.: A model for dynamic strategic vendor selection. Computers & Operations Research 34, 3638–3651 (2007)

66. Talluri, S., Narasimhan, R., Nair, A.: Vendor performance with supply risk: A chance-constrained DEA approach.


67. Tam, M.C.Y., Tummala, V.M.R.: An application of the AHP in vendor selection of a telecommunications system. Omega 29,

171 (2001)

68. Tsai, W.C.: Fuzzy measures of supplier evaluation under lean concepts. Journal of the Operational Research Society 60, 105–

1011 (2009)

69. Tsai, W.-H., Hung, S.-J.: A fuzzy goal programming approach for green supply chain optimisation under activity-based

costing and performance evaluation with a value-chain structure. International Journal of Production Research 47, 4991–5017

(2009)

70. Ustun, O., Demı˙rtas, E.A.: An integrated multi-objective decision-making process for multi-period lot-sizing with supplier

selection. Omega 36, 509–521 (2008)

71. Vahdani, B., Zandieh, M.: Selecting suppliers using a new fuzzy multiple criteria decision model: the fuzzy balancing and

ranking method. International Journal of Production Research 48, 5307–5326 (2010)

72. Wang, Y.-M., Chin, K.-S., Leung, J.P.-F.: A note on the application of the data envelopment analytic hierarchy process for

supplier selection. International Journal of Production Research 47, 3121–3138 (2009)

73. Weber, C.A., Current, J.R., Benton, W.C.: Vendor selection criteria and methods. European Journal of Operational Research

50, 2–18 (1991)

74. Wu, C.-W., Shu, M.H., Pearn, W.L., Liu, K.H.: Bootstrap approach for supplier selection based on production yield.


75. Wu, D., Olson, D.L.: A comparison of stochastic dominance and stochastic DEA for vendor evaluation. International Journal

of Production Research 46, 2313–2327 (2008)

76. Wu, D.D., Zhang, Y., Wu, D., Olson, D.L.: Fuzzy multi-objective programming for supplier selection and risk modeling: A

possibility approach. European Journal of Operational Research 200, 774–787 (2010)

77. Wu, T., Blackhurst, J.: Supplier evaluation and selection: an augmented DEA approach. International Journal of Production

Research 47, 4593–4608 (2009)

78. Xia, W., Wu, Z.: Supplier selection with multiple criteria in volume discount environments. Omega 35, 494–504 (2007)

79. Xu, J., Ding, C.: A class of chance constrained multiobjective linear programming with birandom coefficients and its

application to vendors selection. International Journal of Production Economics 131, 709–720 (2011)

80. Yu, M.-C., Goh, M., Lin, H.-C.: Fuzzy multi-objective vendor selection under lean procurement. European Journal of


81. Zhang, X., Lee, C.K.M., Chen, S.: Supplier evaluation and selection: a hybrid model based on DEAHP and ABC.


appendix: evaluating cloud services using methods of ... · appendix: evaluating cloud services...

Documents