HPC- Data-Center TCO model

Size: px

Start display at page:

Download "HPC- Data-Center TCO model"

Brent Hunt
8 years ago
Views:

1 Total Cost of Ownership in High Performance Computing HPC- Data-Center TCO model SoSe 14 Dozenten: Prof. dr. Thomas Ludwig, Dr. Manuel Dolz Vortragender: Rickmer Weichenthal University of Hamburg

2 1. Introduction to Modeling Costs HPC-Data-Center TCO Model R. Weichenthal 2

3 Contents 1. Introduction 1.1 Modeling Costs 1.2 Capital Costs 1.3 Operational Costs 2. Motivation for TCO models 3. TCO Models 3.1 Data Center Cost Model The Data Center Space Cost of Power Delivery Cost of Cooling Ressources 3.2 Overall Model 4. Personell Costs 5. Remarks and conclusion HPC-Data-Center TCO Model R. Weichenthal 3

1.2 Cost of Power Delivery 3.1.3 Cost of Cooling Ressources 3.2 Overall Model 4.

4 1.1 Modeling Costs The TCO of a datacenter: At the top level: Capital expenses and Operational expenses Capex: Investments made upfront and depreciated over time e.g.: construction costs of a datacenter, purchase costs for a server Opex: Recurring costs for running the equipment e.g.: electricity, repairs & maintenance, human resources HPC-Data-Center TCO Model R. Weichenthal 4

: construction costs of a datacenter, purchase costs for a server Opex: Recurring costs for

5 1.1 Modeling Costs At the top level TCO= datacenter depreciation + datacenter Opex + server depreciation + server Opex HPC-Data-Center TCO Model R. Weichenthal 5

+ server depreciation + server Opex 03.06.

6 1.2 Capital Costs Basically : Datacenter construction costs depending on: design, size, location, speed of construction small and very large datacenters are more expensive adding reliability and redundancy increases the costs HPC-Data-Center TCO Model R. Weichenthal 6

large datacenters are more expensive adding reliability and

7 1.2 Capital Costs Expressed in dollars per watt dollars / critical watt makes sense for large datacenters large datacenters cost approx. $12-15/W HPC-Data-Center TCO Model R. Weichenthal 7

8 1.2 Capital Costs Expressed in dollars per watt dollars / critical watt makes sense for large datacenters large datacenters cost approx. $12-15/W HPC-Data-Center TCO Model R. Weichenthal 8

9 1.2 Capital Costs Datacenter primary components: Power Cooling Space Normally 80% of construction costs are for power and cooling 20% are for building and site construction HPC-Data-Center TCO Model R. Weichenthal 9

for power and cooling 20% are for building and site

10 1.2. Capital Costs Example HPC-Data-Center TCO Model R. Weichenthal 10

11 1.3 Operational Costs Opex: Recurring costs for running the equipment e.g.: electricity, repairs & maintenance, human resources Depend on: operational standard (e.g. security guards, testing of generators) the size of the datacenter (larger are cheaper) geographic location design and age of the datacenter HPC-Data-Center TCO Model R. Weichenthal 11

12 1.3 Operational Costs monthly charge per watt Typical operational costs in the US range from 0.02$/w to 0.08$/w per month (excluding actual electricity costs) Operational cost for servers hardware maintenance / repairs, electricity per - machine annual costs quantification of administration costs mostly financed by vendors less administration for large scale applications HPC-Data-Center TCO Model R. Weichenthal 12

repairs, electricity per - machine annual costs quantification of administration costs mostly financed by

13 3. TCO Models HPC-Data-Center TCO Model R. Weichenthal 13

14 3.1 Data Center Cost Model: Space, Power and Cooling Key Drivers: power, ping and pipe space for building and equipment operational expenditures TCO: Cost(total)=Cost(space)+Cost(power hardware)+cost(cooling) +Cost(operation) HPC-Data-Center TCO Model R. Weichenthal 14

expenditures TCO: Cost(total)=Cost(space)+Cost(power

15 3.1.1 The Data Center Space Real estate value consists of two parameters: the Net Operating Income per month (NOI) difference between gross income and operation costs the Capitalization Rate (cap rate) current valuation to expected return between 9% and 13% real estate value: Price(real estate) = NOI/cap rate Extended equasion: Cost(space)=((NOI/m^2)(A(data center))(%occupancy)) / cap rate HPC-Data-Center TCO Model R. Weichenthal 15

to expected return between 9% and 13% real estate value: Price(real estate) = NOI/cap rate Extended equasion:

16 3.1.1 The Data Center Space: Example m^2 property m^2 data center 50% occupied NOI: 50$/m^2 ap rate: 10% Estimated real estate value: Cost(real estate)=((50$/m^2 )(60.000m^2)(0,50))/0,10 Cost(real estate)= 15 Mio $ (or 150$ per m^2) HPC-Data-Center TCO Model R. Weichenthal 16

estate value: Cost(real estate)=((50$/m^2 )(60.

17 3.1.1 The Data Center Space Second Example Alternative Example to estimate leasing prices: NOI/m^2=((Price(real estate))(cap Rate))/ ((%Occupancy)(A(data center))) (( $)(0,09))/((0,50)(60.000m^2)) = 90$/m^2 To break even at 50% occupancy the operating income needs to be 90$/m^ HPC-Data-Center TCO Model R. Weichenthal 17

18 3.1.2 Cost of Power Delivery Beside electricity costs: conditioning, battery back up, one site power generation, redundancy (delivery + generation) Burdened Cost of Power Delivery: Cost(power) = U(Sgrid) P(consumed hardware)+ K1 U(Sgrid) P(consumed hardware) K1 is the power burdening factor measure of increased costs (amortization and maintenance) HPC-Data-Center TCO Model R. Weichenthal 18

U(Sgrid) P(consumed hardware)+ K1 U(Sgrid) P(consumed hardware) K1 is the power burdening factor

19 3.1.2 Cost of Power Delivery K1=J1 U(S, A&M power) / U(Sgrid) J1= maximum capacity (watts)/ utilized capacity P(rated)/P(consumed hardware) Combining the equasions: Cost(power)=U(Sgrid) P(consumed hardware)+u(s, A&M power) P(rated) HPC-Data-Center TCO Model R. Weichenthal 19

hardware) Combining the equasions: Cost(power)=U(Sgrid) P(consumed

20 3.1.2 Cost of Power Delivery Example U(S, A&M power) = U(Sgrid) = 0,072$/W per month 10 MW data center And the data center is 75% utilized: J1=P(rated)/P(consumed hardware) = 10/7,5 =1,33 K1=J1 U(S, A&M power) / U(Sgrid) = 1,33 Cost(power)=(1+K1)U(Sgrid) P(consumed hardware) =(2,33)(0,072$/W)(7,5MW) = $/month HPC-Data-Center TCO Model R. Weichenthal 20

=1,33 K1=J1 U(S, A&M power) / U(Sgrid) = 1,33 Cost(power)=(1+K1)U(Sgrid) P(consumed

21 3.1.3 Cost of Cooling Ressources Equivalent to Cost of Power Delivery: Cost(Cooling)=U(Sgrid) L1P(consumed hardware)+ U(S, A&M cooling) J1L1P(consumed hardware) HPC-Data-Center TCO Model R. Weichenthal 21

22 3.2 Overall Model Cost(space,power,cooling)=(($/m^2)(A(data center))((%occupancy)) +(1+K1+L1+K2 L1)U(Sgrid)P(consumed hardware) HPC-Data-Center TCO Model R. Weichenthal 22

23 4. Personell Costs Personell Costs: M1= average numer of IT personell per rack M2=average numer of facilities personell per rack M3=average numer of administrative personell per rack S(avg)= Average salary of data center personell Cost(personell per rack)= (M1+M2+M3)S(avg)=M(total)S(avg) HPC-Data-Center TCO Model R. Weichenthal 23

24 5.Conclusion Modelling is a complex process wich needs a lot of time: It is easy to do mistakes You have to check your results several times But it is worth it Without modelling a lot of money would be wasted HPC-Data-Center TCO Model R. Weichenthal 24

SoSe 2014 Dozenten: Prof. Dr. Thomas Ludwig, Dr. Manuel Dolz Vorgetragen von Hakob Aridzanjan 03.06.2014

SoSe 2014 Dozenten: Prof. Dr. Thomas Ludwig, Dr. Manuel Dolz Vorgetragen von Hakob Aridzanjan 03.06.2014 Total Cost of Ownership in High Performance Computing HPC datacenter energy efficient techniques: job scheduling, best programming practices, energy-saving hardware/software mechanisms SoSe 2014 Dozenten: