O C T O B E R 7, A N D Y P A L M S I T S

Transcription

1 U-M Data Centers Status O C T O B E R 7, A N D Y P A L M S I T S

2 U-M Data Centers Agenda What U-M has What U-M still wants What s out there What we re working on U-M Data Centers 2

3 The Issues Capacity Control Cost and rate for cycles Reliability U-M Data Centers 3

4 Some Electrical Stuff How much is a megawatt (MW) 2.5 kw = 1 house 1 MW = 400 homes Power Utilization Efficiency (PUE) How much for computing equipment v. other equipment Example: PUE of 2 ½ of power is used for computing equipment ½ of power is used for cooling, UPS, lighting, etc. U-M Data Centers 4

5 Current Resources ITS MACC (1,700 kw available on the floor) Arbor Lakes (192kW) Arbor Lakes w/mcit (93kW) ASB (95kW) SEB (36kW) Units Mid-size centers - guess: 1,000kW Small server rooms and closets guess: 500kW MCIT Inventory of power and applications needed Note: U-M Ann Arbor uses 84 MW total U-M Data Centers 5

6 Space Demand by Area Administrative More predictable capacity plan Long term need for U-M Research Less predictable capacity plan Less clear term of need for U-M (cloud, virtualization, etc.) Disaster Recovery Administrative and Research use Less predictable capacity plan Long term need for U-M U-M Data Centers 6

7 Electrical Demand Short Term Projected Need NSF-MRI Grant kW CoE 200 kw LSA kW Campus Data Center Consolidation 500kW?? On-Going Projection ITS estimated annual growth TBD MCIT estimated annual growth of 150kW Researchers estimated annual growth of kW Campus Units estimated annual growth TBD Disaster Recovery Note: Amounts above represent available power on the floor Power need *may* level out in 3 years Business process for capacity planning U-M Data Centers 7

8 Efficiency Efficient Cycles Dense equipment e.g. blades High kw per rack 12kW or 24 kw per rack not 2kW Efficient Cooling Control equipment Control the cooling Use a natural source of cooling if possible Low PUE 1.5 or better not 2 U-M Data Centers 8

9 POD Architecture U-M Data Centers 9

10 Container Warehouse U-M Data Centers 10

11 View Inside Container U-M Data Centers 11

12 MACC Efficiency Racks 4kW or 6kW No control over equipment or placement Racks 60% in use (not full yet) PUE currently ~3 Annual cost of electricity: $950K U-M Data Centers 12

13 Data Center Architecture Traditional Facility Tier 2-3 Near U-M Fully outfitted infrastructure expensive to construct 15 year life Expense requires long term amortization Purchase cores as required Must be full to be efficient Warehouse with Modules Tier 1 to Tier 3 on per POD basis Relatively inexpensive to construct warehouse with only network, power and chilling capacity Relatively short life if desired Inexpensive to build PODs (compared to data center) Purchase infrastructure (cooling and backup power) together with cores as required Does not need to be full to be efficient U-M Data Centers 13

14 Data Center Reliability Data Intensive Generally Tier 2-3 Disaster Recovery Tier 2 Compute Intensive Generally Tier 1 Disaster Recovery Tier 1 U-M Data Centers 14

15 Solutions Under Consideration Short term NCRC (possibly with containers or PODs) Leased data center space PODs in a warehouse NCDC Long term (in addition to the above) Cloud Consolidating demand Virtualization for Admin Virtualization for Researchers U-M Data Centers 15

16 Current Consideration Two primary Traditional Tier 2-3 U-M data centers Campus: MACC HHC: NCDC Fill data intensive needs (migrate others out) Do not build another traditional architecture data center Update infrastructure as appropriate One or more POD based Tier 1 to Tier 3 data facilities Free network access Multiple MW of power available Fill compute intensive and lower availability needs U-M Data Centers 16

17 Cost and Price Problem Central large data centers Low cost High price Local small data centers High cost Low price U-M Data Centers 17

18 Local Control Capacity Cost Where Ann Arbor Dearborn Flint Remote keyboard, mouse, monitor U-M Data Centers 18

19 Next Steps Hired consultant Evaluate MACC for efficiency and reliability Expansion plan Go upstream for capacity planning Further analyze short and long term solutions Propose solution(s) Consolidation of server rooms and data centers U-M Data Centers 19

20 One More Thing Blacksmiths have the right idea U-M Data Centers 20

21 Liquid Cooling U-M Data Centers 21

22 A few people working on this Dan Atkins Joe Kryza, Paul Killey, Bill Wrobleski MACC Operations Committee ITS Data Center Lead Team U-M Data Centers 22