DC powered data centers in the world Keiichi Hirose, Ph.D. Senior Research Engineer R&D Headquarters NTT Facilities, Inc. Tokyo Japan LVDC Workshop SMB Strategic Group 4 on LVDC distribution systems up to 1 500 V 29th & 30th of September 2011 (Dresden/Germany)
Motivation 2 Use of DC power
The trend of energy for telecom and computer ( e.g. in Japan) 3 60 Others 50 40 18% increase in 5 years [TWh] 30 IT equipment (routers, servers) 1% of total energy consumed in Japan 20 10 Main frame PCs (home use) PCs (business use) User s terminals 4% of all electricity consumed in Japan Carriers 0 1996 1995 1994 1993 1999 1998 1997 2001 2000 2004 2003 2002 2007 2006 2005 2010 2009 2008
Increasing load power 4
Telecom power supply system 5
An Issue in telocom central office 6 Past Today
Best solution to the issue 7 Past Today
What is a data center? 8
Typical AC and DC power systems in Data Centers 9 AC UPS ICT equipment Utility Grid Gen-set Mechanical SW AC DC Battery AC Static SW AC DC CPU DC DC power plant ICT equipment Utility Grid AC DC DC CPU Gen-set Mechanical SW Battery
AC or DC? 10 Computer Fusion Technology Communication
Comparison of AC, 48 Vdc, and HVDC Systems 11 AC system AC UPS ICT Equipment DC system (48 Vdc) DC UPS ICT Equipment Utility Grid AC DC AC Battery AC ACDC DC CPU Utility Grid AC DC Battery 48 Vdc DC DC CPU High efficiency operation High reliability No phase balancing No Harmonics issues DC system (HVDC) Utility Grid DC UPS AC DC DC DC CPU 1 380 Vdc 2 Battery ICT Equipment Reduce in voltage drop Wire size reduction Equipment footprint reduction, simpler interfaces, and potentially lower costs Easy integration with renewable energy resources
NTT-F s Activities (History) 12 DC Power Promotion 2000 In-house IT System 2001 DC powered Data Center 2006 Telecom System Low Voltage DC (-48( Vdc) NEDO Sendai Project 2004 HVDC Distribution System With Intel 2007 NTT News release June 2008 High Voltage DC (300~400 Vdc)
NTT-F Launched a 48 VDC-powered Data Center on December 2006 13 NTT East Saitama Shin-toshin Building Racks for operation and monitoring system 1,200A@DC48V 30 Racks Operation center
Low Voltage 48 VDC power system 14 AC Main Rectifier Cables DC Power Distribution Unit Front Rear Battery Banks
DC voltage converted from AC power source 15
DC powered sites in Europe, US, and Japan 16 DC power in buildings DC microgrids Operating data centers Planned datacenters
DC powered 0perational/Demo Sites for ICT use 17 US Intel Corp. 400 VDC US Syracuce Univ. 380VDC France Telecom 350/38 0 VDC Sweden Netpower 350/380 VDC China Telecom 240/380 VDC China Mobile 380 VDC KOREA 300/380 VDC US UCSD 380 VDC Japan NTT Group 380 VDC US Duke Energy 380 VDC US Validus 550 VDC Tiwan IT Manufacture 380 VDC New Zealand Telecom NZ 220 VDC Japan Other Demos 380 VDC
300-400VDC Operational and Demo Sites Worldwide 18 Site Location Op Date Max kw Gnesta Municipality Gnesta Mar-06 9kW Elicom Toreboda Mar-06 4.5kW NTT NEDO Project Sendai Feb-07 20kW NTT Univ. Microgrid Aichi May-07 50 kw France Telecom Lannion France Nov-07 31.5kW Ericsson Stockholm Mar-08 4.5kW Soderhamm Teknikpark Soderhamm Jun-08 6kW NTT Data Corp Mitaka City,Tokyo Jan-09 100 kw NTT Lab. Mitaka City, Tokyo Jan-09 100 kw NTT Facilities Toshima-ku, Tokyo Jan-09 100 kw Compare Test Lab Hammaro Karlstad Jun-09 4.5kW Korea Telecom Seoul, Korea Jun-09 N/A Univ of Calif/San Diego San Diego, CA Nov-09 20 kw Syracuse Univ Syracuse, NY Dec-09 150 kw Swedish Energy Agency Eskilstuna Jan-10 18 kw Compare Test Lab Hammaro Karlstad Oct-10 500 kw Duke Energy Choriotte, NC Aug-10 30 kw NTT EAST Tokyo Dec-10 100 kw NTT Atsugi City, Kanagawa Feb-11 100 kw
Gnesta Project, Sweden 19
Hammaro/Eskilstuna/Toredoba, HVDC(DC350V) PV FC AC Main DC350V Transformer Hammaro 10 kv Eskilstuna 0.4 kv Toreboda 0.4 kv 20
DC power in office, Toredoba, Sweden 21
Next generation data center 22 Smart grid data center Providing intelligent energy management across systems and facilities Construction May 29, 2009 Installation September 2009 Launched November 2009
Server room in the data center 23
DC Power Demonstrations by NTT Facilities 24 Sapporo 380VDC NTT Data Corp. 380VDC NTT Facilities 380VDC NTT EAST * 380VDC NTT lab. Sendai NEDO Project 300VDC Demo 380VDC NTT container type *: The demonstration was supported by Ministry of Internal Affairs and Communications, Japan in 2010. Fukuoka Osaka Aichi 380VDC Microgird In university campus Tokyo Metropolitan 100 KW x 5 sites
Modular type data center powered by 380 VDC 25
Power supply unit (PSU) 26 380 Vdc 100-240 Vac Same output for servers (same dimensions)
A Basic configuration of 380 VDC power system 27 HVDC Rectifier HVDC HVDC Wall mounted HVDC Switch HVDC lighting 19-inch Rack IT equipment HVDC Rectifier HVDC PDU HVDC HVDC HVDC N + 1 Voltage booster Dummy loads Basement Option Power strip, plug & socket Three-phase AC main AC PDU Charger Battery bank
NTT-F s site 28 For basic characteristics of HVDC power system, short circuit tests, transient tests, voltage dips, and so on 3 types of HVDC power system Power Distribution Units Dummy loads Intel s HVDC servers 100-kW simulated DC server loads
380VDC lighting in NTT DATA s site 29 Existing ac lighting and new dc lighting New dc lighting Wall switch for dc lighting
380 VDC Power strip in the 19 inch s rack 30 Plug
Other use of 380 VDC plug & socket-outlet 31 Chung Cheng University in Taiwan September 2010
Future plan by Korea telecom 32
What is NEDO Sendai Demonstration? 33 4 year project (FY 2004-2007) Multiple power quality supply (4 AC and 1 DC) A demo for the future ICT society Here is DC Demo system in this building. PV Panels 50 kwp Gas Gensets 350 kw X 2 DVRs 200 kva 600 kva MCFC 250 kw
DC Circuit System Configuration 34 PV panels (50 kwp) 300 VDC HVDC Servers AC main 400 VAC AC/DC Integrated Power Supply DC/DC Supply Side 20 kw DC/DC N+1 430 VDC Batteries 300 VDC N+1 5kW DC/DC 5kW DC/DC 48 VDC 48 VDC Customer Side Servers Lightings Fans DC Power Distribution Unit 4 branches (With Static Switches) Intel and NTT-F are cooperating on the 300 Vdc test during the NEDO Sendai project.
DC Loads 35 Fan (DC -48V) Lighting (DC -48V) Intel s HVDC servers Servers (DC-48V) (HP BL20p)
Campus DC Microgrid in Aichi Institute of Technology 36 This project is supported by the Ministry of Education, Culture, Sports, Science and Technology. Yakusa Campus / TOYOTA City Library PV Panels Educational Facility Batteries Power Station for DGs Hydro Power Wind Turbines DC Power Plant
DC Microgrid Project: Campus 37 Utility Grid 750 kva Gen-set G 6.6 kv/ 210 V 10 kw 10 kw 20 kw PV WG HVDC Servers PV = ~ = = = ~ = = DC bus 350V ~ = ~ = Battery DC Load AC Load AC Load Building #1 Building #2
Barriers to 380/400VDC power system 38 Technical Issues -Breaking-current -Earthing, EMC, Noise -Power quality and reliability -Power architecture -Power electronics engineering (e.g. SiC) Legal and Standard Issues -Common voltage and system configuration -Safety requirements -Working groups and committees Market promotion Market promotion -Cost evaluation (total cost of ownership) -PR / Advertising -Consortium of HVDC power suppliers for ICT Systems
DC power workshops in the U.S and Japan 39 US workshop - EPRI DC Power Production, Delivery and Use Workshop - June 1-2, 2006 - At George Washington Univ. (Washington D.C) - No. of Attendees: 70 persons Manufacture: 21, Engineer: 20, Researcher: 10, Utility: 7, etc. George Washington Univ. Japan workshop - IEEJ Research committee for survey on DC power distribution and application - At Tokyo - No. of Attendees: 20 Persons University prof. : 7, Manufacture: 6, Engineer: 3 Researcher: 2, Utility: 2 Question: What is the most important item for DC power applications?
Important items for DC power (in 2006) 40 Items 1. Standards, codes 2. Safety and Protection 3. Connector 4. Experience 5. Economics Others International standards (Voltage, range) Intelligent circuit breaker Plug & socket-outlet Note Actual operation, Know-how DC type appliances Cost-benefit analysis Circuit topology, promotion, etc. c.f. US NEC covers both AC and DC, and the products can be UL listed today. (LVDC workshop in Washington DC, April 8, 2011) Items 1. Standards, codes 2. Safety and Protection 3. Experience 4. Economics Note International standards (Voltage, range), regulation and law DC circuit breaking, Prevention electric shock, etc. Actual operation, Know-how, DC type appliances Cost-benefit analysis
DC Voltage Standard 41
400 Vdc system (today) 42 Utility grid (AC main) Today AC in Power Converter DC out Y Protection Device X Loads (IT system) Storage Bank Scope of discussion - Near future - The 400 Vdc class system is capability to expand another loads (electrical vehicle and household appliance).
400 Vdc system (Option) 43 Utility grid (AC main) Distributed Energy Source Future AC in Power Converter DC out Y Protection Device X Loads (IT system) Storage Bank Electric Vehicle Household appliances - Near future - The 400 Vdc class system is capability to expand another loads (electrical vehicle and household appliance).
International cooperation 44 France, Japan, Sweden, and US colleagues worked together for the 33th INTELEC.
Acknowledgement 45 I would like to thank: - John Åkerlund, Netpower, Sweden - Marek Szpek, Emerson, Sweden - BJ Sonnenberg, Emerson, USA - Dennis Symanski, EPRI, USA - Didier Marquet, France Telecom - And all of my colleagues
46 Questions?