Cyberinfrastructure Facilities in Utah

Transcription

1 Cyberinfrastructure Facilities in Utah Steve Corbató! Deputy CIO! Adjunct Faculty, School of Computing! University of Utah!! AAAS External Review! University of Utah! March 4, 2013!!!

2 CI objectives Provide coordinated, high-performance information technology resources and services to CI-WATER team and other Utah and Wyoming EPSCoR researchers! Support research data analysis, management, and curation; modeling; and simulation needs! Tools: computing cycles, data storage, advanced networking, visualization environments, middleware, software libraries, software development, data centers! Strategies! Leverage campus facilities and services new Downtown Data Center! Leverage Utah Education Network (UEN), Front Range Gigapop (FRGP), and Internet2 for advanced networking! Leverage other public sector partners e.g., UDOT, UTA! Collaborate with local HPC centers new relationship with University of Wyoming! Leverage national HPC activities CASC, XSEDE, Open Science Grid!

3 74,000+ sq ft 2 former industrial building south of downtown SLC (~4 miles off- campus) Designing for enterprise & HPC (2.4 MW) Co- location by research groups & partners Low industrial electric power rates in Utah High desert climate: energy efficiency Now in production March

4 ITC Presentation Site Plan 900 South University of Utah Data Center Main Street Richard Street West Temple 800 South

5 ITC Presentation Site Access Parking University of Utah Data Center

6 Research capacity and competiveness Matching network capacity to the research data explosion and remote collaboration demands by providing greater capacity and scalability 30 Gbps at outset 10 Tbps maximum Enhancing competitiveness for research funding and faculty hiring Enhancing potential for in- state collaboration with UofU and BYU Joint NSF EPSCoR projects Utah Field Station Network Interconnection with new 100- Gbps Internet2 network Economics Buying vs. renting - home/condo ownership analog Additional network capacity can be added at incremental cost Customer (UEN, BYU & USU) control of bandwidth, provisioning, and services Trend toward customer ownership & control of networks in higher education Technology Ability to innovate in new network technologies Support for new applications Support for enhanced disaster recovery capabilities 6

7 SALT LAKE CITY - THE (OPTICAL FIBER) CROSSROADS OF THE WEST Seattle Calgary Missoula Idaho Falls Great Falls Butte Bozeman Rexburg Pocatello Logan Reno Salt Lake City Provo San Francisco Denver Las Vegas St. George Los Angeles Albuquerque Phoenix Tucson

8 Altamont CO Tabiona CO Duchesne CO Myton CO Neola CO Roosevelt CO La Point CO Ballard CO Vernal CO Utah Education Network Wide Area Network 1.5 Mbs T1 45 Mbs Mbs Ethernet Grouse Creek (Box Elder SD) Park Valley (Box Elder SD) To USU To USU Bear River MS Alice C. Harris IS Adele C. Young IS Mt. Logan MS Logan HS Logan S. Campus Logan DO Bear River HS Box Elder HS Fast Forward Charter School Richmond LIB Cache DO Brigham City LIB Box Elder MS Box Elder DO USU White Pine MS N. Cache Center Skyview HS Cedar Ridge MS Cache HS Spring Creek MS S. Cache Center Mountain Crest HS Willow Valley MS Rich DO Rich JHS Rich HS 45 Mbs DS3 155 Mbs OC3 Gigabit Ethernet 1000 Mbs Geomax 1000 Mbs Geomax 1000 Mbs Backbone 10 Gbs Backbone Central MS Highland MS Mound Fort MS Mount Ogden MS Ben Lomond HS Washington HS Ogden Tech Center Ogden HS Weber HS Fremont HS Orion JHS N. Ogden JHS Wahlquist JHS Bonneville HS TH Bell JHS S. Ogden JHS BDO Rocky Mtn JHS Two Rivers HS Sand Ridge JHS Roy HS Roy JHS Ogden DO DATC WSU Weber DO WSU Davis Davis DO Snowcrest JHS MorganHS/MS Morgan DO N.Summit HS/DO See Salt Lake County Detail Manila HS Dagget DO Wendover HS Wendover CO Grantsville HS Grantsville MS Tooele DO Tooele Valley HS Tooele MS Tooele HS Dugway HS Park City LIB S.Summit MS/DO EBC Salt Lake DO Park City DO SLCC Granite DO Wasatch DO Wasatch Co. LIB Altamont HS Murray DO Wasatch MS Roosevelt MS Wasatch HS Roosevelt JHS Jordan DO NUES Tabiona HS Roosevelt LIB Timpanogos SS UVSC Wasatch Duchesne DO Pleasant Grove LIB Lone Peak HS J. Hancock School Roosevelt USU Roosevelt Timpanogos HS Union HS USU Vernal Alpine DO Mountainview HS Uintah River HS UBATC Vernal Orem HS Duchesne DO Lehi HS UBATC UVU Orem LIB Duchesne HS West JHS Duchesne LIB Myton/Conamore Thomsen School Provo DO Duchesne Jail Mountainland ATC USU Vernal Uinta DO Ashley Valley HS Vernal JHS Uintah HS Ibapah EL (Tooele SD) Alpine Life and Learning Nebo DO Springville HS Callao EL (Tintic SD) Tintic DO Payson HS Spanish Fork JHS Spanish Fork HS Spanish Fork MS Tintic HS Juab DO Juab HS Juab MS N. Sanpate MS N. Sanpete HS Wasatch Academy Helper LIB E. Carbon HS N. Sanpete DO CEU Carbon HS Carbon DO Wellington LIB Millard DO Snow College West Desert HS (Tintic SD) Delta HS Delta ATC S. Sanpete DO Canyon View JHS Emery DO Eskdale School (Millard SD) Ephraim MS Manti HS Emery HS Gunnison HS Garrison EL (Millard SD) Fillmore MS Fillmore HS San Rafael JHS CUES N. Sevier HS N. Sevier MS Green River HS Snow College South Richfield Data Center Sevier DO Richfield HS Cedar Ridge HS Red Hills MS S. Sevier HS S. Sevier MS Grand HS Grand DO SouthEast ATC Moab Bald Mesa Milford HS Wayne DO Minersville School Beaver DO Beaver HS Piute DO/HS Wayne HS Wayne MS Hanksville EL Antimony EL Escalante Valley EL USU DCE Parowan LIB Parowan HS Panguitch CO Garfield DO Monticello HS SUU Panguitch HS Panguitch MS Escalante HS Enterprise HS Iron DO SEDC SWATC Canyon View HS Cedar City MS Foothill HS Cedar City HS Cross Hollows MS Bryce Valley HS San Juan Media Center San Juan DO San Juan HS Pine View HS Pine View MS Snow Canyon MS Post HS Snow Canyon HS Tonaquint MS Hurricane LIB Lava Ridge IS Tuachan Charter School Hurricane IS Dixie HS Hurricane MS Dixie MS Desert Hills HS Hurricane HS Desert Hills IS Dixie Hurricane Ctr Fossil Ridge MS Santa Clara LIB Washington DO Washington Co. LIB St. George Rehab Dixie College Valley HS SWATC Kane DO Kanab CO Kanab DCE Kanab HS Kanab MS Big Water EL (Kane SD) Lake Powell EL Navajo Mountain HS Monument Valley HS Montezuma Creek Higher Ed Monument Valley Higher Ed Whitehorse HS 8

9 Special EPSCoR program based on ARRA funding Collaboration partners: UofU, USU, BYU, and UEN Award: $1.17M (9/1/2010 for three years) One- year no- cost extension granted through 8/31/2013 Better coordination with Tracks - 1 and - 2 outreach efforts Leadership S. Corbató (PI) and Jim Ehleringer, U. of Utah Larry Baxter and Kelly McDonald, BYU Key partners Eric Hawley and Robert Spall, USU Jim Stewart and Laura Hunter, UEN 9

10 Collaboration of Utah Education Network (UEN), Univ. of Utah, Utah State, and Brigham Young Univ. Leverage UEN operational capability & statewide reach Motivations New University off- campus data center in downtown SLC Reach national R&E networks (Internet2, ESnet, N- Wave) at SLC Level 3 PoP at 100 Gbps Enhanced interconnectivity among 3 research universities in Utah BYU, USU, and UofU Connect federal R&D partners: NOAA/NWS, USFS RSAC 10

11 Leverage public sector partner assets (fiber & conduit) wherever possible UDOT (Interstate/state highway RoW) Utah Transit Authority (UTA/TRAX light rail) Work with wholesale oriented carriers (e.g., Zayo, Syringa) Leverage federal stimulus funding NSF EPSCoR RII Cyber Connectivity award - $1.18M (S. Corbató, U of Utah) NTIA BTOP Round 1 award - $13.4M (M. Petersen/ D. Sampson, UEN) revised statement of work 11

12 To Logan Salt Lake International Airport 215 SLC Weather Forecast Office 2242 W. North Temple Utah Higher Education 60 S. 400 W. 15 Salt Palace 100 S. West Temple Kearns Building 136 S. Main St. U of U Park Bldg. 201 President s Circle UEN EBC 101 Wasatch Dr S. Downtown Salt Lake City NOAA Western Region Headquarters 125 S. State St. 400 S. Level 3 PoP Internet2 & NLR Nodes 572 DeLong St. 800 S. 15 Main St. 900 S. University of Utah Main Campus 215 U of U Data Center 875 S. West Temple Research@UEN: Salt Lake City Metro Optical Network U of U Campus Fiber UTA Light Rail Routes (proposed) CENIC/LLC Fiber IRU (through AFS) AFS Fiber IRU (proposed) Northern Utah Extension (proposed) 1 Mile Carrier proprietary information included 12

13 Idaho Utah Tremonton (amplifier, if necessary) 30 Logan (Utah State University) Northern Utah Optical Network Extensions Dark Fiber IRU Along UDOT Right-of- Way to Logan Dark Fiber IRU Along UDOT Right-of- Way to Provo (this proposal) Ogden (potential future add/drop node) Wyoming Utah 20 Miles/32 Kilometers Wyoming Utah University of Utah 80 Level 3 PoP Salt Lake City Metro Fiber Ring UofU Data Center Idaho Logan Orem (potential future add/drop node for UVU) Provo (Brigham Young University) Ogden Wyoming Salt Lake City Provo 15 Nevada Colorado Richfield Cedar City St. George Arizona 100 Miles/161 Kilometers 13

14 CI-WATER data repository for Big Data September 2012 Support acquired and simulated data curation needs of project! Key driver: atmospheric science simulations (Court Strong)! Needs: access to high speed computation; long-term preservation! Help support EPSCoR Track 1 projects! Goal: 250 Terabytes in Year 2; 350 Terabytes by Year 3! Leverage existing data storage system at Univ. of Utah CHPC (HP ibrix)! Location: new Univ. of Utah Downtown Data Center in Salt Lake City! Distributed storage: Develop and maintain high-performance connectivity to ARCC resources at UWyo as well as HPC/CI resources at BYU and USU! Access: Open to all CI-WATER collaborators! Status: Hardware specification and procurement underway!

15 CI-WATER data repository for Big Data March 2013 CHPC is moving away from previous file storage system (HP) due to software reliability and performance issues! Started new RFI/bid process! Coordination with another campus Big Data project! Partnered with UofU Physics & Astronomy in its role as data management site for Sloan Digital Sky Survey 4 (SDSS-4) 175 TB (separate space)! Successful bid: 1 Petabyte usable space ($230/TB Dell) including DTN! Access: Open to all CI-WATER and iutah collaborators! DTN-DTN connections with U Wyoming and NWSC HPC sites! Status: Purchase underway in production early May!

16 Shared data respository among CI- WATER and iutah insdtudons Supports both fast I/O computadon and long- term data archiving Hosted at CHPC in Utah DDC Leverages high- speed, secure data transfer nodes (DTNs) as advocated by NERSC and ESnet

17 November 10-16, 2012 Salt Palace International conference and exhibition for HPC & computational science Large Utah research and EPSCoR presence >10K attendees and >160K s.f. exhibit space General chair: Jeff Hollingsworth, U Maryland SCinet chair: Linda Winkler, Argonne National Lab Jim Stewart & Kevin Quire, UEN Exhibits: Mary Hall & Steve Corbató, Univ. of Utah

18 Questions? Steve Corbató! office!