Initial Thoughts on Regionally Aggregated Support for Big Data

Size: px

Start display at page:

Download "Initial Thoughts on Regionally Aggregated Support for Big Data"

Bruno Davis
8 years ago
Views:

1 Initial Thoughts on Regionally Aggregated Support for Big Data Steve Corbató, Deputy CIO & Adjunct Faculty, School of Compu>ng University of Utah Member, UEN Advisory Council ARN2 Workshop, Washington DC April 18, 2013

2 What is driving Big Data at Utah? The science SDSS- IV astrophysical data management site EPSCoR research projects atmospheric science, ecology & hydrology simula>on & experimental data (UU, BYU, USU & UWyo) Data analy>cs & visualiza>on SCI Ins>tute Network research leadership Emulab/protoGENI The structure An>cipated federal open science regula>ons IT Governance (Research Por_olio) review Ac>ve library (academic & medical) interest Cura>on, indexing, and preserva>on New NSA data center (120 MW for load)

3 Massive Astronomical Survey Spectroscopy at The University of Utah (SDSS- IV, ) The Large- Scale Universe (eboss) 2.5- meter Sloan Digital Sky Survey Telescope (Apache Point, New Mexico) 2.5- meter dupont Telescope (Las Campanas, Chile) The Local Universe (MaNGA) Discovering the architecture of nearby galaxies Mapping galaxies & quasars and measuring dark energy Our Galaxy (APOGEE) Dynamical structure and chemical archaeology of the Milky Way Source: Prof. Adam Bolton, Physics & Astronomy, University of Utah

4 Wasatch Snowfall Sensitivity to Local Climate Change +1 C +2 C +3 C +4 C PC Base PC Base PC Base PC Base PC Top PC Top PC Top PC Top Alta Base Alta Base Alta Base Alta Base Mt. Baldy Mt. Baldy Mt. Baldy Mt. Baldy 10% 20% 30% 40% 50% Percent of snow that will instead fall as rain with warming Source: Prof. John Horel and Leigh Jones, Atmospheric Sciences, Univ. of Utah

5 Frisco Peak Observatory Milford, Utah Ultra High Energy Cosmic Ray Observatory Delta, Utah 5

6 Rio Mesa Center on the Dolores River (SE Utah, U of Utah) 6

7 RAW MATERIALS

8 74,000+ sq ft 2 former industrial building south of downtown SLC (~4 miles off- campus) Designed for both enterprise & HPC (2.4 MW) Co- location by research groups & partners Low industrial electric power rates in Utah Energy efficient design (low PUE) In operation since spring

9 Altamont CO Tabiona CO Duchesne CO Myton CO Neola CO Roosevelt CO La Point CO Ballard CO Vernal CO Utah Education Network Wide Area Network 1.5 Mbs T1 45 Mbs Mbs Ethernet Grouse Creek (Box Elder SD) Park Valley (Box Elder SD) To USU To USU Bear River MS Alice C. Harris IS Adele C. Young IS Mt. Logan MS Logan HS Logan S. Campus Logan DO Bear River HS Box Elder HS Fast Forward Charter School Richmond LIB Cache DO Brigham City LIB Box Elder MS Box Elder DO USU White Pine MS N. Cache Center Skyview HS Cedar Ridge MS Cache HS Spring Creek MS S. Cache Center Mountain Crest HS Willow Valley MS Rich DO Rich JHS Rich HS 45 Mbs DS3 155 Mbs OC3 Gigabit Ethernet 1000 Mbs Geomax 1000 Mbs Geomax 1000 Mbs Backbone 10 Gbs Backbone Central MS Highland MS Mound Fort MS Mount Ogden MS Ben Lomond HS Washington HS Ogden Tech Center Ogden HS Weber HS Fremont HS Orion JHS N. Ogden JHS Wahlquist JHS Bonneville HS TH Bell JHS S. Ogden JHS BDO Rocky Mtn JHS Two Rivers HS Sand Ridge JHS Roy HS Roy JHS Ogden DO DATC WSU Weber DO WSU Davis Davis DO Snowcrest JHS MorganHS/MS Morgan DO N.Summit HS/DO See Salt Lake County Detail Manila HS Dagget DO Wendover HS Wendover CO Grantsville HS Grantsville MS Tooele DO Tooele Valley HS Tooele MS Tooele HS Dugway HS Park City LIB S.Summit MS/DO EBC Salt Lake DO Park City DO SLCC Granite DO Wasatch DO Wasatch Co. LIB Altamont HS Murray DO Wasatch MS Roosevelt MS Wasatch HS Roosevelt JHS Jordan DO NUES Tabiona HS Roosevelt LIB Timpanogos SS UVSC Wasatch Duchesne DO Pleasant Grove LIB Lone Peak HS J. Hancock School Roosevelt USU Roosevelt Timpanogos HS Union HS USU Vernal Alpine DO Mountainview HS Uintah River HS UBATC Vernal Orem HS Duchesne DO Lehi HS UBATC UVU Orem LIB Duchesne HS West JHS Duchesne LIB Myton/Conamore Thomsen School Provo DO Duchesne Jail Mountainland ATC USU Vernal Uinta DO Ashley Valley HS Vernal JHS Uintah HS Ibapah EL (Tooele SD) Alpine Life and Learning Nebo DO Springville HS Callao EL (Tintic SD) Tintic DO Payson HS Spanish Fork JHS Spanish Fork HS Spanish Fork MS Tintic HS Juab DO Juab HS Juab MS N. Sanpate MS N. Sanpete HS Wasatch Academy Helper LIB E. Carbon HS N. Sanpete DO CEU Carbon HS Carbon DO Wellington LIB Millard DO Snow College West Desert HS (Tintic SD) Delta HS Delta ATC S. Sanpete DO Canyon View JHS Emery DO Eskdale School (Millard SD) Ephraim MS Manti HS Emery HS Gunnison HS Garrison EL (Millard SD) Fillmore MS Fillmore HS San Rafael JHS CUES N. Sevier HS N. Sevier MS Green River HS Snow College South Richfield Data Center Sevier DO Richfield HS Cedar Ridge HS Red Hills MS S. Sevier HS S. Sevier MS Grand HS Grand DO SouthEast ATC Moab Bald Mesa Milford HS Wayne DO Minersville School Beaver DO Beaver HS Piute DO/HS Wayne HS Wayne MS Hanksville EL Antimony EL Escalante Valley EL USU DCE Parowan LIB Parowan HS Panguitch CO Garfield DO Monticello HS SUU Panguitch HS Panguitch MS Escalante HS Enterprise HS Iron DO SEDC SWATC Canyon View HS Cedar City MS Foothill HS Cedar City HS Cross Hollows MS Bryce Valley HS San Juan Media Center San Juan DO San Juan HS Pine View HS Pine View MS Snow Canyon MS Post HS Snow Canyon HS Tonaquint MS Hurricane LIB Lava Ridge IS Tuachan Charter School Hurricane IS Dixie HS Hurricane MS Dixie MS Desert Hills HS Hurricane HS Desert Hills IS Dixie Hurricane Ctr Fossil Ridge MS Santa Clara LIB Washington DO Washington Co. LIB St. George Rehab Dixie College Valley HS SWATC Kane DO Kanab CO Kanab DCE Kanab HS Kanab MS Big Water EL (Kane SD) Lake Powell EL Navajo Mountain HS Monument Valley HS Montezuma Creek Higher Ed Monument Valley Higher Ed Whitehorse HS 9

10 To Logan Salt Lake International Airport 215 SLC Weather Forecast Office 2242 W. North Temple Utah Higher Education 60 S. 400 W. 15 Salt Palace 100 S. West Temple Kearns Building 136 S. Main St. U of U Park Bldg. 201 President s Circle UEN EBC 101 Wasatch Dr S. Downtown Salt Lake City NOAA Western Region Headquarters 125 S. State St. 400 S. Level 3 PoP Internet2 & NLR Nodes 572 DeLong St. 800 S. 15 Main St. 900 S. University of Utah Main Campus 215 U of U Data Center 875 S. West Temple Research@UEN: Salt Lake City Metro Optical Network U of U Campus Fiber UTA Light Rail Routes (proposed) CENIC/LLC Fiber IRU (through AFS) AFS Fiber IRU (proposed) Northern Utah Extension (proposed) 1 Mile Carrier proprietary information included 10

11 Idaho Utah Tremonton (amplifier, if necessary) 30 Logan (Utah State University) Northern Utah Optical Network Extensions Dark Fiber IRU Along UDOT Right-of- Way to Logan Dark Fiber IRU Along UDOT Right-of- Way to Provo (this proposal) Ogden (potential future add/drop node) Wyoming Utah 20 Miles/32 Kilometers Wyoming Utah University of Utah 80 Level 3 PoP Salt Lake City Metro Fiber Ring UofU Data Center Idaho Logan Orem (potential future add/drop node for UVU) Provo (Brigham Young University) Ogden Wyoming Salt Lake City Provo 15 Nevada Colorado Richfield Cedar City St. George Arizona 100 Miles/161 Kilometers 11

12 Big Data Startup at Utah 1- Petabyte EPSCoR data repository under development Utah/Wyoming CI- WATER project Exis>ng campus HPC center Faculty interest favors investments in cycles over data storage Economics: airline seats vs. real estate Some faculty interest in Hadoop/MapReduce Ac>ve topic in IT Governance Expect funding pressure due to federal R&D Resurgence of open source sofware Off- campus data center, UEN, & EPSCoR partnerships are natural collabora>on vehicles Regional collabora>on extends to Idaho & Montana Partnering with Clemson, Wisconsin, Hawai i, Internet2 et al. on Condo of condos approach

13 Ques>ons How much long- term research data can be moved cost effec>vely to the cloud versus stored locally? Indexing/federa>on vs. ownership How much of a role do discipline- based data repositories play (e.g.,ncar, EarthCube) vs. campus/regional approaches? How do we develop and incent a cura>on discipline with the proper preserva>on techniques? What is the right way to engage the library community How do we fund long- term data storage? How do we preserve and protect research data with PHI and other restricted data (e.g., transla>onal medicine) over >me?

14 Regional roles Access to Internet2 Network and modern, energy efficient data centers Outreach to smaller universi>es and colleges Analog: OSC program for computa>onal science at liberal arts colleges in Ohio Can we do a similar thing for data scien>sts? Access to remote data sources (field science) Tradi>onal call to move up the stack Virtualiza>on and storage aggrega>on USHE Broader leverage of higher ed cloud deals Net+

15 Ques>ons, Comments? mobile

Cyberinfrastructure Facilities in Utah

Cyberinfrastructure Facilities in Utah Steve Corbató! Deputy CIO! Adjunct Faculty, School of Computing! University of Utah!! AAAS External Review! University of Utah! March 4, 2013!!! CI objectives Provide