PNNL Institutional Research Cloud Pilot WENDY COWLEY PNNL

Transcription

1 PNNL Institutional Research Cloud Pilot WENDY COWLEY PNNL

2 Background Wendy Cowley Visual Analytics Researcher, National Security Directorate Project Management, software development 20+ PNNL Interests : Visualization, Text analytics, living with deployed software May 15,

3 PNNL Institutional Computing Vision: Accelerate research outcomes by promoting awareness and access to a broad set of enabling capabilities, coupled with the expertise to help leverage them High Performance Computing Specialized Test Beds Network Fabric Cloud Computing FY14 Pilot Cloud Computing as an Institutional Computing capability Software Engineering Managed Infrastructure 3

4 Why Cloud Computing at PNNL? It s what our clients are or will be using It will provide more flexible services to our researchers and projects If we don t invest now, we will fall behind We need it to develop the next generation of capabilities at all architecture levels The timing is right, and we have the resources 4

5 Background Research Cloud Pilot Started October 2014 Using hardware from Institutional Computing s previous high-performance computer, Olympus OpenStack Juno release deployed using RDO Limited to a small number of pilot projects Pilot projects gained access at the end of January Oct Nov Dec Jan 2015 Feb Mar Apr May Jun Jul Aug Sep 2015 Today Pilot 10/1/2014 9/30/2015 Setup Hardware 12/1/2014 1/9/2015 Deploy cloud software 12/22/2014 1/23/2015 On board inital pilot users 1/28/2015 3/13/2015 Operate pilot 1/28/2015 9/30/2015 May 15,

6 Measures of success Evaluate the impact that cloud computing has on research Does it get researchers back to the real question more quickly? Does it make something possible (either in scale or technology)? Is it a more efficient use of computing resources? Does is enable new research, processes or relationships? May 15,

7 Lessons Communication Cloud setup Running the cloud Moving forward May 15,

8 What might you think of when you hear Cloud Computing? Cloud storage of photos and data from mobile devices Apple icloud Instagram Dropbox Commercial cloud providers Amazon Windows Azure Rackspace Google IBM 8

9 Communication - Vocabulary Never assume you share the same definition as the person you are talking to. May 15, 2015 Photos: Public Domain via Pixabay 9

10 Our definition The National Institute of Standards and Technology (NIST) defines five essential characteristics of cloud computing 1. On-demand self-service 2. Broad network access 3. Resource pooling 4. Rapid elasticity 5. Measured service May 15,

11 Cloud Setup - Hardware It will work but just how hard it is remains to be seen. May 15, 2015 Photo: Maitri, Flickr cc 11

12 Cloud Setup - Hardware Current pilot hardware SuperMicro 2 cpu (16 core each), 64 gig memory nodes 4 controller nodes, 96 compute nodes Infiniband leaf switches joined to the Olympus Infiniband fabric May 15,

13 Cloud Setup - Hardware Don t assume that HPC and Cloud workloads will benefit from the same hardware profile. May 15, Photos: Public Domain via Pixabay

14 Cloud Setup - Hardware Its hard to choose the right hardware until you know what kind of research you want to enable. May 15, 2015 Photos: Public Domain via Pixabay 14

15 Cloud Setup Core Software You can probably get what you need, but you might need a programmer to do it. May 15, 2015 Photos: Public Domain via Flickr Commons 15

16 Cloud Setup - Software Licensed software for clouds can be really expensive. May 15, 2015 Photos: Public Domain via Pixabay 16

17 Running a Cloud Networking requires different assumptions Details of traditional networking may not apply directly to the cloud. May 15, 2015 Photos: Public Domain via Pixabay 17

18 Running a Cloud Networking requires different assumptions Details of traditional networking may not apply directly to the cloud. May 15, 2015 Photos: Public Domain via Pixabay 18

19 Running a Cloud Computing and Cyber policy Plan to work with your computing and security teams to manage and measure risk. Understand that evolving policy can take time. May 15, 2015 Photos: Public Domain via Wikimedia 19

20 Running a cloud Software development outreach Developing fully cloud enabled software or deploying to a cloud can require a different mindset. Do what you can to support this. May 15, Photos: Public Domain via Pixabay

21 Running a Cloud Users are hard to predict Reach out more often. Check in with users, have someone that can work with them on complex problems. A vocal unhappy user can derail an otherwise successful deployment. May 15, 2015 Photo: Sharon Mollerus, Flickr cc 21

22 Moving Forward Hybrid public/private cloud mixtures Projects may choose to initially use an internal cloud because the cost is more easily managed yet still have an endpoint deployment goal of a commercial cloud. May 15, Photo: Tony Fischer, Flickr cc

23 Moving forward Measuring success Gather your success stories! May 15,

24 Moving forward Measuring success Gather your success stories! May 15,

25 Moving forward Building your team Say thanks to your team! Look at single points of skill depth try to build more depth. Our core team Kevin Fox - system administrator, contributor to OpenStack Dan Spanner - network engineer Ryan LaMothe - principal researcher and cloud software development architect Wendy Cowley - project manager and occasional system administrator PNNL Institutional Computing team Our extended team The rest of lab s IT staff May 15,

26 Moving forward Giving back - Open Source Outreach Never underestimate what a single agreement can do to your plans. May 15,

27 Questions? Questions? Grateful acknowledgement goes to PNNL CIO - Brian Abrahamson, PNNL s Institutional Computing team, and the Cloud Computing team. Contact us at cloud.computing@pnnl.gov May 15,