Manjra Cloud Computing: Opportunities and Challenges for HPC Applications

Transcription

1 Manjrasoft Cloud Computing: Opportunities and Challenges for HPC Applications 1

2 Prediction: Buyya s Cloud is the Computer 100% real in 2020! Dr. Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab Dept. of Computer Science and Software Engineering The University of Melbourne, Australia Manjrasoft Dr Rajkumar Buyya Ch ie f Exe c utiv e O ffic e r Manjrasoft Pty Ltd Room 5.31, ICT Building, 111, Barry Street, Carlton, Melbourne, VIC 3053, Australia P: F : E: raj@manjrasoft.com Gridbus Sponsors Manjrasoft

3 Issues with HPC So far, HPC is too much patronaged by Govt. and dominated by scientific apps: This has changed recently with Clusters Setting up HPC environment is harder and requires too much of expertise. Often people with PhD qualification needs to be hired develop parallel applications. Programming in MPI is harder. Need more advances in Application Development and Deployment Environments 3

4 Issues with HPC HPC environment is often setup to meet peak needs. HPC systems are often underutilised Few applications dominate the system. Clouds can help here: Blessing for those who have a great idea for applications (and don t have huge budget). Lease more resources only when you need. But Clouds need to have SDK supporting HPC and non-hpc (Internet Service) Applications 4

5 Too popular: too many are In Search of Cloud Computing Legend: Cluster computing, Grid computing, Cloud computing 5

6 Aneka:.NET-based Cloud Computing Development of Enterprise Cloud Applications Cloud enabling legacy applications Portability for Customer Apps: Enterprise Public Clouds.NET/Win Mono/Linux Design Explorer APIs SLA-Negotiation Web Services Management Web Services Container Programming Models Thread Model Task Model Map Reduce Model Other Models Foundation Services Membership Services Reservation Services Storage Services License Services Accounting Services Fabric Services Dynamic Resource Provisioning Services Hardware Profile Services Windows Linux Physical Machines/Virtual Machines Amazon Private Cloud 6 Administration Portal LAN network Microsoft Google IBM Data Center Security Software Development Kit Management Studio Persistence SDK containing APIs for multiple programming models and tools Runtime Environment for managing application execution management Suitable for Management Kit Application

7 Clouds pose Challenge Some HPC Apps (e.g., MPI-based) often use space shared allocation: Nodes need to be allocated/reserved often for entire execution duration. Cloud providers will charge once you lease nodes irrespective of their usage. Block charging of Clouds (hourly basis like in Amazon) is NOT good for HPC applications. VMs can be performance killers. 7

8 What do we do? Can we force Cloud providers to change charging policy? Can we bypass VMs to gain best performance. We/HPC definitely need to align with mainstream computing industry: Make HPC Apps accessible/beneficial for all. Offer HPC Apps as services so that they can be embedded in consumer applications. 8

9 When will Cloud spending become 50% of IT spending or reach to a several trillion $ business/year? 600? 30% 1000? 50% 120? 15% ? Buyya s Estimate! 2020?

10 Manjrasoft: Roadmap & ambition - What can we do to achieve it and how can you all help? CNN.com: Manjrasoft Acquires Microsoft Aneka idea Aneka Aneka Beta Aneka Patent 1.0, Amazon Aneka Federation Open Cloud Market De-facto PaaS Aneka: De-facto PaaS On all Clouds 50% Cloud Apps On Manjrasoft 70% Cloud Apps On Manjrasoft 50 % of IT spending is on Cloud (trillions?)

11 Manjrasoft Become part of the Revolution: Join hands with Manjrasoft and use its Solutions for Cloud Computing! 11

12 Thanks for your attention! Are there any Questions? Comments/ Suggestions Manjrasoft We Welcome Cooperation in R&D and Business!

13 References Blueprint Paper! R. Buyya, C. S. Yeo, S. Venugopal, J. Broberg, I. Brandic, Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5 th Utility, Future Generation Computer Systems (FGCS) Journal, Aneka Documents: The Grid Economy Paper: R. Buyya, D. Abramson, S. Venugopal, The Grid Economy, Proceedings of the IEEE, No. 3, Volume 93, IEEE Press, MetaCDN Paper: James Broberg, Rajkumar Buyya, and Zahir Tari, MetaCDN: Harnessing 'Storage Clouds' for High Performance Content Delivery, Journal of Network and Computer Applications, ISSN: , Elsevier, Amsterdam, The Netherlands, CloudSim Keynote Paper: R. Buyya, R. Ranjan and R. Calheiros, Modeling and Simulation of Scalable Cloud Computing Environments and the CloudSim Toolkit: Challenges and Opportunities, Proceedings of the 7th High Performance Computing and Simulation (HPCS 2009) Conference, Leipzig, Germany, June 21-24,

14 14