Building Out Your Cloud-Ready Solutions. Clark D. Richey, Jr., Principal Technologist, DoD

Transcription

1 Building Out Your Cloud-Ready Solutions Clark D. Richey, Jr., Principal Technologist, DoD Slide 1

2 Agenda Define the problem Explore important aspects of Cloud deployments Wrap up and questions Slide 2

3 Big Data Solution Why MarkLogic? Built for complex, unstructured information Petabyte scale with predictable elastic scaling Real time (load and query) Handles complex queries / analytics High performance Slide 3

4 Virtualization Utility Computing Hadoop Dynamic Scaling Map-Reduce SaaS Security PaaS Grid Computing

5 What is Cloud Computing? Cloud computing is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned with minimal management effort or service provider interaction. This cloud model is composed of three service models, and two primary deployment models Slide 5

6 Virtualization VMware, Xen, HyperV Optimization Akamai, Aspera Service and Deployment Models SaaS Salesforce, Netsuite, Taleo, Office Live, Google Apps PaaS Force.com, Azure, AWS, Google App Engine, MarkLogic IaaS Amazon, Terremark, Savvis, Sun, EMC, HP, IBM Public cloud cloud resources available and open to the public via the internet Private cloud cloud resources accessible exclusively from within a firewall or VPN Slide 6

7 Service and Deployment Models PaaS Force.com, Azure, AWS, Google App Engine, MarkLogic IaaS Amazon, Terremark, Savvis, Sun, EMC, HP, IBM Public cloud cloud resources available and open to the public via the internet Private cloud cloud resources accessible exclusively from within a firewall or VPN Slide 7

8 Hadoop Hadoop is a popular open-source implementation of the MapReduce algorithm framework for distributed processing Provides excellent support for certain analytics and batch processing Designed to work at very large scales Like everything else, often needs to be part of a larger solution Slide 8

9 Virtualization Backbone of many IT cost saving strategies Lowers cost of hardware and labor Provides operational agility Not supported by many Enterprise Class products Slide 9

10 High Availability Ability to continue operations without loss of data in the event of a system failure Low cost options Leveraging existing infrastructure Local disk storage Support for Continuity of Operations Plan (COOP) Easy to setup and maintain Slide 10

11 Security Moving to a Cloud based deployment can increase security concerns Applications often co-located on physical servers Continued need for application level security Robust, built in security Support for PKI, LDAP / ActiveDirectory Previously accredited / certified COTS solutions Slide 11

12 Monitoring and Management Out of the box support for major monitoring tools Nagios HP Operations Manager Ability to easily connect other monitoring tools Automated, configurable backup Fire and forget administration Slide 12

13 Scalability Scale out on commodity hardware Do you need specialized hardware / appliance? Beware of hardware lock-in Do your tools force you to scale up instead? How difficult is it to add capacity? Increase capacity in minutes, not hours Can you add capacity while the system is running in production? Slide 13

14 Dynamic Scaling Automate the addition or removal of servers as demand increases or decreases Requires strong understanding of demand patterns and application architecture Automated interaction of: Virtualization Monitoring Scale out Slide 14

15 Support for Hadoop Seamless support Ability to expose data to MapReduce jobs Ability to store results of MapReduce jobs Provides synergistic benefits when combined with Hadoop Real time analytics Alerting Multi-lingual full text search Slide 15

16 MarkLogic Connector for Hadoop MapReduce processing directly on MarkLogic without copying to HDFS Client Hadoop MapReduce Job Tracker Task Tracker Task Tracker Task Tracker Connector Data Node Slide 16 MarkLogic Server

17 Support Cloud solutions can get complicated, quickly Can you get 24 / 7 support? Can support duplicate your environment? Can you, if necessary, get classified resources? Slide 17

18 Conclusion Cloud deployments can be a valuable tool but aren t a panacea Can add additional complexity to a solution Ensure that infrastructure and platform meet all your requirements Understand what you are looking to get out of the deployment Slide 18

19 Questions? Slide 19