Overview The 30 Second Pitch Intel Solutions for Lustre* solutions Deliver sustained storage performance needed that accelerate breakthrough innovations and deliver smarter, data-driven decisions for enterprise use. We do this by: Creating products and support services that solve the key challenges the organizations face when implementing storage solutions. Intel Lustre solutions use industry-leading hardware and software: Flexible, storage neutral solutions Easy to install, con figure and manage Highly available and resource ef ficient Extensible and easily integrated What this means: You can rely on Intel Lustre Solutions to add signi ficant value across your data center and boost application performance. How Are Customers Challenged Today? Under powered storage solutions Insuf ficient storage performance has a direct, negative impact on application performance. Purpose-built for superior performance, Intel Lustre Solutions deliver the sustained performance needed by today s applications. Proprietary, single vendor storage solutions As with servers, which have promoted the idea of openness, today s storage administrators and purchasers demand multi-vendor storage solutions that promote competition to keep prices low. Shaped by their experiences with clustered compute servers, they require proven solutions built using standard software components. Intel Lustre Solutions meet this important criteria. Extensible, modular and simple to manage Enterprise markets and end-users demand extensible, interoperable and easily integrated storage solutions Intel Lustre Solutions Overview Built upon unmatched open source expertise Intel is the primary developer and maintainer of the open source Lustre file system software ensuring that new features are designed, built and tested for enterprise-class storage solutions. Advanced features that enhance Lustre solutions Intel Lustre Solutions build upon open source Lustre to deliver additional bene fits, including: 1. Intel Manager for Lustre* 2. Modern REST interface and storage plug-interfaces for deep integration with storage arrays or applications. 3. Fast, shared, simple to manage storage for Hadoop Map Reduce applications Global Technical Support Services As the recognized Lustre experts, Intel has the technical expertise and experience needed to support even the most complex con figurations..
The HPC Storage Market The High Performance Storage Market Servers Storage Service The High Performance Computing (HPC) Market 1 The overall HPC market, comprised of servers, storage, applications and services, is forecasted to grow to $30B by 2017. Storage for HPC is the fastest growing segment of the HPC market, growing +8% annually, and is expected to be a $6B market, up from $4B today. Spending on storage for HPC and big data will continue to outpace all other HPC segments. 2017 15 8% CAGR 6 2.4 $B Servers used for clustered storage solutions account for nearly 40% of all HPC server revenues. Intel Xeon is the dominant processor for clustered storage servers the ideal hardware foundation for an Intel Lustre Solution. 2012 11 4 1.9 Key Drivers Shaping High Performance Storage Investments in HPC solutions will continue to grow because: They create strong, sustained competitive advantages, There are important problems to be solved - from advanced simulations to life sciences, weather forecasting and climate modeling and oil/gas/ energy What this means: Intel Lustre Solutions lower the complexity and cost of high performance storage solutions for HPC and data-intensive workloads 0 5 10 15 20 25 High Performance Storage Meets Big Data The Need for Fast, Shared, Easy to Manage Storage for Hadoop Applications Per IDC, over 65% of HPC users are running Hadoop applications on their HPC systems, further fueling the need for fast, shared storage solutions. The HPC storage-big Data segment is forecasted to grow at +18% CAGR ideal for Intel HPC Distribution for Apache Hadoop software. Source: 1 IDC, Broad HPC Market 2012-2017, #242742, August 2013
Lustre Software Solutions Overview What is Lustre? A closer look at Lustre software What does an Intel Enterprise Edition for Lustre* software solution look like? Purpose-built to support the most demanding storage requirements, Lustre is the most widely used file system for HPC, and is rapidly gaining use in enterprise and Big Data markets. Management Target (MGT) Metadata Target (MDT) Targets (OSTs) Targets (OSTs) What makes Lustre important? 1. Speed: Over 2 TB/second, with many production sites running between 500-750 GB/second 2. Scalability: Able to support virtually unlimited numbers of storage servers and clients 3. Ef ficient: Achieves ~90% of underlying storage and network resources 4. Capacity: Massive file and file system sizes (32 and 512 PB respectively) to support any workload. Management Network Metadata Servers Intel Manager for Lustre Servers Servers What this means: Fast, massively scalable, cost effective and ef ficient storage solutions for traditional HPC and emerging enterprise applications of all sizes. High Performance Data Network (In finiband, 10GbE) Lustre Clients (1 100,000+) * Some names and brands may be claimed as the property of others.
Intel Enterprise Edition for Lustre* software Intel Enterprise Edition for Lustre* software Value Proposition For storage administrators and data scientists who need very fast and highly scalable storage that s simple to con figure and manage -- Intel Enterprise Edition for Lustre is an enhanced implementation of Lustre that lowers the complexity and management costs while accelerating the bene fits of distributed, shared storage. Differentiating Features: ü Very resource ef ficient ü High availability architecture for storage servers ü Choice and flexibility: Vendor neutral solutions ü Extensible: Storage plug-in and REST interfaces ü Lower total cost of ownership Target Buyers: Storage administrators and data center managers Line of business managers needing fast, effective storage (e.g. Hadoop applications) A Closer Look What are the key pieces of Intel Enterprise Edition for Lustre? Hadoop Adapter Lustre storage for MapReduce applications REST API Extensibility Management and Monitoring Services Lustre File System Full distribution of open source Lustre software Intel value-added software Intel Manager for Lustre* Software Configure, Monitor, Troubleshoot, Manage Open source software CLI Storage Plug-in Integration Creating a Lustre Solution What Intel technologies can be used? Lustre is ideal for exposing the complete Intel technology portfolio, from 1. Xeon processors, including Xeon Phi 2. Intel fabrics, from True Scale In finiband to Gb Ethernet 3. Intel [HPC] Distribution of Apache Hadoop* software 4. Intel Enterprise Edition for Lustre* software What do I sell? Support services based on the number of object storage servers that will be deployed Dual-attached block storage required for high availability con figurations
Competitive Landscape - Lustre Powered Storage Lustre Not Lustre The Most Widely Used File System for HPC Open Source Intel Enterprise Edition for Lustre Xyratex ClusterStor IBM GPFS Panasas ActiveStor The latest research from IDC shows that Lustre is the most widely used primary file system for HPC. And equally important, only Lustre grew in fact, Lustre use grew nearly 10% to reach 27% overall, while IBM GPFS remained unchanged. Software-only Y Y N/A Y N Integrated storage appliance N Y Y Y Y Hardware neutral Y Y N Y N 27 22 Management CLI only CLI & UI CLI & UI CLI & UI UI Provisioning Y Y Y 11 7 4 HW Monitoring N Y (via plug-in) Y Y REST API N Y N N Storage plug-in N Y N N N Shared, parallel storage for Hadoop Map/Reduce N Y N Y N Source: IDC, January 2014
FAQ What is Intel Enterprise Edition for Lustre* software? What should I ask or listen for to determine if I have an opportunity? With a full release of open source Lustre software Intel EE for Lustre software is purpose-built to combine the superior performance and massive scalability of Lustre with simple but powerful management tools, unique support for Hadoop applications and modern, open interfaces that allow enterprises of all sizes to exploit the advantages of scale-out storage software to help solve today s most data-intensive computing and storage challenges. Ask your prospect about their current storage solution and applications. Are they getting adequate storage performance to power their applications? Are they experiencing any capacity or I/O bottlenecks? Are they planning to deploy any new applications, such as Hadoop MapReduce? Is their current storage solution dif ficult to manage? Are they using Linux today, or willing to consider using Linux? Ask whether they have any concerns about using open source software. Who is their primary storage vendor? Also, have they ve ever considered a Lustre-based solution? Who can I contact for help? HPDD has a roster of sales and solution architects that you can contact for help. Refer to slide 5. How can my prospect learn more? How are Lustre solutions priced? What makes Lustre from Intel unique? Customers and prospects can learn more about Intel Solutions for Lustre at lustre.intel.com Pricing is based on the total number of storage servers within an Intel Lustre Solution con figuration. Contact one of the sales resources listed on slide 5 complete details. With the needs of enterprise customers in mind, we ve extended Lustre with smart management tools, open interfaces and a software connector that makes storage for Hadoop MapReduce applications simpler to manage and more cost effective.
Case Study [visit the partner portal for the complete case study] 10-15 TB of processed data weekly Processed data is small fraction of overall storage capacity Stored in irods data warehouse BAM or FASTA format files Use pattern matching algorithms like BWA and BLAST Lustre offers immense scalable capacity Now have 8 production Lustre file systems and are planning to add more Performance was main goal but scale, flexibility, ef ficiency were critical Challenge: Improvements to lab equipment and processes have led to exponential increases in the volume of data being generated but storage budgets are flat or growing slowly. Large data sets are dif ficult to proactively manage, and can easily overwhelm storage resources. Un-optimized storage has a direct, negative impact on application performance slowing the time for breakthrough results. Solution: Exploit the power and scale of HPC-class storage, powered by Intel Enterprise Edition for Lustre* software for unprecedented performance with unmatched management simplicity. Bene fits that storage solutions powered by Intel EE for Lustre software provided: Openness Developed and enhanced by the Lustre experts Global namespace all clients can access all data Performance Upwards of 1 TB/s Virtually unlimited file system and per file sizes Management simplicity using Intel Manager for Lustre*