Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015

Transcription

1 Hortonworks and ODP: Realizing the Future of Big Data, Now Manila, May 13, 2015 We Do Hadoop Fall 2014 Page 1

2 HDP delivers a comprehensive data management platform GOVERNANCE Hortonworks Data Platform 2.2 BATCH, INTERACTIVE & REAL-TIME DATA ACCESS SECURITY OPERATIONS YARN is the architectural center of HDP Data Workflow, Lifecycle & Governance Falcon Sqoop Flume Kafka NFS WebHDFS Script Pig Tez SQL Hive Tez Java Scala Cascading Tez NoSQL HBase Accumulo Slider Stream Storm Slider In-Memory Spark YARN: Data Operating System (Cluster Resource Management) Search Solr Others ISV Engines Authentication Authorization Accounting Data Protection Storage: HDFS Resources: YARN Access: Hive, Pipeline: Falcon Cluster: Knox Cluster: Ranger Provision, Manage & Monitor Ambari Zookeeper Scheduling Oozie Enables batch, interactive and real-time workloads Provides comprehensive enterprise capabilities 1 HDFS (Hadoop Distributed File System) Deployment Choice Linux Windows On-Premises Cloud The widest range of deployment options Delivered Completely in the OPEN Page 2

3 Governance & Integration Security Operations SCALE 3. Data Lake: An architectural shift Unlocking the Data Lake RDBMS MPP EDW New Analytic Apps or IT Optimization HDP 2.2 Data Access YARN Data Management Data Lake Enabled by YARN Single data repository, shared infrastructure Multiple biz apps accessing all the data Enable a shift from reactive to proactive interactions Gain new insight across the entire enterprise SCOPE Page 3

4 ..to shift from reactive to proactive interactions A shift in Advertising From mass branding A shift in Financial Services From Educated Investing A shift in Healthcare From mass treatment A shift in Retail From static branding A shift in Telco From break then fix to 1x1 Targeting to Automated Algorithms to Designer Medicine to Real-time Personalization to repair before break HDP and Hadoop allow organizations to shift interactions from Reactive Post Transaction Proactive Pre Decision Page 4

5 INTRODUCING THE OPEN DATA PLATFORM INITIATIVE FEBRUARY 2015 OpenDataPlatform.org Page 5

6 Open Data Platform Overview The Open Data Platform initiative (ODP) is a shared industry effort to promote and advance the state of Apache Hadoop and Big Data technologies for the enterprise ODP is 100% Apache Software Foundation (ASF) compliant, planning, development, IP guidelines, and marketing. Page 6

7 The Open Data Platform Core ODP Core focus: Apache Hadoop (HDFS, YARN, MapReduce) and Apache Ambari Open source available software components and certification tests Build solutions, software distributions, or internal data-driven applications The ODP Core is not a distribution it s the kernel over which the industry can build enterprise-class Apache Hadoop distributions ODP Core Hadoop Distributions Hadoop Hadoop Distributions Distributions Commercial Commercial Commercial Solutions Solutions Solutions Page 7

8 ODP: Big Data Industry Benefits Drive DOWN cost All Open, Accessible, NO proprietary modules Drive OUT complexity From six modules, to 20, to many more No more fragmentation, greatly simplify app dev/qa with third parties No vendor lock In Consistent documentation and solution development Drive OUT uncertainty All components and modules validated, ready for Enterprise scale deployment Page 8

9 ODP: Big Data Industry Benefits Drive UP Innovation Interoperability drives a broad set of use cases and rapid market growth Common ODP Core with one shared qualification effort: reduced R&D cost More efficient development that balances upstream community innovation with downstream enterprise-ready technology Shared tech marketing: benchmarks, reference architectures, whitepapers Page 9

10 ODP Great Reviews Open Data Platform strives for Hadoop unity Infoworld Feb 17 S. Yegulalp Hey Cloudera & MapR: Open Data Platform is the Real Deal Virigina Backaitas, CMS Wire, Apr 14, 2015 Page 10

11 Big Data in Philippines PLDT: First ODP member from Asia PLDT Talas: First ODP compliant Big Data Platform offering in Asia The other ODP: Open Data Philippines: Launched in Leveraging Big Data and other new Information Technologies Towards Achieving More Open Governance in The Philippines Recent initiatives In support of our thrust to promote the use and reuse of data MAY 5, 2015 Open Data Philippines Boot Camp for UP NCPAGP MAR 23, 2015 OPEN DATA STOCK TAKE WORKSHOP Page 11

12 How You Can Participate Anybody can join the ODP - Members help define governance and structure Leverage the ODP Core as the basis of your own solution Contribute people, tests, and code to accelerate executing on the vision Enabling Big Data solutions to flourish atop a common core platform Page 12

13 Gregory Shea, AP Business Development Page 13