Kieran Towey October2013. Big Data, Data Analytics & GI

Transcription

1 Kieran Towey October2013 Big Data, Data Analytics & GI

2 CRM MRM Ariba Quickbooks NetReach Bills of Material SolidFire Pandora kaggle Scribd. Amazon ihandy Music DocuSign SmugMug salesforce.com Finance SuperCam Snapfish Urban NetSuite AppFog Travel Xactly Dragon Diction Parse Taleo Joyent Plex Systems LinkedIn Reference UPS Mobile Facebook DCC Google ebay Manufacturing Projects GoGrid Hosting.com Hyland CCC Product Configurator SAP HP buzzd Tata Communications Engineering Order Entry NetDocuments SCM Inventory Alterian Datapipe Quality Control Burroughs EMC OpenText HCM IBM Hitachi Workscape Cost Management Zoho Qvidian Scanner Pro Foursquare Hootsuite PingMe Lifestyle Bromium Atlassian nebula HP eprint Twitter CyberShift Sage Splunk Amazon Web Services box.net LimeLight Sport Yandex ScaleXtreme cloudability Games CloudSigma Pinterest Workbrain Every 60 seconds 98,000+ tweets 695,000 status updates 11million instant messages Unisys Mainframe Kilobytes Client/Server Megabytes The Internet Gigabytes Mobile, Social, Big Data & The Cloud Zettabytes 698,445 Google searches NEC Cash Management Microsoft Bull ERP Serif Xerox HCM SLI Systems Zynga OpSource Fijitsu Time and Expense Avid Workday Baidu Fixed Assets Costing Elemica ischedule Navigation Yandex Mixi Accounts Receivable Photo & Video ADP VirtualEdge Yahoo! SCM Khan Academy Zillabyte Heroku Payroll Billing Yammer Adobe Corel CyberShift PaperHost Renren Entertainment Activity Management SuccessFactors Viber PLM Yahoo Training Kinaxis Education Answers.com Microsoft Atlassian SugarCRM Sales tracking & Marketing BrainPOP Social Networking Rostering Saba RightScale PPM Sonar6 Time & Attendance CYworld Quadrem MobileFrame.com YouTube Kenexa Service Sonar6 Jive Software Commissions Saba Business myhomework Database Softscape NetSuite Tumblr. Qzone Claim Processing Intacct Toggl Fring News Amazon dotcloud Cornerstone ondemand Exact Online Data Warehousing Xing Cookie Doodle New Relic Mozy FinancialForce.com Softscape MailChimp PingMe Utilities Zynga Ah! Fasion Girl IntraLinks Volusion Associatedcontent BeyondCore SmugMug MobilieIron Atlassian Productivity Fed Ex Mobile Rackspace Flickr TripIt Twitter 168 million+ s sent 1,820TB of data created 217 new mobile web users Yottabytes Paint.NET

3 Information from the internet of things We have gone beyond the decimal system Today data scientist uses Yottabytes to describe how much government data the NSA or FBI have on people altogether. In the near future, Brontobyte will be the measurement to describe the type of sensor data that will be generated from the IoT (Internet of Things) Brontobyte This will be our digital universe tomorrow Yottabyte This is our digital universe today = 250 trillion of DVDs Exabyte 1 EB of data is created on the internet each day = 250 million DVDs worth of information. The proposed Square Kilometer Array telescope will generated an EB of data per day Terabyte 500TB of new data per day are ingested in Facebook databases Zettabyte 1.3 ZB of network traffic Petabyte 10 9 Gigabyte by 2016 The CERN Large Hadron Collider generates 1PB per second Megabyte 10 6

4 CeNSE Central Nervous System for the Earth A real world example: Networks of billions of low-cost, self-powered, nano-scale sensors Airline Airframe Integrity Passenger Comfort Security Service Personal Sensor Subnet Large Structure Integrity Auto Maker Weather Service Wildlife Research Oil and Gas Department of Transportation Retailer Home Automation & Security Tsunami Warning System Real Time Traffic Conditions Merchandise Tracking Oil Exploration & Production Climate Monitoring Wildlife Tracking Wireless Carrier

5 CeNSE Central Nervous System for the Earth Large sensor networks are being designed and deployed by leading HP customers The data volumes being generated ,000,000,000,000 bytes per day 25,000,000,000,000,000,000 bytes per year Data being generated on the back-end network to configure, monitor and manage 1,000,000,000,000 bytes per day A trillion sensors by 2030, roughly 150 sensors for every person on earth As sensor networks grow to this scale that equates to one million times more storage and processing will be required.

6 The Challenge Variety, velocity, volume, time to value 90% of digital content created by 2015 will be unstructured data types ¹ 75% of currently deployed data warehouses will fail to include unstructured data support (by 2016) 2 to meet new information velocity and complexity of demands 48% Worldwide information volume growth of digital content¹ 86% of corporations cannot deliver the right information, at right time to support enterprise outcomes all of the time³ ¹Source: IDC Predictions 2012: Competing for 2020 ²Source: Gartner - The State of Data Warehousing in 2012 ³Source: Coleman Parkes Survey Nov 2012

7 So why should we care?? Big Data is on the Executive Agenda MARCH 22, 2011, 11:30 A.M. ET. Report to the President: Every Federal Agency Needs a 'Big Data' Strategy February 4, 2011 How Vendors Are Lowering Big Data Barriers March 26, 2011 A Model for the Big Data Era Data-centric architecture is becoming fashionable again Today s Leaders Are Racing to Uncover New Value and Opportunities for Competitive Insights and Improved Operations

8 C-level executives recognize that data is an essential asset and that analytical insights drive business performance High level of commitment Open to external partnerships 2 out of 3 appoint Chief Analytics or Chief Data officer 7 out of 10 are open to external insight providers 2 out of 3 using Predictive Analytics to run business 8 out of 10 recognize that they will have to tap external data sources Recognition of gaps to achieving value 1 out of 5 believe they are getting the ROI from analytics Only 2 out of 5 believe that their organization has access to the right data Clear lack of alignment to core business processes Source: Accenture research with analytics practitioners, released March 2013, Analytics in Action: Breakthroughs and Barriers on the Journey to ROI

9 Data is everywhere, Analytics is everywhere! Customer Segmentation Media Benchmarking Marketing Return on Investment (MROI) Merchandising & Assortment Analytics Customer Retention & Churn Management Sales Talent Analytics Promotions Analytics Pricing Analytics Incentives Management Analytics Business Intelligence & Performance Management Data and Content Management Information Integration Advanced Analytics Technology Enablement Big Data Outcomes Spend Analytics Warranty Analytics Forecasting & Demand Planning Logistics Optimization Predictive Asset Maintenance Clinical Quality Workbench (Health) Smart Customer Operations (Resources) FS Risk & Regulatory Analytics (FS) Network Planning & Optimization (CMT) Biometric Analytics Solutions for PS Talent Management Analytics Change Management Analytics Healthcare Compliance & Fraud Analytics Banking Fraud Analytics PS Intelligent Processing & Compliance Analytics Insurance Claims Fraud Analytics

10 GI is BIG DATA, supports Analytics & will become ubiquitous From Local Tracking disease with Social Media To Global Tracking the world with the UN