Big Data and its use for Communications Service Providers. IoT, Washington, DC April 9, 2014 Sanjay Mishra

Transcription

1 Big Data and its use for Communications Service Providers IoT, Washington, DC April 9, 2014 Sanjay Mishra 4/9/2014 IoT, Washington, DC, Big Data & its use for CSP (c)

2 Information and Communications Technology Facts & Figures 2.7 Billion People (~40% of the world population is online) 6.8 billion mobile-cellular subscriptions 750 million households connected to the Internet (41% of the world population) Big Data Is a consequence of an increasing Internet usage with rich multimedia, social media and proliferation of use of data in fields of Health & Medical Sciences, Genomics, Space exploration, Climate science to name a few fields generating exabytes of data and an ever increasing Mobile Internet connections embedded in electronics, cars, buildings and energy systems to create an Internet of Things, which together with Cloud computing is transforming the meaning and use of data in terms of sheer volume, the pace and type of data. 4/9/2014 IoT, Washington, DC, Big Data & its use for CSP (c)

3 4/9/2014 IoT, Washington, DC, Big Data & its use for CSP (c) Big Data Market Big Data Market Trends IDC predicts that the market for big data will reach $16.1 billion in 2014 ($32B by 2017), growing 6 times faster than the overall IT market. IDC includes in this figure Infrastructure (servers, storage, etc., the largest and fastest growing segment at 45% of the market), services (29%) software (24%) Cloud infrastructure will be the fastest-growing sub-segment of the big data market, with a CAGR of close to 50% Worldwide Big Data Technology and Services Revenue, Source: IDC 2013 Our annual data consumption estimated at 9.57 zettabytes (1 zettabyte = ) Source:

4 IoT, Washington, DC, Big Data & its use for CSP (c) Paradigm Shift Traditional Data Bases Shared Systems Centralized data sources Usually have vertical scaling on one computer Computing as a product Relational database with structured data Shared disk file system Analytical applications structured for relational databases High cost for storage, processing, and proprietary databases Reporting Emphasis on counting events using queries such as: How many users from New Haven CT are in my data base? Which customers drive the most sales? These questions can usually be answered by counting the number of times some complex event occurs in a database. Methods can help test hypotheses about patterns in a database such as: Are sales increasing in a given region? How many dropped calls occurred between 1 and 4 pm on a given date What proportion of my most profitable customers use a specific phone (Make and model) Big Data Innovations Shared Nothing Systems Distributed data sources Massive parallel processing on commodity hardware Cloud computing/computing as a service Semi-structured or unstructured data Distributed file systems Analytics based on advanced methods such as MapReduce Low cost for storage, pay-as-you-go processing, and numerous open source solutions. Analytics Emphasis on discovering new patterns and trends such as: What are the important cliques in my network of users? Which users are reputable in my network? Which ad is best to show? Usually performed by algorithms that discover predictive or descriptive in very large databases. Prediction: building models to predict a future event Optimization & visualization

5 4/9/2014 IoT, Washington, DC, Big Data & its use for CSP (c) Opportunities For Communications Service Providers Network Health Monitoring Network & Cyber Security Customer Retention Internet of Things/Machine-to-Machine/ and Fleet Management Health Care Automation Citizen Science Location based services Privacy & Security Gartner estimates that big data analytics can impact a communications service provider s financials by $300 million a year. It identifies four areas as ripe for big data analytics: network optimization, customer engagement, operations, and applications and new business models.