1 Why is BIG Data Important? March Why is BIG Data Important? A Navint Partners White Paper May 2012
2 Why is BIG Data Important? March What is Big Data? Big data is a term that refers to data sets or combinations of data sets whose size (volume), complexity (variability), and rate of growth (velocity) make them difficult to be captured, managed, processed or analyzed by conventional technologies and tools, such as relational databases and desktop statistics or visualization packages, within the time necessary to make them useful. While the size used to determine whether a particular data set is considered big data is not firmly defined and continues to change over time, most analysts and practitioners currently refer to data sets from terabytes(10 12 or 1000 gigabytes per terabyte) to multiple petabytes (1015 or 1000 terabytes per petabyte) as big data. The complex nature of big data is primarily driven by the unstructured nature of much of the data that is generated by modern technologies, such as that from web logs, radio frequency Id (RFID), sensors embedded in devices, machinery, vehicles, Internet searches, social networks such as Facebook, portable computers, smart phones and other cell phones, GPS devices, and call center records. In most cases, in order to effectively utilize big data, it must be combined with structured data (typically from a relational database) from a more conventional business application, such as Enterprise Resource Planning (ERP) or Customer Relationship Management (CRM). Similar to the complexity, or variability, aspect of big data, its rate of growth, or velocity aspect, is largely due to the ubiquitous nature of modern on-line, real-time data capture devices, systems, and networks. It is expected that the rate of growth of big data will continue to increase for the foreseeable future. Specific new big data technologies and tools have been and continue to be developed. Much of the new big data technology relies heavily on massively parallel processing (MPP) databases, which can concurrently distribute the processing of very large sets of data across many servers. As another example, specific database query tools have been developed for working with the massive amounts of unstructured data that are being generated in big data environments. BIG Data Growth and Size Facts (*MGI Estimates) There were 5 billion mobile phones in use in There are 30 billion pieces of content shared on Facebook each month. There is a 40% projected growth in global data generated per year vs. 5% growth in global IT spending. There were 235 terabytes of data collected by the US Library of Congress in April out of 17 major business sectors in the United States have more data stored per company that the US Library of Congress. Big Data Value Potential(*) $300 billion annual value to US healthcare more than twice the total annual healthcare spending in Spain. $600 billion potential annual consumer surplus from using personal location data globally. 60% - potential increase in retailers operating margins possible via use of big data. Big Data Industry Examples Major utility company integrates usage data recorded from smart meters in semi real-time into their analysis of the national energy grid. Pay television providers have begun to customize ads based on individual household demographics and viewing patterns. A major entertainment company is able to analyze its data and customer patterns across its many and varied enterprises e.g. using park attendance, on-line purchase, and television viewership data. The security arm of a financial services firm detects fraud by correlating activities across multiple data sets. As new fraud methods are detected and understood, they are used to encode new algorithms into the fraud detection system.
3 Why is BIG Data Important? March Why is Big Data Important? When big data is effectively and efficiently captured, processed, and analyzed, companies are able to gain a more complete understanding of their business, customers, products, competitors, etc. which can lead to efficiency improvements, increased sales, lower costs, better customer service, and/or improved products and services. For example: Manufacturing companies deploy sensors in their products to return a stream of telemetry. Sometimes this is used to deliver services like OnStar, that delivers communications, security and navigation services. Perhaps more importantly, this telemetry also reveals usage patterns, failure rates and other opportunities for product improvement that can reduce development and assembly costs. (**Oracle) The proliferation of smart phones and other GPS devices offers advertisers an opportunity to target consumers when they are in close proximity to a store, a coffee shop or a restaurant. This opens up new revenue for service providers and offers many businesses a chance to target new customers. (**) Retailers usually know who buys their products. Use of social media and web log files from their ecommerce sites can help them understand who didn t buy and why they chose not to, information not available to them today. This can enable much more effective micro customer segmentation and targeted marketing campaigns, as well as improve supply chain efficiencies. (**) Other widely-cited examples of the effective use of big data exist in the following areas: Using information technology (IT) logs to improve IT troubleshooting and security breach detection, speed, effectiveness, and future occurrence prevention. Use of voluminous historical call center information more quickly, in order to improve customer interaction and satisfaction. Use of social media content in order to better and more quickly understand customer sentiment about you/your customers, and improve products, services, and customer interaction. Fraud detection and prevention in any industry that processes financial transactions online, such as shopping, banking, investing, insurance and health care claims. Use of financial market transaction information to more quickly assess risk and take corrective action.
4 Why is BIG Data Important? March Key Big Data Challenges Understanding and Utilizing Big Data It is a daunting task in most industries and companies that deal with big data just to understand the data that is available to be used, determining the best use of that data based on the companies industry, strategy, and tactics. Also, these types of analyses need to be performed on an ongoing basis as the data landscape changes at an everincreasing rate, and as executives develop more and more of an appetite for analytics based on all available information. New, Complex, and Continuously Emerging Technologies Since much of the technology that is required in order to utilize big data is new to most organizations, it will be necessary for these organizations to learn about these new technologies at an ever-accelerating pace, and potentially engage with different technology providers and partners than they have used in the past. Like with all technology, firms entering into the world of big data will need to balance the business needs associated with big data with the associated costs of entering into and remaining engaged in big data capture, storage, processing, and analysis. Cloud Based Solutions A new class of business software applications has emerged whereby company data is managed and stored in data centers around the globe. While these solutions range from ERP, CRM, Document Management, Data Warehouses and Business Intelligence to many others, the common issue remains the safe keeping and management of confidential company data. These solutions often offer companies tremendous flexibility and cost savings opportunities compared to more traditional on premise solutions but it raises a new dimension related to data security and the overall management of an enterprise s Big Data paradigm. Privacy, Security, and Regulatory Considerations - Given the volume and complexity of big data, it is challenging for most firms to obtain a reliable grasp on the content of all of their data and to capture and secure it adequately, so that confidential and/or private business and customer data are not accessed by and/or disclosed to unauthorized parties. The costs of a data privacy breach can be enormous. For instance, in the health care field, class action lawsuits have been filed, where the plaintiff has sought $1000 per patient record that has been inappropriately accessed or lost. In the regulatory area, for instance, the proper storage and transmission of personally identifiable information (PII), including that contained in unstructured data such as s can be problematic and necessitate new and improved security measures and technologies. For companies doing business globally there are significant differences in privacy laws between the U.S. and other countries. Lastly, it will be very important for most forms to tightly integrate their big data, data security/privacy, and regulatory functions. Archiving and Disposal of Big Data Since big data will lose its value to current decisionmaking over time, and since it is voluminous and varied in content and structure, it is necessary to utilize new tools, technologies, and methods to archive and delete big data, without sacrificing the effectiveness of using your big data for current business needs. The Need for IT, Data Analyst, and Management Resources It is estimated that there is a need for approximately 140,000 to 190,000 more workers with deep analytical expertise and 1.5 million more data-literate managers, either retrained or hired. Therefore, it is likely that any firm that undertakes a big data initiative will need to either retrain existing people, or engage new people in order for their initiative to be successful.
5 Why is BIG Data Important? March Developing a Big Data Strategy Big Data Basics Business Systems Social Data Unstructured Data Process Data Big Data Assessment Sources and Uses Volumes & Metrics Estimated Growth Privacy & Regulatory Impact/ Value Potential Big Data Strategy Organization Impacts Opportunity Analysis Methods and Tools Compliance Business Case & ROI About Navint Partners Navint is a different kind of management consulting firm, excelling in large scale business process change. With offices in New York, Chicago, Boston, Pittsburgh, Philadelphia and Rochester, Navint s consultants specialize in managing the alignment of people, processes and technology when organizations face operational restructuring and IT transformation. A unique blend of experience and innovative thinking allows Navint consultants to address clients' business challenges in imaginative ways.
An Oracle White Paper June 2013 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure
BUY BIG DATA IN RETAIL Table of contents What is Big Data?... How Data Science creates value in Retail... Best practices for Retail. Case studies... 3 7 11 1. Social listening... 2. Cross-selling... 3.
How to embrace Big Data A methodology to look at the new technology Contents 2 Big Data in a nutshell 3 Big data in Italy 3 Data volume is not an issue 4 Italian firms embrace Big Data 4 Big Data strategies
IBM Software Big Data & Analytics Thought Leadership White Paper Better business outcomes with IBM Big Data & Analytics The insights to transform your business with speed and conviction 2 Better business
Internet of Things Next-Generation Business and the Internet of Things Opportunities and Challenges Created by a Connected and Real-Time World Table of Contents 3 The Internet of Things Is Redefining Enterprise
An Oracle White Paper March 2013 Big Data Analytics Advanced Analytics in Oracle Database Advanced Analytics in Oracle Database Disclaimer The following is intended to outline our general product direction.
May 2011 Big data: The next frontier for innovation, competition, and productivity The McKinsey Global Institute The McKinsey Global Institute (MGI), established in 1990, is McKinsey & Company s business
J U L Y 2 0 1 2 OpenText Enterprise Information Management CIOs are under siege Do more with less is no longer an ideal, it s a mandate. With growing volumes and a host of information formats to manage
IBM Software Thought Leadership White Paper June 2013 The top five ways to get started with big data 2 The top five ways to get started with big data Big data: A high-stakes opportunity Remember what life
10 About Big Data and its Challenges and Benefits in Manufacturing About Big Data and its Challenges and Benefits in Manufacturing Bogdan NEDELCU University of Economic Studies, Bucharest, Romania firstname.lastname@example.org
INTELLIGENT BUSINESS STRATEGIES W H I T E P A P E R Architecting A Big Data Platform for Analytics By Mike Ferguson Intelligent Business Strategies October 2012 Prepared for: Table of Contents Introduction...
white paper Boosting Retail Revenue and Efficiency with Big Data Analytics A Simplified, Automated Approach to Big Data Applications: StackIQ Enterprise Data Management and Monitoring Abstract Contents
Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.872.8200 F.508.935.4015 www.idc.com W H I T E P A P E R B i g D a t a : W h a t I t I s a n d W h y Y o u S h o u l d C a r e Sponsored
For Big Data Analytics There s No Such Thing as Too Big The Compelling Economics and Technology of Big Data Computing March 2012 By: 4syth.com Emerging big data thought leaders Forsyth Communications 2012.
1 Contents Introduction. 1 View Point Phil Shelley, CTO, Sears Holdings Making it Real Industry Use Cases Retail Extreme Personalization. 6 Airlines Smart Pricing. 9 Auto Warranty and Insurance Efficiency.
Trends in Cloud Computing and Big Data Nikita Bhagat, Ginni Bansal, Dr.Bikrampal Kaur email@example.com, firstname.lastname@example.org, email@example.com Abstract - BIG data refers to the
Predictive Analytics The Right Tool for Tough Times February 2010 David White Page 2 Executive Summary Enterprises are under pressure to predict the future behavior of customers and potential customers,
July 2013 Contents 1. Introduction 3 2. What is Big Data? 4 3. Big Data Adoption 5 4. Drivers and Barriers 11 5. Opportunities for Digital Entrepreneurship 14 5.1. Supply-side Business opportunities 14
CIO Roundtable - Big March 13, 2013 Big and its Dimensions Big refers to internal and external data that is multi-structured, generated from diverse sources in near real-time and in large volumes making
Drive Your Business with Predictive Analytics By Olivia Parr-Rud Predictive Analytics Expert and Principal at OLIVIAGroup Contents The Nuts and Bolts of Predictive Analytics. 2 Applications in Marketing.
IBM Software Business Analytics Retail Delivering a Smarter Shopping Experience with Predictive Analytics: Innovative Retail Strategies Delivering a Smarter Shopping Experience with Predictive Analytics:
May 2014, HAPPIEST MINDS TECHNOLOGIES Big Data: Why should enterprises adopt it Author Manish Kumar 1 S HARING. MINDFUL. INTEGRITY. LEARNING. EXCELLENCE. SOCIAL RESPONSIBILITY. Copyright Information This
April 2013 Operational Intelligence: What It Is and Why You Need It Now Sponsored by Splunk Contents Introduction 1 What Is Operational Intelligence? 1 Trends Driving the Need for Operational Intelligence
CHAPTER 1.9 Making Big Data Something More than the Next Big Thing ANANT GUPTA HCL Technologies Big data is the business buzzword du jour. But how can you turn this hot topic into a real source of business
Email Management Services: Opportunity for the Postal Service September 27, 2012 Prepared by U.S. Postal Service Office of Inspector General Office of Audit, Revenue and Systems Directorate Report Number:
Five predictive imperatives for maximizing customer value Applying predictive analytics to enhance customer relationship management Contents: 1 Introduction 4 The five predictive imperatives 13 Products