1 The New Normal: Get Ready for the Era of Extreme Information Management John Mancini President, DigitalLandfill.org
2 Giving Credit Where Credit is Due I didn t make up the term Extreme Information Management I first heard it used by Gartner. But I like it a lot.
3 Big Data is not just more data. --Thornton May
7 The Chessboard Fable
8 We are reaching the 2 nd half of Moore s Chessboard, dramatically changing what information means to our organizations and how it must be managed.
10 Systems of Engagement Era Mainframe Mini PC Internet Social and Cloud Systems of Record Years Typical thing managed A batch trans A dept process A document A web page An interaction Best known company IBM Digital Equipment Microsoft Google Facebook Content mgmt focus Microfilm Image Mgmt Document Mgmt Content Mgmt Social Business Systems
11 Consideration Systems of Record Systems of Engagement Focus Transactions Interactions Governance Command & Control Collaboration Core Elements Facts & Commitments Ideas & Nuances Value Single Source of Truth Discovery & Dialog Standard Accurate & Complete Immediate & Accessible Content Authored Communal Primary Record Type Documents Conversations Searchability Easy Hard Usability User is trained User knows Accessibility Regulated & Contained Ad Hoc & Open Retention Permanent Transient Policy Focus Security (Protect Assets) Privacy (Protect Users)
12 Systems of Engagement For the past decade, companies have been accumulating data in what we call a system of record. Those who survive going forward will also have systems of engagement -- start with evaluating how you can have a relevant conversation with each individual customer across all channels. And insuring you have the analytical capability and the data to support that analysis. That is where the linkage is between the system of record data to system of engagement. On the technology side, we believe the future of handling this volume lies in leveraging the capability of the cloud. Yuchon Lee, Vice President, IBM
13 Our 5-Point Manifesto 1. Commit to the cloud. 2. Mobilize everything. 3. Make the business social. 4. Digitize anything that moves. 5. Prepare for information management on a massive scale.
14 According to IDC Between now and X growth in information 75X growth in information containers BUT 1.4X growth in IT professionals
15 The dramatic changes in the consumer space provide a hint as to what is coming
16 Source =
17 Source =
18 Source =
19 Source =
20 Source =
21 Source =
22 Source =
23 Prepare for extreme information management.
24 We are moving from the Systems of Record era in which our focus was on high-value information assets to the Systems of Engagement era in which volume and complexity and velocity are increasingly dramatically.
25 HIGH DENSITY Systems of Record Value of Information per Unit to Organization Structured Information i.e., data 1 Managed via traditional BI and Data Warehousing Original concept Freeform Dynamics
26 HIGH Value/Byte Systems of Record Value of Information per Unit to Organization Structured Information i.e., data 1 Managed via traditional BI and Data Warehousing 2 Unstructured Information i.e., content Currently unmanaged Managed in ECM & ERM systems Original concept Freeform Dynamics
27 Structured Information i.e., data HIGH Value/Byte Systems of Record 1 Managed via traditional BI and Data Warehousing Value of Information per Unit to Organization 3 LOW Value/Byte Systems of Engagement BIG DATA Internet of things e.g., climate data, transaction records, phone GPS data intelligent, interconnected, and everywhere Unstructured Information i.e., content 2 Currently unmanaged Managed in ECM & ERM systems 4 Volume, Velocity, Variety, Complexity 2.5 quintillion bytes/day BIG CONTENT Social, images, audio, video, text, office apps, web traffic, print streams, , documents Original concept Freeform Dynamics
28 Considered overall, to what degree does your organization exploit its information assets for analysis and decision making purposes? 0% 20% 40% 60% 80% 100% Structured data Unstructured data 5 Fully Poorly Unsure Source: Online survey of Register readers, 122 respondents, first half of November 2011, Freeform Dynamics
29 The New Normal Volume: Enterprises are awash with ever-growing data of all types, easily amassing terabytes even petabytes of information. Turn 12 terabytes of Tweets created daily into improved product sentiment analysis Convert 350 billion meter readings per annum to better predict power consumption Velocity: Sometimes 2 minutes is too late. For time-sensitive processes such as catching fraud, big data must be used as it streams into your enterprise in order to maximize its value. Scrutinize 5 million trade events per day to identify potential fraud Analyze 500 million call detail records per day in real-time to predict customer churn faster Variety: Big data is any type of data - structured and unstructured data such as text, sensor data, audio, video, click streams, log files and more. New insights are found when analyzing these data types together. Use 100 s of live video feeds from surveillance cameras to monitor points of interest Take advantage of the 80% data growth in images, video and documents to improve customer satisfaction Source = IBM
30 The New Normal The vast majority of the world s information is unstructured. Unstructured information growing 15X faster than structured. Raw computing power growing so fast that an off-the-shelf box approaching the computing power of a super computer 5 years ago. Democratization of information access. Source = Understanding Big Data: Analytics for Enterprise Class Hadoop and Streamng Data
31 Irrational thinking Get rid of as much as you can: Litigation risk Compliance risk Storage cost Save everything that you can: Might need it someday Potential aggregated value Disposition uncertainty High Value/Byte Low Value/Byte
32 Welcome to the Era of Extreme Information
33 5 Things to Remember About Extreme Information AIIM.org/research
34 #1: Most organizations do not have the basics in place.
35 61% report content chaos re unstructured information. 80% have no extended search across multiple repositories. For 70%, harder to find your own stuff than stuff on the web.
36 #2: No one except the industry cares about structured vs. unstructured. 61% would find it very useful to link structured and unstructured datasets.
37 #3: Manual records management is dead.
38 66% have an information management strategy, but only 22 percent use it. 79% have an information retention policy, but only 32 percent enforce it. 58% say that a single enterprise records management model underlying all content systems is their goal, yet only 9% have achieved this. Source: AIIM, Process Revolution: Moving Your Business from Paper to PC to Tablet
39 #4: The future is in metadata.
40 The solution to the over abundance of information is more information. David Weinberger Data that is semantic means exactly the same thing to any system or person who uses it. David Siegel
41 The New Normal The standardization of data sets across industries, the separation of data from its description, and the exposure of this information in the cloud create enormous opportunities. We can now analyze problems that were previously undigestible do to the sheer scale of computing power required to address them. The cloud, HADOOP, and MapReduce driving division of vast data into small pieces and parsing computing across large numbers of computers. We can now solve the metadata problem (i.e., there is none!) for vast landfills of unstructured information We can now use semantic technology to apply metadata where it didn t previously exist.
42 For example
43 Individual Paper records Copied and aggregated paper Manual compliance and reading rooms A Short History of Financial Reporting Individual Computerized records Aggregated computerized records Spot audits and online viewing via EDGAR Separation of data from viewing XBRL standards values, tags, dictionaries Internal process standardization Industry and regulatory standardization Adoption as GAAP Mandated by 110 countries Source = Pull: The Power of the Semantic Web Standardized data moves to the cloud Automated compliance and availability Big data analytic opportunities
44 Mining social streams for predictions about the next hit nextbigsound.com
45 Mining social streams for the best food Dishtip.com
46 Mining social streams for drug info Treato.com
47 Using text analytics to motivate voters
48 Big Data Process Applications Financial Services Fraud detection 360 View of the Customer Transportation Logistics optimization Traffic congestion Health & Life Sciences Epidemic early warning ICU monitoring Telecommunications Geomapping / marketing Network monitoring Utilities Weather analysis Smart grid management Intelligence System Log Analysis Cybersecurity Retail 360 View of the Customer Real-time promotions Law Enforcement Multimodal surveillance Cyber security detection Source = IBM
49 The combination of semantics and accessibility of data in the cloud is revolutionary. Across industries Across geography This revolution will once and for all require the elimination of paper and dictate the management of unstructured information assets.
50 #5: We need T-Shaped people to address this extreme information opportunity. AIIM.org/Certification
51 The emerging information professional The vast majority of organizations see the need to manage information as an enterprise resource rather than in separate "silos," departments or systems, but they don't know how to begin to address the challenge, as it is so large... Professional roles focused on information management will be different to that of established IT roles. An "information professional" will not be one type of role or skill set, but will in fact have a number of specializations. Deb Logan and Regina Casonata, Gartner
52 Information Professionals Who are these people? Risk/Liability Focus Value Focus IT Legal professional Records Manager Digital Archivist Business Process Owners Business Analyst Knowledge Manager Information/Data Scientist Governance Focus Social Focus Ent Information Manager Info/Data Stewards Ent Information Architect Information Curators Community Managers Most roles from Deb Logan and Regina Casonata, Gartner
54 We need T-Shaped Professionals BROAD DEEP AIIM.org/certification AIIM.org/training White paper here Free practice exam/assessment --
Industry Impact of Big Data in the Cloud: An IBM Perspective Inhi Cho Suh IBM Software Group, Information Management Vice President, Product Management and Strategy email: email@example.com twitter: @inhicho
CSC590: Selected Topics BIG DATA & DATA MINING Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait Agenda Introduction What is Big Data Why Big Data? Characteristics of Big Data Applications of Big Data Problems
Deploying Big Data to the Cloud: Roadmap for Success James Kobielus Chair, CSCC Big Data in the Cloud Working Group IBM Big Data Evangelist. IBM Data Magazine, Editor-in- Chief. IBM Senior Program Director,
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics
Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, firstname.lastname@example.org What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed
Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the
Survey Results Table of Contents Survey Results... 4 Big Data Company Strategy... 6 Big Data Business Drivers and Benefits Received... 8 Big Data Integration... 10 Big Data Implementation Challenges...
Statistical Challenges with Big Data in Management Science Arnab Kumar Laha Indian Institute of Management Ahmedabad Analytics vs Reporting Competitive Advantage Reporting Prescriptive Analytics (Decision
Penang egovernment Seminar 2014 A New Era Of Analytic Megat Anuar Idris Head, Project Delivery, Business Analytics & Big Data Agenda Overview of Big Data Case Studies on Big Data Big Data Technology Readiness
Beyond Watson: The Business Implications of Big Data Shankar Venkataraman IBM Program Director, STSM, Big Data August 10, 2011 The World is Changing and Becoming More INSTRUMENTED INTERCONNECTED INTELLIGENT
Business Analytics In a Big Data World Ted Malone Solutions Architect Data Platform and Cloud Microsoft Federal Information has gone from scarce to super-abundant. That brings huge new benefits. The Economist
WHAT IS BIG DATA? David Bechtold Agenda 1. Introduction 2. What is Big Data? 3. Big Data a perspective 4. Characteristic of Big Data Three Vs 5. A Fourth V..? 6. Examples 7. How did we get here?... A historical
Dr. Oliver Adamczak Big Data and Trusted Information CAS Single Point of Truth 7. Mai 2012 The Hype Big Data: The next frontier for innovation, competition and productivity McKinsey Global Institute 2012
Big Data / FDAAWARE Rafi Maslaton President, cresults the maker of Smart-QC/QA/QD & FDAAWARE 30-SEP-2015 1 Agenda BIG DATA What is Big Data? Characteristics of Big Data Where it is being used? FDAAWARE
BIG DATA - How big data transforms our world Kim Escherich Executive Innovation Architect, IBM Global Business Services 1 2 What happens? What is data? 340.282.366.920.938.463.463.374.607.431.768.211.456
Now, Next and the Future: IT, Big Data and other Implications for RIM Agenda for This Afternoon Now: What trends are creating implications within the profession? Next: Why is IT now concerned about RIM?
5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for
YOU VS THE SENSORS Six Requirements for Visualizing the Internet of Things Dan Potter Chief Marketing Officer, Datawatch Corporation About Datawatch NASDAQ: DWCH Pioneer in real-time visual data discovery
An analysis of Big Data ecosystem from an HCI perspective. Jay Sanghvi Rensselaer Polytechnic Institute For: Theory and Research in Technical Communication and HCI Rensselaer Polytechnic Institute Wednesday,
Big Data overview SICS Software week, Sept 23-25 Cloud and Big Data Day Livio Ventura Big Data European Industry Leader for Telco, Energy and Utilities and Digital Media Agenda some data on Data Big Data
The Big Deal about Big Data Mike Skinner, CPA CISA CITP HORNE LLP Mike Skinner, CPA CISA CITP Senior Manager, IT Assurance & Risk Services HORNE LLP Focus areas: IT security & risk assessment IT governance,
Big Data and the new trends for BI and Analytics Juha Teljo Business Intelligence and Predictive Solutions Executive IBM Europe 2012 IBM Corporation The Mega Trends Cloud Mobile Social Analytics 2014 International
Business Analytics and the Nexus of Information 2 The Impact of the Nexus of Forces 4 From the Gartner Files: Information and the Nexus of Forces: Delivering and Analyzing Data 6 About IBM Business Analytics
Auto-Classification for Document Archiving and Records Declaration Josemina Magdalen, Architect, IBM November 15, 2013 Agenda IBM / ECM/ Content Classification for Document Archiving and Records Management
What is big data? Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada 1 2011 IBM Corporation Agenda The world is changing What
BIG DATA FUNDAMENTALS Timeframe Minimum of 30 hours Use the concepts of volume, velocity, variety, veracity and value to define big data Learning outcomes Critically evaluate the need for big data management
DISCUSSION PAPER 1. Enterprise data revolution One of the key trends in the enterprise technology world at the moment - and one that has been steadily growing in influence and importance in the past few
How the oil and gas industry can gain value from Big Data? Arild Kristensen Nordic Sales Manager, Big Data Analytics email@example.com, tlf. +4790532591 April 25, 2013 2013 IBM Corporation Dilbert
End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,
Financial Services Grabbing Value from Big Data: The New Game Changer for Financial Services How financial services companies can harness the innovative power of big data 2 Grabbing Value from Big Data:
White Paper Analyzing Big Data: The Path to Competitive Advantage by Marcia Kaplan Contents Introduction....2 How Big is Big Data?................................................................................
Welcome back! We will have more fun. Databases & Business Intelligence Part 1 BUSA345 Lecture #8-1 Claire Hitosugi, PhD, MBA In the previous lecture We learned Define Open Source Software (OSS) and provide
Big Data Er Big Data bare en døgnflue? Lasse Bache-Mathiesen CTO BIM Norway Big Data What is all the fuss about? The effective use of Big Data has the potential to transform economies, delivering a new
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
Big Data + Predictive Analytics = Actionable Business Insights: Consider Big Data as the Most Important Thing for Business since the Internet Adapted from the forthcoming book, Business Innovation in the
IBM Software Top tips for securing big data environments Why big data doesn t have to mean big security challenges 2 Top Comprehensive tips for securing data big protection data environments for physical,
Impact of Big Data in Oil & Gas Industry Pranaya Sangvai Reliance Industries Limited 04 Feb 15, DEJ, Mumbai, India. New Age Information 2.92 billions Internet Users in 2014 Twitter processes 7 terabytes
Chapter 1 Understanding Big Data Analytics In This Chapter Defining Big Data Understanding Big Data Analytics Contrasting traditional and visual analytics approaches The era of Big Data is upon us. The
STATS-DC 2012 Data Conference July 12, 2012 Washington State s Use of the IBM Data Governance Unified Process Best Practices Bill Huennekens Washington State Office of Superintendent of Public Instruction,
Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize
Harnessing Big Data to Improve Customer Service By Marty Tibbitts The goal is to apply analytics methods that move beyond customer satisfaction to nurturing customer loyalty by more deeply understanding
Big Data Challenges and Success Factors Deloitte Analytics Your data, inside out Big Data refers to the set of problems and subsequent technologies developed to solve them that are hard or expensive to
BIG DATA & SOCIAL INNOVATION KENNETH THOMAS, CLIENT MANAGER 1 MAKING THE RIGHT DECISSION AT THE RIGHT PLACE AT THE RIGHT TIME 2 THE DATA MULTIPLIER EFFECT AT WORK BUSINESS DRIVEN HUMAN DRIVEN MACHINE DRIVEN
Real-Time Big Data Analytics + Internet of Things (IoT) = Value Creation January 2015 Market Insights Report Executive Summary According to a recent customer survey by Vitria, executives across the consumer,
Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data
Business Analytics Gaining the Advantage Clients Collective Intelligence is one of 100 partners Nationally Surfacing Previously Siloed Data Allow Users Direct Access to Data Streamline Business Practices
Predictive Analytics & Business Insights 2015, Chicago Mudit Mangal Project Lead, Data Analytics, Supply Chain Sears Holdings Corporation 06/11/2015 Agenda WHAT IS HAPPENING WHAT ARE BENEFITS AND CHALLENGES
Big Data & QlikView Democratizing Big Data Analytics David Freriks Principal Solution Architect TDWI Vancouver Agenda What really is Big Data? How do we separate hype from reality? How does that relate
QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM QlikView Technical Case Study Series Big Data June 2012 qlikview.com Introduction This QlikView technical case study focuses on the QlikView deployment
Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002
5 Big Data Use Cases to Understand Your Customer Journey CUSTOMER ANALYTICS EBOOK CUSTOMER JOURNEY Technology is radically transforming the customer journey. Today s customers are more empowered and connected
Achieving Business Value through Big Data Analytics Philip Russom TDWI Research Director for Data Management October 3, 2012 Sponsor 2 Speakers Philip Russom Research Director, Data Management, TDWI Brian
Reto Cavegn, IBM Softw are Group Schw eiz September 6, 2012 IBM Information Management Overview Tech Data Truck Day Information Management Information is at the center of a new wave of opportunity Information
Business Intelligence Trends For 2013 10 Trends The last few years the change in Business Intelligence seems to accelerate under the pressure of increased business demand and technology innovations. Here
Industry Perspective: Big Data and Big Data Analytics David Barnes Program Director Emerging Internet Technologies IBM Software Group What is Big Data? The Adjacent Possible Inexpensive disk + Increased
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data
Mohan Sawhney Robert R. McCormick Tribune Foundation Clinical Professor of Technology Kellogg School of Management firstname.lastname@example.org Transportation Center Business Advisory Committee Meeting
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class
IBM Software The MDM advantage: Creating insight from The MDM advantage: Creating insight from 1 2 3 4 5 6 Introduction The importance of understanding your How MDM enhances big data and vice Leveraging
The Lab and The Factory Architecting for Big Data Management April Reeve DAMA Wisconsin March 11 2014 1 A good speech should be like a woman's skirt: long enough to cover the subject and short enough to
The Convergence of IT Big Data & Marketing Regis McKenna 2014 Alliance of Chief Executives 1 2 Technology Marketing 3 Major Technologies Driving Marketing Mass Production & Mass Media Mainframe computer
The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah Cofounder & CTO, Cloudera, Inc. Twitter: @awadallah 1 2 Cloudera Snapshot Founded 2008, by former employees of Employees
The Cloud for Insights A Guide for Enterprise As the volume of data grows, businesses are using the power of the cloud to gather, analyze, and visualize data from internal and external sources to improve
NewPoint IT Consulting BIG DATA WHITE PAPER NewPoint Information Technology Consulting Content 1 Big Data: Challenges and Opportunities for Companies... 3 2 The Technical and Business Drivers of BIG DATA...
Big Data and Analytics in Government Nov 29, 2012 Mark Johnson Director, Engineered Systems Program 2 Agenda What Big Data Is Government Big Data Use Cases Building a Complete Information Solution Conclusion
WHITEPAPER OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT A top-tier global bank s end-of-day risk analysis jobs didn t complete in time for the next start of trading day. To solve
Turning Big Data into Big Decisions Delivering on the High Demand for Data Michael Ho, Vice President of Professional Services Digital Government Institute s Government Big Data Conference, October 31,
DATA STORAGE Martin Strohbach, AGT International (R&D) THE DATA VALUE CHAIN Value Chain Data Acquisition Data Analysis Data Curation Data Storage Data Usage Structured data Unstructured data Event processing
Unlocking The Value of the Deep Web Harvesting Big Data that Google Doesn t Reach Introduction Every day, untold millions search the web with Google, Bing and other search engines. The volumes truly are
ACS 2015 Annual Canberra Conference Are You Big Data Ready? Vladimir Videnovic Business Solutions Director Oracle Big Data and Analytics Introduction Introduction What is Big Data? If you can't explain
Big Analytics: A Next Generation Roadmap Cloud Developers Summit & Expo: October 1, 2014 Neil Fox, CTO: SoftServe, Inc. 2014 SoftServe, Inc. Remember Life Before The Web? 1994 Even Revolutions Take Time
Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights
IBM Software White Paper Petroleum Industry Tapping the power of big data for the oil and gas industry 2 Tapping the power of big data for the oil and gas industry The petroleum industry is no stranger
Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Housekeeping 1. Any questions coming out of today s presentation can be discussed in the bar this evening 2. OCF is
Integrating a Big Data Platform into Government: Drive Better Decisions for Policy and Program Outcomes John Haddad, Senior Director Product Marketing, Informatica Digital Government Institute s Government
Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require
Secure Data Transmission Solutions for the Management and Control of Big Data Get the security and governance capabilities you need to solve Big Data challenges with Axway and CA Technologies. EXECUTIVE