The New Normal: Get Ready for the Era of Extreme Information Management. John Mancini President, DigitalLandfill.

Transcription

1 The New Normal: Get Ready for the Era of Extreme Information Management John Mancini President, DigitalLandfill.org

2 Giving Credit Where Credit is Due I didn t make up the term Extreme Information Management I first heard it used by Gartner. But I like it a lot.

3 Big Data is not just more data. --Thornton May

4

5

6

7 The Chessboard Fable

8 We are reaching the 2 nd half of Moore s Chessboard, dramatically changing what information means to our organizations and how it must be managed.

9 aiim.org/futurehistory

10 Systems of Engagement Era Mainframe Mini PC Internet Social and Cloud Systems of Record Years Typical thing managed A batch trans A dept process A document A web page An interaction Best known company IBM Digital Equipment Microsoft Google Facebook Content mgmt focus Microfilm Image Mgmt Document Mgmt Content Mgmt Social Business Systems

11 Consideration Systems of Record Systems of Engagement Focus Transactions Interactions Governance Command & Control Collaboration Core Elements Facts & Commitments Ideas & Nuances Value Single Source of Truth Discovery & Dialog Standard Accurate & Complete Immediate & Accessible Content Authored Communal Primary Record Type Documents Conversations Searchability Easy Hard Usability User is trained User knows Accessibility Regulated & Contained Ad Hoc & Open Retention Permanent Transient Policy Focus Security (Protect Assets) Privacy (Protect Users)

12 Systems of Engagement For the past decade, companies have been accumulating data in what we call a system of record. Those who survive going forward will also have systems of engagement -- start with evaluating how you can have a relevant conversation with each individual customer across all channels. And insuring you have the analytical capability and the data to support that analysis. That is where the linkage is between the system of record data to system of engagement. On the technology side, we believe the future of handling this volume lies in leveraging the capability of the cloud. Yuchon Lee, Vice President, IBM

13 Our 5-Point Manifesto 1. Commit to the cloud. 2. Mobilize everything. 3. Make the business social. 4. Digitize anything that moves. 5. Prepare for information management on a massive scale.

14 According to IDC Between now and X growth in information 75X growth in information containers BUT 1.4X growth in IT professionals

15 The dramatic changes in the consumer space provide a hint as to what is coming

16 Source =

17 Source =

18 Source =

19 Source =

20 Source =

21 Source =

22 Source =

23 Prepare for extreme information management.

24 We are moving from the Systems of Record era in which our focus was on high-value information assets to the Systems of Engagement era in which volume and complexity and velocity are increasingly dramatically.

25 HIGH DENSITY Systems of Record Value of Information per Unit to Organization Structured Information i.e., data 1 Managed via traditional BI and Data Warehousing Original concept Freeform Dynamics

26 HIGH Value/Byte Systems of Record Value of Information per Unit to Organization Structured Information i.e., data 1 Managed via traditional BI and Data Warehousing 2 Unstructured Information i.e., content Currently unmanaged Managed in ECM & ERM systems Original concept Freeform Dynamics

27 Structured Information i.e., data HIGH Value/Byte Systems of Record 1 Managed via traditional BI and Data Warehousing Value of Information per Unit to Organization 3 LOW Value/Byte Systems of Engagement BIG DATA Internet of things e.g., climate data, transaction records, phone GPS data intelligent, interconnected, and everywhere Unstructured Information i.e., content 2 Currently unmanaged Managed in ECM & ERM systems 4 Volume, Velocity, Variety, Complexity 2.5 quintillion bytes/day BIG CONTENT Social, images, audio, video, text, office apps, web traffic, print streams, , documents Original concept Freeform Dynamics

28 Considered overall, to what degree does your organization exploit its information assets for analysis and decision making purposes? 0% 20% 40% 60% 80% 100% Structured data Unstructured data 5 Fully Poorly Unsure Source: Online survey of Register readers, 122 respondents, first half of November 2011, Freeform Dynamics

29 The New Normal Volume: Enterprises are awash with ever-growing data of all types, easily amassing terabytes even petabytes of information. Turn 12 terabytes of Tweets created daily into improved product sentiment analysis Convert 350 billion meter readings per annum to better predict power consumption Velocity: Sometimes 2 minutes is too late. For time-sensitive processes such as catching fraud, big data must be used as it streams into your enterprise in order to maximize its value. Scrutinize 5 million trade events per day to identify potential fraud Analyze 500 million call detail records per day in real-time to predict customer churn faster Variety: Big data is any type of data - structured and unstructured data such as text, sensor data, audio, video, click streams, log files and more. New insights are found when analyzing these data types together. Use 100 s of live video feeds from surveillance cameras to monitor points of interest Take advantage of the 80% data growth in images, video and documents to improve customer satisfaction Source = IBM

30 The New Normal The vast majority of the world s information is unstructured. Unstructured information growing 15X faster than structured. Raw computing power growing so fast that an off-the-shelf box approaching the computing power of a super computer 5 years ago. Democratization of information access. Source = Understanding Big Data: Analytics for Enterprise Class Hadoop and Streamng Data

31 Irrational thinking Get rid of as much as you can: Litigation risk Compliance risk Storage cost Save everything that you can: Might need it someday Potential aggregated value Disposition uncertainty High Value/Byte Low Value/Byte

32 Welcome to the Era of Extreme Information

33 5 Things to Remember About Extreme Information AIIM.org/research

34 #1: Most organizations do not have the basics in place.

35 61% report content chaos re unstructured information. 80% have no extended search across multiple repositories. For 70%, harder to find your own stuff than stuff on the web.

36 #2: No one except the industry cares about structured vs. unstructured. 61% would find it very useful to link structured and unstructured datasets.

37 #3: Manual records management is dead.

38 66% have an information management strategy, but only 22 percent use it. 79% have an information retention policy, but only 32 percent enforce it. 58% say that a single enterprise records management model underlying all content systems is their goal, yet only 9% have achieved this. Source: AIIM, Process Revolution: Moving Your Business from Paper to PC to Tablet

39 #4: The future is in metadata.

40 The solution to the over abundance of information is more information. David Weinberger Data that is semantic means exactly the same thing to any system or person who uses it. David Siegel

41 The New Normal The standardization of data sets across industries, the separation of data from its description, and the exposure of this information in the cloud create enormous opportunities. We can now analyze problems that were previously undigestible do to the sheer scale of computing power required to address them. The cloud, HADOOP, and MapReduce driving division of vast data into small pieces and parsing computing across large numbers of computers. We can now solve the metadata problem (i.e., there is none!) for vast landfills of unstructured information We can now use semantic technology to apply metadata where it didn t previously exist.

42 For example

43 Individual Paper records Copied and aggregated paper Manual compliance and reading rooms A Short History of Financial Reporting Individual Computerized records Aggregated computerized records Spot audits and online viewing via EDGAR Separation of data from viewing XBRL standards values, tags, dictionaries Internal process standardization Industry and regulatory standardization Adoption as GAAP Mandated by 110 countries Source = Pull: The Power of the Semantic Web Standardized data moves to the cloud Automated compliance and availability Big data analytic opportunities

44 Mining social streams for predictions about the next hit nextbigsound.com

45 Mining social streams for the best food Dishtip.com

46 Mining social streams for drug info Treato.com

47 Using text analytics to motivate voters

48 Big Data Process Applications Financial Services Fraud detection 360 View of the Customer Transportation Logistics optimization Traffic congestion Health & Life Sciences Epidemic early warning ICU monitoring Telecommunications Geomapping / marketing Network monitoring Utilities Weather analysis Smart grid management Intelligence System Log Analysis Cybersecurity Retail 360 View of the Customer Real-time promotions Law Enforcement Multimodal surveillance Cyber security detection Source = IBM

49 The combination of semantics and accessibility of data in the cloud is revolutionary. Across industries Across geography This revolution will once and for all require the elimination of paper and dictate the management of unstructured information assets.

50 #5: We need T-Shaped people to address this extreme information opportunity. AIIM.org/Certification

51 The emerging information professional The vast majority of organizations see the need to manage information as an enterprise resource rather than in separate "silos," departments or systems, but they don't know how to begin to address the challenge, as it is so large... Professional roles focused on information management will be different to that of established IT roles. An "information professional" will not be one type of role or skill set, but will in fact have a number of specializations. Deb Logan and Regina Casonata, Gartner

52 Information Professionals Who are these people? Risk/Liability Focus Value Focus IT Legal professional Records Manager Digital Archivist Business Process Owners Business Analyst Knowledge Manager Information/Data Scientist Governance Focus Social Focus Ent Information Manager Info/Data Stewards Ent Information Architect Information Curators Community Managers Most roles from Deb Logan and Regina Casonata, Gartner

53

54 We need T-Shaped Professionals BROAD DEEP AIIM.org/certification AIIM.org/training White paper here Free practice exam/assessment --