White Paper: Big Data and the hype around IoT
|
|
- Agatha Maxwell
- 8 years ago
- Views:
Transcription
1 1 White Paper: Big Data and the hype around IoT Author: Alton Harewood 21 Aug 2014 (first published on LinkedIn) If I knew today what I will know tomorrow, how would my life change? For some time the idea of big data has been running high in the media so when Gartner recently published the 2014 Hype Cycle and indicated Big Data has moved rapidly over the peak of the Hype Cycle into the "trough of disillusionment", it raised the eyebrows of many observers. Has Gartner got it wrong? Is there still more to come? Gartner suggests that "while interest in big data remains undiminished, it has moved beyond the peak because the market has settled into a reasonable set of approaches, and the new technologies and practices are additive to existing solutions." [Source: Gartner's Hype Cycle Special Report for 2014] So, all the hype is real, big data and in particular how businesses will use that data is as important and exciting as it was last year it s just that in 2014, there is more hype about the Internet of Things #IoT illustrating just how quickly attention is moving in technology compared to just four years ago. So, in this article we will talk about the hype around the IoT and also about where Big Data is, what to expect as it 'settles down' as a technology and how its power is being harnessed through exciting new technologies. #IoT If you have not heard of the Internet of Things don't be too concerned, conceptually you may have heard of it but not realized it for what it was. To illustrate, consider your lowly (or wonderful) refrigerator. Imagine now if it could make your life easier by reading the bar code of everything placed in it. Through a user interface - voice or screen driven, it could tell you if something has passed its best before date. If its tied to big data through the internet, it might be able to suggest other brands of products and even the local store with the best price or coupons for the product this week! How about it sending you an SMS to pick up more milk? And so on. Imagine this now from the business perspective, the value of the data in the context of hundreds of consumers, considering how to get that data (with permission) and leverage it as part of a bigger data pool, this then is where big data remains front and center event though IoT is riding the crest. Through Hadoop and other frameworks the distributed refrigerator network could become an incredibly powerful data source, if Joe public allows it to share.
2 2 The humble refrigerator could be one of many parts of the IOT that businesses need to interact with. How will they do so without big data? From a business perspective, once you get beyond the consumer benefits, the IoT is only as valuable as the data it is collecting, storing and subsequently presenting for analysis to the businesses providing the new capabilities be they smart fridges, personal monitoring devices tied to insurance, security systems and a plethora of other 'things' that could be hooked into the internet! Big Data So, Big Data is not off the table, it s just "settled down". How so? Well, in 2011 there was a great infographic [ ] that demonstrated the concepts of the big data challenge that showed that in that year alone an estimated 1.8 zettabytes of data would be collected. Are you trying to size that up? Think 57.5 BILLION 32GB ipads of data! This number is estimated to double annually. Size of the data problem is in itself a big problem. So too is understanding data relationships, structure of the data and understanding the content from different perspectives. A great example of this is a Tweet about a cat from one person may hashtag #cat or #Meow or #KittyKat etc., creating multiple elements for the same entity. Finally, architecture plays into the problem, should a database be duplicated, or the application, or both? Alongside this proliferation of data gathering the world has progressed from flat spreadsheet databases to the enormous data storage and growth of frameworks to manage these. These range from intuitive, macro enabling distributed Hadoop environments through to the dynamically and intelligently harnessed data interrogated by powerful AI engines like IBM s Watson. Data management and formats passed over time from flat text documents of the 90s and early 2000s, through iterations of similarly flat but more powerful hypertext, wikis and blogs, through the path of tagging-based social media that includes personalization of data (folksonomy), metadata (RDF) to the subsequent arising conceptual relationship knowledge management (ontologies classes & relationships) These latter changes though have happened rapidly from a technology advancement perspective so that in the space of perhaps 10 years huge steps forward have been achieved to build out ways to better manage data of enormous sizes. Twitter is an excellent example of the challenge of "folksonomy" in the handling of big data. The number of tools emerging to better manage Twitter feeds and isolate keywords or HASHTAGS, shows that while the tool itself provides a wonderful social interaction platform, much of its big data power requires significant effort to harness. This in turn suggests that there are still many iterations of social media advancement to come with Web 3.0.
3 3 The facts are that what was considered a panacea in the early 2000s, the relational database management system, RDBMS, which has at its heart SQL, has significant performance problems as the data complexity, and its use, expands. So, how is the power of big data being harnessed? Concepts such as NoSQL arose largely due to the problems inherent in managing big data. NoSQL is not suggesting that SQL is bad. NoSQL postulates that there are alternative and better ways to store data. Consider a typical SQL query on a large data set and you immediately start to get the idea of where this is coming from and where the concept would be going to. There has to be a way to interrogate larger sets of data, understand their relationships and repeat the task reliably and better than using SQL. The impact of Graph Databases You may have heard of key values, graph databases, big tables and document categories, or maybe just one of these. Each of these are emerging NoSQL categories. Key-Value stores focus on the position of an object defined by its key. Big Tables extend the idea of columns to column families and add rights & permissions (ACL) Document databases (categories) are similar to key-values but the database knows what the value is (classic example MongoDB) Graph Databases focus modeling the structure of the data. This is the most exciting part, the relationship, interconnectivity of the data. Inspired by Graph Theory the data model is a Property Graph that has Nodes, Relationships (edges) between Nodes, Key-Value pairs on both nodes and edges and sometimes edge labels or node/edge types. Neo4J is the classic example of graph database frameworks. We ll dwell on graph databases a little more as the roots help us understand how the concept can help practically. Graph database is based on graph theory which began in the18 th century with studies by Euler; this became the origin of topology and in fact the concept of network relationships. At its essence, graph theory deals with the relationships. Euler wanted to know if he could walk over each of seven bridges of Königsberg (then Prussia) once without crossing one of them a second time. He could prove this in practice as due to the odd number of bridge endpoints in each section of the town, it simply was not possible to cross every bridge once, the edges and points and their locations influenced the outcome. Euler went on to prove this mathematically. This concept is the basis of understanding relationships in complex patterns, such an underground map routes or street maps and in our case often distributed big data.
4 4 Neo4j is an example of a graph database where data is stored in nodes that are connected by relationships with properties. This structure is used to describe simple or complex relationships between data. Why Graphs? Well, if you draw a small relationship diagram on a whiteboard, in order to represent it in an RDBMS you would need to translate it to an entity-relationship (ER) diagram that extrapolates all possible relationships and then massage it (normalize) to fit the relational database. With a graph database the model on the whiteboard is implemented directly, this speed to deploy is a huge advantage when dealing with complex data. Each of the NoSQL concepts fits into the scaling problem as follows: Key-Value stores best for large data, low complexity Big tables slightly less data and slightly increased complexity Document databases usually less data but increased complexity Graph Databases less data but great complexity Examples of NoSQL? These include Facebook, Twitter, LinkedIn, Google, Amazon, Hadoop, MongoDB and more. Examples of enterprise big data management solutions Examples of taking the opportunity and driving big data storage further include Cloudera, Hortonworks and MapR Technologies. The nature of Hadoop though means that a lower number of companies are paying for the privilege against say existing users of Oracle. This is largely because the suite of applications riding the platform are not solving the big data analytics need that is poised to be the largest change in our current technology generation. Companies like Pivotal, for example, are trying to close that gap presenting with the Hadoop platform the ability to batch store and process data then leverage both a standalone or HDFS integrated SQL DB or In-memory standalone or HDFS integrated SQL DB to complete analysis on 100% of data (versus a typical EDW which in many cases is a fraction of the enterprise data often fractured around the company). There are of course many companies building a portfolio in this arena including the likes of IBM, Microsoft, Google and many merely trying to manage the cloud storage problem. Aligned to some of the suites solutions are tools that include the key growth opportunity of predictive analytics for big data.
5 5 This article kind of grew as I wrote but I think I hit a natural end point here. While you see IoT riding a crest of media attention, consider that now is indeed time to get to grips with your big data, to examine your options, many of them in the cloud and to ensure that you are fully prepared as it moves rapidly through the slope of enlightenment to practical and almost limitless usefulness!
Why NoSQL? Your database options in the new non- relational world. 2015 IBM Cloudant 1
Why NoSQL? Your database options in the new non- relational world 2015 IBM Cloudant 1 Table of Contents New types of apps are generating new types of data... 3 A brief history on NoSQL... 3 NoSQL s roots
More informationAnalytics March 2015 White paper. Why NoSQL? Your database options in the new non-relational world
Analytics March 2015 White paper Why NoSQL? Your database options in the new non-relational world 2 Why NoSQL? Contents 2 New types of apps are generating new types of data 2 A brief history of NoSQL 3
More informationBig Data Technologies Compared June 2014
Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development
More informationComposite Data Virtualization Composite Data Virtualization And NOSQL Data Stores
Composite Data Virtualization Composite Data Virtualization And NOSQL Data Stores Composite Software October 2010 TABLE OF CONTENTS INTRODUCTION... 3 BUSINESS AND IT DRIVERS... 4 NOSQL DATA STORES LANDSCAPE...
More informationINTRODUCTION TO CASSANDRA
INTRODUCTION TO CASSANDRA This ebook provides a high level overview of Cassandra and describes some of its key strengths and applications. WHAT IS CASSANDRA? Apache Cassandra is a high performance, open
More informationJAVASCRIPT CHARTING. Scaling for the Enterprise with Metric Insights. 2013 Copyright Metric insights, Inc.
JAVASCRIPT CHARTING Scaling for the Enterprise with Metric Insights 2013 Copyright Metric insights, Inc. A REVOLUTION IS HAPPENING... 3! Challenges... 3! Borrowing From The Enterprise BI Stack... 4! Visualization
More informationManagement Imperative
Social Channels: A Content Management Imperative How enterprise social content management provides a competitive edge for success Introduction There is no doubt that the Social Web is in an explosive growth
More informationUNIFY YOUR (BIG) DATA
UNIFY YOUR (BIG) DATA ANALYTIC STRATEGY GIVE ANY USER ANY ANALYTIC ON ANY DATA Scott Gnau President, Teradata Labs scott.gnau@teradata.com t Unify Your (Big) Data Analytic Strategy Technology excitement:
More informationBig Data: Are You Ready? Kevin Lancaster
Big Data: Are You Ready? Kevin Lancaster Director, Engineered Systems Oracle Europe, Middle East & Africa 1 A Data Explosion... Traditional Data Sources Billing engines Custom developed New, Non-Traditional
More informationBig Data and Data Science: Behind the Buzz Words
Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing
More informationX4-2 Exadata announced (well actually around Jan 1) OEM/Grid control 12c R4 just released
General announcements In-Memory is available next month http://www.oracle.com/us/corporate/events/dbim/index.html X4-2 Exadata announced (well actually around Jan 1) OEM/Grid control 12c R4 just released
More informationSo What s the Big Deal?
So What s the Big Deal? Presentation Agenda Introduction What is Big Data? So What is the Big Deal? Big Data Technologies Identifying Big Data Opportunities Conducting a Big Data Proof of Concept Big Data
More informationExecutive Summary... 2 Introduction... 3. Defining Big Data... 3. The Importance of Big Data... 4 Building a Big Data Platform...
Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure Requirements... 5 Solution Spectrum... 6 Oracle s Big Data
More informationArchitecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing
Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics
More informationINTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY
INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A REVIEW ON BIG DATA MANAGEMENT AND ITS SECURITY PRUTHVIKA S. KADU 1, DR. H. R.
More informationBig Data Analytics. Rasoul Karimi
Big Data Analytics Rasoul Karimi Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany Big Data Analytics Big Data Analytics 1 / 1 Introduction
More informationApache Hadoop Patterns of Use
Community Driven Apache Hadoop Apache Hadoop Patterns of Use April 2013 2013 Hortonworks Inc. http://www.hortonworks.com Big Data: Apache Hadoop Use Distilled There certainly is no shortage of hype when
More informationGigaSpaces Real-Time Analytics for Big Data
GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and
More informationNext-Generation Cloud Analytics with Amazon Redshift
Next-Generation Cloud Analytics with Amazon Redshift What s inside Introduction Why Amazon Redshift is Great for Analytics Cloud Data Warehousing Strategies for Relational Databases Analyzing Fast, Transactional
More informationChanging the Equation on Big Data Spending
White Paper Changing the Equation on Big Data Spending Big Data analytics can deliver new customer insights, provide competitive advantage, and drive business innovation. But complexity is holding back
More informationBig Data Zurich, November 23. September 2011
Institute of Technology Management Big Data Projektskizze «Competence Center Automotive Intelligence» Zurich, November 11th 23. September 2011 Felix Wortmann Assistant Professor Technology Management,
More informationHow To Handle Big Data With A Data Scientist
III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution
More informationNoSQL and Hadoop Technologies On Oracle Cloud
NoSQL and Hadoop Technologies On Oracle Cloud Vatika Sharma 1, Meenu Dave 2 1 M.Tech. Scholar, Department of CSE, Jagan Nath University, Jaipur, India 2 Assistant Professor, Department of CSE, Jagan Nath
More informationDATA MINING WITH HADOOP AND HIVE Introduction to Architecture
DATA MINING WITH HADOOP AND HIVE Introduction to Architecture Dr. Wlodek Zadrozny (Most slides come from Prof. Akella s class in 2014) 2015-2025. Reproduction or usage prohibited without permission of
More informationNoSQL and Agility. Why Document and Graph Stores Rock November 12th, 2015 COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED
NoSQL and Agility Why Document and Graph Stores Rock November 12th, 2015 COPYRIGHT 2015 MARKLOGIC CORPORATION. ALL RIGHTS RESERVED Description We have all heard about how NoSQL databases are being adopted
More informationIntroduction to Big Data the four V's
Chapter 1: Introduction to Big Data the four V's This chapter is mainly based on the Big Data script by Donald Kossmann and Nesime Tatbul (ETH Zürich) Big Data Management and Analytics 15 Goal of Today
More informationThe Inside Scoop on Hadoop
The Inside Scoop on Hadoop Orion Gebremedhin National Solutions Director BI & Big Data, Neudesic LLC. VTSP Microsoft Corp. Orion.Gebremedhin@Neudesic.COM B-orgebr@Microsoft.com @OrionGM The Inside Scoop
More informationWeb Data Mining: A Case Study. Abstract. Introduction
Web Data Mining: A Case Study Samia Jones Galveston College, Galveston, TX 77550 Omprakash K. Gupta Prairie View A&M, Prairie View, TX 77446 okgupta@pvamu.edu Abstract With an enormous amount of data stored
More informationTHE CLOUD DATA BRIEF. Big Data Transitions to the Cloud
THE CLOUD DATA BRIEF Big Data Transitions to the Cloud Most businesses strive to capture and analyze their data. But how and where does this happen? Solutions were once limited to databases deployed exclusively
More informationData Mining in the Swamp
WHITE PAPER Page 1 of 8 Data Mining in the Swamp Taming Unruly Data with Cloud Computing By John Brothers Business Intelligence is all about making better decisions from the data you have. However, all
More informationBig Data Buzzwords From A to Z. By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012
Big Data Buzzwords From A to Z By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012 Big Data Buzzwords Big data is one of the, well, biggest trends in IT today, and it has spawned a whole new generation
More informationAn Oracle White Paper June 2013. Oracle: Big Data for the Enterprise
An Oracle White Paper June 2013 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5 Infrastructure
More informationData processing goes big
Test report: Integration Big Data Edition Data processing goes big Dr. Götz Güttich Integration is a powerful set of tools to access, transform, move and synchronize data. With more than 450 connectors,
More informationForecast of Big Data Trends. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014
Forecast of Big Data Trends Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 3 September 2014 Big Data transforms Business 2 Data created every minute Source http://mashable.com/2012/06/22/data-created-every-minute/
More informationBig Data and the Cloud Trends, Applications, and Training
Big Data and the Cloud Trends, Applications, and Training Stavros Christodoulakis MUSIC/TUC Lab School of Electronic and Computer Engineering Technical University of Crete stavros@ced.tuc.gr Data Explosion
More informationOracle Big Data Strategy Simplified Infrastrcuture
Big Data Oracle Big Data Strategy Simplified Infrastrcuture Selim Burduroğlu Global Innovation Evangelist & Architect Education & Research Industry Business Unit Oracle Confidential Internal/Restricted/Highly
More informationTurn your information into a competitive advantage
INDLÆG 03 Data Driven Business Value Turn your information into a competitive advantage Jonas Linders 04.10.2015 (dato) CGI Group Inc. 2015 Jonas Linders Education Role Industries M.Sc Informatics Experience
More informationIntroduction to NoSQL Databases. Tore Risch Information Technology Uppsala University 2013-03-05
Introduction to NoSQL Databases Tore Risch Information Technology Uppsala University 2013-03-05 UDBL Tore Risch Uppsala University, Sweden Evolution of DBMS technology Distributed databases SQL 1960 1970
More informationBig Data Big Deal? Salford Systems www.salford-systems.com
Big Data Big Deal? Salford Systems www.salford-systems.com 2015 Copyright Salford Systems 2010-2015 Big Data Is The New In Thing Google trends as of September 24, 2015 Difficult to read trade press without
More informationBig Data and Hadoop for the Executive A Reference Guide
Big Data and Hadoop for the Executive A Reference Guide Overview The amount of information being collected by companies today is incredible. Wal- Mart has 460 terabytes of data, which, according to the
More information#TalendSandbox for Big Data
Evalua&on von Apache Hadoop mit der #TalendSandbox for Big Data Julien Clarysse @whatdoesdatado @talend 2015 Talend Inc. 1 Connecting the Data-Driven Enterprise 2 Talend Overview Founded in 2006 BRAND
More informationEnterprise Archietcure and Big Data. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 September 2015
Enterprise Archietcure and Big Data Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 September 2015 Internet of Things Cloud Computing Big Data 2 3 Data created every minute Source:
More informationBIG DATA MARKETING: THE NEXUS OF MARKETING, ANALYSTS, AND IT
BIG DATA MARKETING: THE NEXUS OF MARKETING, ANALYSTS, AND IT The term Big Data is definitely a leading contender for the marketing buzz-phrase of 2012. On November 11, 2011, a Google search on the phrase
More informationOracle Big Data Spatial & Graph Social Network Analysis - Case Study
Oracle Big Data Spatial & Graph Social Network Analysis - Case Study Mark Rittman, CTO, Rittman Mead OTN EMEA Tour, May 2016 info@rittmanmead.com www.rittmanmead.com @rittmanmead About the Speaker Mark
More informationHow To Use Big Data For Telco (For A Telco)
ON-LINE VIDEO ANALYTICS EMBRACING BIG DATA David Vanderfeesten, Bell Labs Belgium ANNO 2012 YOUR DATA IS MONEY BIG MONEY! Your click stream, your activity stream, your electricity consumption, your call
More informationInfiniteGraph: The Distributed Graph Database
A Performance and Distributed Performance Benchmark of InfiniteGraph and a Leading Open Source Graph Database Using Synthetic Data Objectivity, Inc. 640 West California Ave. Suite 240 Sunnyvale, CA 94086
More informationBig Table in Plain Language
Big Table in Plain Language Some people remember exactly where they were when JFK was shot. Other people remember exactly where they were when Neil Armstrong stepped on the moon. I remember exactly where
More informationThe 3 questions to ask yourself about BIG DATA
The 3 questions to ask yourself about BIG DATA Do you have a big data problem? Companies looking to tackle big data problems are embarking on a journey that is full of hype, buzz, confusion, and misinformation.
More informationwww.objectivity.com Choosing The Right Big Data Tools For The Job A Polyglot Approach
www.objectivity.com Choosing The Right Big Data Tools For The Job A Polyglot Approach Nic Caine NoSQL Matters, April 2013 Overview The Problem Current Big Data Analytics Relationship Analytics Leveraging
More informationTap into Hadoop and Other No SQL Sources
Tap into Hadoop and Other No SQL Sources Presented by: Trishla Maru What is Big Data really? The Three Vs of Big Data According to Gartner Volume Volume Orders of magnitude bigger than conventional data
More informationESS event: Big Data in Official Statistics. Antonino Virgillito, Istat
ESS event: Big Data in Official Statistics Antonino Virgillito, Istat v erbi v is 1 About me Head of Unit Web and BI Technologies, IT Directorate of Istat Project manager and technical coordinator of Web
More informationA Study on Big-Data Approach to Data Analytics
A Study on Big-Data Approach to Data Analytics Ishwinder Kaur Sandhu #1, Richa Chabbra 2 1 M.Tech Student, Department of Computer Science and Technology, NCU University, Gurgaon, Haryana, India 2 Assistant
More informationA Tour of the Zoo the Hadoop Ecosystem Prafulla Wani
A Tour of the Zoo the Hadoop Ecosystem Prafulla Wani Technical Architect - Big Data Syntel Agenda Welcome to the Zoo! Evolution Timeline Traditional BI/DW Architecture Where Hadoop Fits In 2 Welcome to
More informationReal-Time Data Access Using Restful Framework for Multi-Platform Data Warehouse Environment
www.wipro.com Real-Time Data Access Using Restful Framework for Multi-Platform Data Warehouse Environment Pon Prabakaran Shanmugam, Principal Consultant, Wipro Analytics practice Table of Contents 03...Abstract
More informationNoSQL a view from the top
Red Stack Tech Ltd James Anthony Technology Director NoSQL a view from the top Part 1 1 Contents Introduction...Page 3 Key Value Stores..... Page 4 Column Family Data Stores.. Page 6 Document Data Stores...Page
More informationSOCIAL MEDIA ADVERTISING STRATEGIES THAT WORK
SOCIAL MEDIA ADVERTISING STRATEGIES THAT WORK ABSTRACT» Social media advertising is a new and fast growing part of digital advertising. In this White Paper I'll present social media advertising trends,
More informationINDEX. Introduction Page 3. Methodology Page 4. Findings. Conclusion. Page 5. Page 10
FINDINGS 1 INDEX 1 2 3 4 Introduction Page 3 Methodology Page 4 Findings Page 5 Conclusion Page 10 INTRODUCTION Our 2016 Data Scientist report is a follow up to last year s effort. Our aim was to survey
More informationThe Five Biggest MISSED Internet Marketing Opportunities Most Lawyers Don't Know About
The Five Biggest MISSED Internet Marketing Opportunities Most Lawyers Don't Know About Many lawyers and other professionals equate internet marketing with Search Engine Optimization (SEO). And while SEO
More informationPreparing Your Data For Cloud
Preparing Your Data For Cloud Narinder Kumar Inphina Technologies 1 Agenda Relational DBMS's : Pros & Cons Non-Relational DBMS's : Pros & Cons Types of Non-Relational DBMS's Current Market State Applicability
More informationTooling is starting to tame Hadoop
Tooling is starting to tame Hadoop Reference Code: IT015 001716 Publication Date: 21 Jun 2012 Author: Tony Baer THIS IS A CHAPTER EXTRACT FROM PUBLISHED OVUM RESEARCH. THE FULL REPORT IS AVAILABLE ON THE
More informationTRANSFORM BIG DATA INTO ACTIONABLE INFORMATION
TRANSFORM BIG DATA INTO ACTIONABLE INFORMATION Make Big Available for Everyone Syed Rasheed Solution Marketing Manager January 29 th, 2014 Agenda Demystifying Big Challenges Getting Bigger Red Hat Big
More informationBig Data and Industrial Internet
Big Data and Industrial Internet Keijo Heljanko Department of Computer Science and Helsinki Institute for Information Technology HIIT School of Science, Aalto University keijo.heljanko@aalto.fi 16.6-2015
More informationBetter Decision Making
Better Decision Making Big Data Analytics Webinar, November 2013 Dr. Wolfgang Martin Analyst and Member of the Boulder BI Brain Trust Better Decision Making Process Oriented Businesses. Decision Making:
More informationAsking Hard Graph Questions. Paul Burkhardt. February 3, 2014
Beyond Watson: Predictive Analytics and Big Data U.S. National Security Agency Research Directorate - R6 Technical Report February 3, 2014 300 years before Watson there was Euler! The first (Jeopardy!)
More informationEvolving Data Warehouse Architectures
Evolving Data Warehouse Architectures In the Age of Big Data Philip Russom April 15, 2014 TDWI would like to thank the following companies for sponsoring the 2014 TDWI Best Practices research report: Evolving
More informationTOP 8 TRENDS FOR 2016 BIG DATA
The year 2015 was an important one in the world of big data. What used to be hype became the norm as more businesses realized that data, in all forms and sizes, is critical to making the best possible
More informationBig Data Management. Big Data Management. (BDM) Autumn 2013. Povl Koch September 16, 2013 15-09-2013 1
Big Data Management Big Data Management (BDM) Autumn 2013 Povl Koch September 16, 2013 15-09-2013 1 Overview Today s program 1. Little more practical details about this course 2. Chapter 7 in NoSQL Distilled
More informationGRAPH DATABASE SYSTEMS. h_da Prof. Dr. Uta Störl Big Data Technologies: Graph Database Systems - SoSe 2016 1
GRAPH DATABASE SYSTEMS h_da Prof. Dr. Uta Störl Big Data Technologies: Graph Database Systems - SoSe 2016 1 Use Case: Route Finding Source: Neo Technology, Inc. h_da Prof. Dr. Uta Störl Big Data Technologies:
More informationAN INTRO TO DATA MANAGEMENT
AN INTRO TO DATA MANAGEMENT HOW TO USE DATA TO SUCCEED AT YOUR JOB by: TABLE OF CONTENTS Chapter 1: The Rise of Global Data Chapter 2: Taking Advantage of Big Data Chapter 3: Data Projects from Start to
More informationBIG DATA IN BUSINESS ENVIRONMENT
Scientific Bulletin Economic Sciences, Volume 14/ Issue 1 BIG DATA IN BUSINESS ENVIRONMENT Logica BANICA 1, Alina HAGIU 2 1 Faculty of Economics, University of Pitesti, Romania olga.banica@upit.ro 2 Faculty
More informationOpen source large scale distributed data management with Google s MapReduce and Bigtable
Open source large scale distributed data management with Google s MapReduce and Bigtable Ioannis Konstantinou Email: ikons@cslab.ece.ntua.gr Web: http://www.cslab.ntua.gr/~ikons Computing Systems Laboratory
More informationManaging Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
More informationOracle Big Data Handbook
ORACLG Oracle Press Oracle Big Data Handbook Tom Plunkett Brian Macdonald Bruce Nelson Helen Sun Khader Mohiuddin Debra L. Harding David Segleau Gokula Mishra Mark F. Hornick Robert Stackowiak Keith Laker
More informationStep by Step: Big Data Technology. Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015
Step by Step: Big Data Technology Assoc. Prof. Dr. Thanachart Numnonda Executive Director IMC Institute 25 August 2015 Data Sources IT Infrastructure Analytics 2 B y 2015, 20% of Global 1000 organizations
More informationCOULD VS. SHOULD: BALANCING BIG DATA AND ANALYTICS TECHNOLOGY WITH PRACTICAL OUTCOMES
COULD VS. SHOULD: BALANCING BIG DATA AND ANALYTICS TECHNOLOGY The business world is abuzz with the potential of data. In fact, most businesses have so much data that it is difficult for them to process
More informationAn Oracle White Paper October 2011. Oracle: Big Data for the Enterprise
An Oracle White Paper October 2011 Oracle: Big Data for the Enterprise Executive Summary... 2 Introduction... 3 Defining Big Data... 3 The Importance of Big Data... 4 Building a Big Data Platform... 5
More informationthe Internet of Things
The Bloor Group A Database Platform for the Internet of Things ParStream Walks the Walk Robin Bloor, Ph.D. & Rebecca Jozwiak WHITE PAPER The Once and Future Internet of Things A Database Platform for the
More informationWith the Emergence of Big Data, Where do Relational Technologies Fit?
With the Emergence of Big Data, Where do Relational Technologies Fit? Donna Burbank VP Product Marketing CA Technologies DAMA Chicago June 2013 Who am I? More than more than 15 years of experience in the
More informationBuilding Big with Big Data Now companies are in the middle of a renovation that forces them to be analytics-driven to continue being competitive.
Unlocking Big Data Building Big with Big Data Now companies are in the middle of a renovation that forces them to be analytics-driven to continue being competitive. Data analysis provides a complete insight
More informationStudy concluded that success rate for penetration from outside threats higher in corporate data centers
Auditing in the cloud Ownership of data Historically, with the company Company responsible to secure data Firewall, infrastructure hardening, database security Auditing Performed on site by inspecting
More informationQuantitative Displays for Combining Time-Series and Part-to-Whole Relationships
Quantitative Displays for Combining Time-Series and Part-to-Whole Relationships Stephen Few, Perceptual Edge Visual Business Intelligence Newsletter January, February, and March 211 Graphical displays
More informationNoSQL for SQL Professionals William McKnight
NoSQL for SQL Professionals William McKnight Session Code BD03 About your Speaker, William McKnight President, McKnight Consulting Group Frequent keynote speaker and trainer internationally Consulted to
More informationOracle Big Data SQL Technical Update
Oracle Big Data SQL Technical Update Jean-Pierre Dijcks Oracle Redwood City, CA, USA Keywords: Big Data, Hadoop, NoSQL Databases, Relational Databases, SQL, Security, Performance Introduction This technical
More informationNoSQL Data Base Basics
NoSQL Data Base Basics Course Notes in Transparency Format Cloud Computing MIRI (CLC-MIRI) UPC Master in Innovation & Research in Informatics Spring- 2013 Jordi Torres, UPC - BSC www.jorditorres.eu HDFS
More informationThree Reasons Why Visual Data Discovery Falls Short
Three Reasons Why Visual Data Discovery Falls Short Vijay Anand, Director, Product Marketing Agenda Introduction to Self-Service Analytics and Concepts MicroStrategy Self-Service Analytics Product Offerings
More informationCloud Scale Distributed Data Storage. Jürmo Mehine
Cloud Scale Distributed Data Storage Jürmo Mehine 2014 Outline Background Relational model Database scaling Keys, values and aggregates The NoSQL landscape Non-relational data models Key-value Document-oriented
More informationApplications for Big Data Analytics
Smarter Healthcare Applications for Big Data Analytics Multi-channel sales Finance Log Analysis Homeland Security Traffic Control Telecom Search Quality Manufacturing Trading Analytics Fraud and Risk Retail:
More informationBig Data and Analytics: Challenges and Opportunities
Big Data and Analytics: Challenges and Opportunities Dr. Amin Beheshti Lecturer and Senior Research Associate University of New South Wales, Australia (Service Oriented Computing Group, CSE) Talk: Sharif
More informationW H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract
W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the
More informationTapping Into Hadoop and NoSQL Data Sources with MicroStrategy. Presented by: Jeffrey Zhang and Trishla Maru
Tapping Into Hadoop and NoSQL Data Sources with MicroStrategy Presented by: Jeffrey Zhang and Trishla Maru Agenda Big Data Overview All About Hadoop What is Hadoop? How does MicroStrategy connects to Hadoop?
More informationThe Next Wave of Data Management. Is Big Data The New Normal?
The Next Wave of Data Management Is Big Data The New Normal? Table of Contents Introduction 3 Separating Reality and Hype 3 Why Are Firms Making IT Investments In Big Data? 4 Trends In Data Management
More informationOPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT
WHITEPAPER OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT A top-tier global bank s end-of-day risk analysis jobs didn t complete in time for the next start of trading day. To solve
More informationTake Online Lead Generation to the Next Level
Take Online Lead Generation to the Next Level 5 Ways to Capture New Market Niches By: Deven Pravin Shah WSI Internet Marketing Consultant Overview Many business owners ask the same questions about capturing
More informationG-Cloud Big Data Suite Powered by Pivotal. December 2014. G-Cloud. service definitions
G-Cloud Big Data Suite Powered by Pivotal December 2014 G-Cloud service definitions TABLE OF CONTENTS Service Overview... 3 Business Need... 6 Our Approach... 7 Service Management... 7 Vendor Accreditations/Awards...
More informationAdvanced Big Data Analytics with R and Hadoop
REVOLUTION ANALYTICS WHITE PAPER Advanced Big Data Analytics with R and Hadoop 'Big Data' Analytics as a Competitive Advantage Big Analytics delivers competitive advantage in two ways compared to the traditional
More informationBuilding Dashboards for Real Business Results. Cindi Howson BIScorecard December 11, 2012
Building Dashboards for Real Business Results Cindi Howson BIScorecard December 11, 2012 Sponsor 2 Speakers Cindi Howson Founder, BIScorecard Mark Gamble Director of Technical Marketing, Actuate Cindi
More informationNOSQL, BIG DATA AND GRAPHS. Technology Choices for Today s Mission- Critical Applications
NOSQL, BIG DATA AND GRAPHS Technology Choices for Today s Mission- Critical Applications 2 NOSQL, BIG DATA AND GRAPHS NOSQL, BIG DATA AND GRAPHS TECHNOLOGY CHOICES FOR TODAY S MISSION- CRITICAL APPLICATIONS
More informationTalend Big Data. Delivering instant value from all your data. Talend 2014 1
Talend Big Data Delivering instant value from all your data Talend 2014 1 I may say that this is the greatest factor: the way in which the expedition is equipped. Roald Amundsen race to the south pole,
More informationThe Principles of the Business Data Lake
The Principles of the Business Data Lake The Business Data Lake Culture eats Strategy for Breakfast, so said Peter Drucker, elegantly making the point that the hardest thing to change in any organization
More information