Chapter 1. Contrasting traditional and visual analytics approaches
|
|
- Neil Baldwin
- 8 years ago
- Views:
Transcription
1 Chapter 1 Understanding Big Data Analytics In This Chapter Defining Big Data Understanding Big Data Analytics Contrasting traditional and visual analytics approaches The era of Big Data is upon us. The race is on to extract insight and value from this abundant resource. The opportunities are enormous and so are the challenges. Organizations that master the emerging discipline of Big Data Analytics can reap significant rewards and separate themselves from their competitors; those that fail to do so will be left in the dust. Big Data is here to stay. And you re part of it! In this chapter, I define Big Data and Big Data Analytics and explore the challenges of harvesting value from an evergrowing sea of digital information. What Is Big Data? COPYRIGHTED MATERIAL Big Data is a term applied to data sets so large that common software tools aren t capable of capturing, managing, and processing their data within a tolerable period. Big Data is colossal, unstructured (or loosely structured), distributed, fluid, and often unconnected. The amount of Big Data varies by organization, but its volume (and variety) tends to increase astonishingly quickly and exponentially.
2 4 Big Data Analytics For Dummies, Centrifuge Special Edition In the following sections, I give you some basic background on Big Data: exactly how big it is, where it comes from, how to evaluate it, and how to use it. Putting the Big in Big Data Analysts estimate that approximately 300 million terabytes (TB) of data exist in the world today. But what s staggering is that 90 percent of this data was created in the last two years! In a recent study titled The Digital Decade Are You Ready? market research company IDC projected that by 2020 the digital universe will encompass a staggering 35 zettabytes (ZB). Step aside, petabytes and exabytes! The word is now zettabytes! And with 1ZB being equivalent to 1 billion terabytes, that s a whole lot of data. To put this into perspective, from its founding in April 1800 to April 2011, the U.S. Library of Congress had amassed about 235TB of data. Currently, it s adding about 5TB of new data each month. So if IDC is correct, by 2020, computers will collectively store 400 million times more data than is archived in the entire Library of Congress today! Seeing where the data comes from You may wonder where all this data comes from. It comes from almost everywhere. Enterprises and government agencies aggregate data from myriad private and/or public data sources. Private data is information that your organization specifically collects that is available only to your organization, such as employee data, customer data, and machine data (such as user transactions, customer behavior, computer system health, and cybersecurity threats). Commercial-specific examples include credit-card, pharmacy, and mortgage transactions. Government-specific examples include Social Security data, Medicare transactions, and passport paperwork. Public data is information that s generally available to the public for a fee or at no charge. Examples include stock prices, company and individual credit ratings, social media content (such as Facebook and Twitter), and computer IP
3 Chapter 1: Understanding Big Data Analytics 5 blacklists (such as known hacking sites) along with all other content found on the public Internet. When you stop and think about it, it s no wonder the world is drowning in data. If an organization can record something, it usually does environmental data, financial data, medical data, surveillance data, and on and on. Figuring out what to do with the data The most significant challenges of Big Data no longer involve aggregation and storage but rather what to do with all the accumulated data. Today, common concerns for commercial enterprises and government agencies include the following: Deriving actionable value from Big Data, due to information overload. Analyzing the connections between structured, semistructured, and unstructured data sets. Structured data is stored in relational databases in columns and rows. Semistructured data doesn t conform to the formal structure of tables and rows but contains tags or other markers to separate semantic elements and enforce hierarchies of records and fields. Examples include web pages and XML (extensible markup language). Unstructured data refers to information that doesn t have a predefined data model and thus can t be stored in a relational database. Unstructured data can be textual or nontextual. Examples of textual unstructured data include messages, PowerPoint presentations, and Word documents. Examples of nontextual unstructured data include JPEG images, MP3 audio files, and Flash video files. According to the market-research firm IDC, semistructured and unstructured data accounts for more than 90 percent of the data in today s organizations. Uncovering patterns of useful data when you don t know what questions to ask in the first place. As you discover throughout this book, a Big Data Analytics solution can help your organization meet all these challenges.
4 6 Big Data Analytics For Dummies, Centrifuge Special Edition Popular Big Data infrastructure solutions The following is a list of popular Big Data infrastructure solutions that you re likely to encounter when using Big Data Analytics applications. Apache Hadoop is an opensource software framework that supports data-intensive distributed applications working with thousands of computers and petabytes of data. Cloudera offers Apache Hadoopbased software and services that make it easier to run Hadoop in a production environment. EMC Greenplum is a commercial data warehouse based on the open-source database PostgreSQL and intended for large-scale enterprise and cloud deployments. HP Vertica is a commercial database software platform that uses a column-oriented analytic database to process large amounts of data for quick analysis. IBM Netezza is a commercial data-warehouse solution based on proprietary technology, scaling to more than 10 petabytes (PB) of data. NetApp specializes in enterpriseclass data-warehouse solutions and is a thought leader in Big Data. NetApp s highest-end platform can accommodate up to 4PB of raw data. Oracle is one of the most successful enterprise database warehouse providers today, with all of the Fortune 100 as customers. Oracle offers a line of Big Data Appliances that can accommodate up to 648TB of raw storage in a single rack and up to 5PB within an eight-rack cluster. Splunk is a software application that enables users to search, monitor, and analyze machinegenerated data by applications, systems, and IT infrastructure via a web-based interface. Sybase, an SAP company, is an enterprise software and services company offering software to manage, analyze, and mobilize information using relational databases, analytics, and data warehousing solutions and mobile applications development platforms. Teradata offers commercial relational database management system (RDBMS) hardware and software. The company launched the Petabyte Power Players club to include customers with petabyte-plus data warehouses, including Dell (1PB), Bank of America (1.5PB), Wal-Mart Stores (2.5PB), and ebay (5PB).
5 Chapter 1: Understanding Big Data Analytics 7 Evaluating Big Data for analysis: The Four Vs Diamonds are evaluated on what are commonly known as the Four Cs: color, cut, clarity, and carat weight. Similarly, Big Data is commonly evaluated on the Four Vs: Volume describes the relative size of data typically, in terabytes or petabytes. Velocity describes the frequency at which data is generated, captured, and shared. Variety describes the types of data in a data set, such as transactional, social, content, geospatial, location-based, log, and radio-frequency identification (RFID). Value describes the business benefits reaped by the organization, such as fraud detection, loan risk analysis, and customer-behavioral analytics. All four of these Big Data characteristics are important to consider when you re evaluating solutions for Big Data Analytics which I introduce next. See Chapter 2 for a lot more information about the Four Vs. What Is Big Data Analytics? Big Data Analytics is the process whether manual or automated of analyzing Big Data to extract meaning and actionable intelligence. Put another way, it makes Big Data useful. Only a short time ago, companies used to spend considerable time and resources to identify and procure useful data. Today, most companies have the opposite problem. Aggregating useful data is relatively easy; analyzing that data is the challenge. In the following sections, I explore two approaches to Big Data Analytics: the traditional approach and the visual analytics approach.
6 8 Big Data Analytics For Dummies, Centrifuge Special Edition Traditional analytics approach You may be surprised that many organizations still employ data analysts who use manual techniques to extract useful information from large data warehouses. Such techniques typically include ad hoc database queries followed by a series of univariate (analysis of single-variable distributions), bivariate, and, more often, multivariate analyses. These analysts often have advanced degrees in mathematics and/or statistics and pride themselves on their ability to perform advanced regression analyses. They often view data in columns and rows and then periodically create charts and graphs manually, using spreadsheets or basic business intelligence reporting tools (see Figure 1-1). Figure 1-1: Manual data analysis. Even with automation, this type of analytical approach is limited in its ability to detect unknown or undiscovered patterns (link analysis). Assumptions are often hard-coded, leading to false outcomes. It s like trying to find a needle in a haystack! Ultimately, the results are too little and too late.
7 Chapter 1: Understanding Big Data Analytics 9 Visual analytics approach Today s data analysts take an entirely different approach. They prefer to work smarter not harder to uncover hidden meanings in Big Data, leveraging visual analytics tools to integrate, visualize, and collaborate with data in ways that old-school data analysts have never seen. Visual analytics applications extract value from Big Data through advanced analytics and interactive visualization. Advanced analytics, such as link analysis, enable the integration of complex information in simple visualizations for pattern discovery (for example, seeing the forest through the trees). Interactive visualization refers to the ability to do it yourself through prebuilt charts, graphs, and timelines that tell the complete story. You ve often heard that a picture is worth a thousand words. Would you rather try to extract useful information from the table of data shown in Figure 1-1 or through interactive visualizations displayed in Figure 1-2? Figure 1-2: Data analysis with visual analytics software. For centuries, visualization has been used to support the understanding of complex information. Better understanding of relationships and context is key to visual analytics.
8 10 Big Data Analytics For Dummies, Centrifuge Special Edition Visual analytics software can improve time-to-discovery by more than 50 percent and make data analysts 10 to 20 times more productive than analysts who use traditional manual methods. Organizations typically recoup their investments in visual analytics tools in a matter of months. They also find it easier to fill data-analyst positions because advanced degrees in mathematics and statistics are no longer required. Analysts who leverage visual analytics applications instantly become data scientists because they now have the ability to test new hypotheses and experiment with data in ways never before possible. Visual representation of the data sharpens focus on what s important (so you can see clearly). If you re excited by the prospects of visual analytics, read on. Chapter 2 describes how to get started.
Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing
Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics
More informationHow Big Is Big Data Adoption? Survey Results. Survey Results... 4. Big Data Company Strategy... 6
Survey Results Table of Contents Survey Results... 4 Big Data Company Strategy... 6 Big Data Business Drivers and Benefits Received... 8 Big Data Integration... 10 Big Data Implementation Challenges...
More informationHP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica
HP Vertica at MIT Sloan Sports Analytics Conference March 1, 2013 Will Cairns, Senior Data Scientist, HP Vertica So What s the market s definition of Big Data? Datasets whose volume, velocity, variety
More informationSurfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics
Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,
More informationBig Data Buzzwords From A to Z. By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012
Big Data Buzzwords From A to Z By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012 Big Data Buzzwords Big data is one of the, well, biggest trends in IT today, and it has spawned a whole new generation
More informationMike Maxey. Senior Director Product Marketing Greenplum A Division of EMC. Copyright 2011 EMC Corporation. All rights reserved.
Mike Maxey Senior Director Product Marketing Greenplum A Division of EMC 1 Greenplum Becomes the Foundation of EMC s Big Data Analytics (July 2010) E M C A C Q U I R E S G R E E N P L U M For three years,
More informationBig Data Analytics FOR. by Steve Piper
Big Data Analytics FOR DUMmIES CENTRIFUGE SPECIAL EDITION by Steve Piper Big Data Analytics For Dummies, Centrifuge Special Edition Published by John Wiley & Sons, Inc. 111 River St. Hoboken, NJ 07030-5774
More informationData Refinery with Big Data Aspects
International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data
More informationBig Data. Fast Forward. Putting data to productive use
Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize
More informationVIEWPOINT. High Performance Analytics. Industry Context and Trends
VIEWPOINT High Performance Analytics Industry Context and Trends In the digital age of social media and connected devices, enterprises have a plethora of data that they can mine, to discover hidden correlations
More informationOutline. What is Big data and where they come from? How we deal with Big data?
What is Big Data Outline What is Big data and where they come from? How we deal with Big data? Big Data Everywhere! As a human, we generate a lot of data during our everyday activity. When you buy something,
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationIl mondo dei DB Cambia : Tecnologie e opportunita`
Il mondo dei DB Cambia : Tecnologie e opportunita` Giorgio Raico Pre-Sales Consultant Hewlett-Packard Italiana 2011 Hewlett-Packard Development Company, L.P. The information contained herein is subject
More informationRaul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada
What is big data? Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada 1 2011 IBM Corporation Agenda The world is changing What
More informationBig Analytics: A Next Generation Roadmap
Big Analytics: A Next Generation Roadmap Cloud Developers Summit & Expo: October 1, 2014 Neil Fox, CTO: SoftServe, Inc. 2014 SoftServe, Inc. Remember Life Before The Web? 1994 Even Revolutions Take Time
More informationAre You Ready for Big Data?
Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?
More informationWhite Paper: Datameer s User-Focused Big Data Solutions
CTOlabs.com White Paper: Datameer s User-Focused Big Data Solutions May 2012 A White Paper providing context and guidance you can use Inside: Overview of the Big Data Framework Datameer s Approach Consideration
More informationData Doesn t Communicate Itself Using Visualization to Tell Better Stories
SAP Brief Analytics SAP Lumira Objectives Data Doesn t Communicate Itself Using Visualization to Tell Better Stories Tap into your data big and small Tap into your data big and small In today s fast-paced
More informationBig + Fast + Safe + Simple = Lowest Technical Risk
Big + Fast + Safe + Simple = Lowest Technical Risk The Synergy of Greenplum and Isilon Architecture in HP Environments Steffen Thuemmel (Isilon) Andreas Scherbaum (Greenplum) 1 Our problem 2 What is Big
More informationDemystifying Big Data Government Agencies & The Big Data Phenomenon
Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed
More informationDanny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank
Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»
More informationwww.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage
www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage If every image made and every word written from the earliest stirring of civilization
More informationAGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW
AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this
More informationHow To Create A Data Science System
Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002
More informationGetting Started Practical Input For Your Roadmap
Getting Started Practical Input For Your Roadmap Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson
More informationKeywords Big Data; OODBMS; RDBMS; hadoop; EDM; learning analytics, data abundance.
Volume 4, Issue 11, November 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Analytics
More informationWhat happens when Big Data and Master Data come together?
What happens when Big Data and Master Data come together? Jeremy Pritchard Master Data Management fgdd 1 What is Master Data? Master data is data that is shared by multiple computer systems. The Information
More informationBusiness Intelligence / Big Data Consulting Service
Business Intelligence / Big Data Consulting Service DATASHEET Business Problem Enterprises and IT businesses have been accumulating an enormous amount of data for years (according to IDC data is growing
More informationNavigating the Four Vs of Big Data: Shrinking the Haystack for Actionable Insights
Navigating the Four Vs of Big Data: Shrinking the Haystack for Actionable Insights An ISS open source project Table of Contents 1. Introduction and Overview 2. Optimizing the Three Vs of Big Data a. Volume
More information5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014
5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for
More informationUsing Tableau Software with Hortonworks Data Platform
Using Tableau Software with Hortonworks Data Platform September 2013 2013 Hortonworks Inc. http:// Modern businesses need to manage vast amounts of data, and in many cases they have accumulated this data
More informationA New Era Of Analytic
Penang egovernment Seminar 2014 A New Era Of Analytic Megat Anuar Idris Head, Project Delivery, Business Analytics & Big Data Agenda Overview of Big Data Case Studies on Big Data Big Data Technology Readiness
More informationIndustry Impact of Big Data in the Cloud: An IBM Perspective
Industry Impact of Big Data in the Cloud: An IBM Perspective Inhi Cho Suh IBM Software Group, Information Management Vice President, Product Management and Strategy email: inhicho@us.ibm.com twitter: @inhicho
More informationHow the oil and gas industry can gain value from Big Data?
How the oil and gas industry can gain value from Big Data? Arild Kristensen Nordic Sales Manager, Big Data Analytics arild.kristensen@no.ibm.com, tlf. +4790532591 April 25, 2013 2013 IBM Corporation Dilbert
More informationAdvanced Fraud Detection & Prevention Through Big Data
Advanced Fraud Detection & Prevention Through Big Data Mark Johnson Director, Engineered Systems, Oracle Public Sector 1 Copyright 2011, Oracle and/or its affiliates. All rights reserved. The following
More informationINTELLIGENT BUSINESS STRATEGIES WHITE PAPER
INTELLIGENT BUSINESS STRATEGIES WHITE PAPER Improving Access to Data for Successful Business Intelligence Part 2: Supporting Multiple Analytical Workloads in a Changing Analytical Landscape By Mike Ferguson
More informationManaging Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database
Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica
More informationBig Data. Lyle Ungar, University of Pennsylvania
Big Data Big data will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus. McKinsey Data Scientist: The Sexiest Job of the 21st Century -
More informationThe New Normal: Get Ready for the Era of Extreme Information Management. John Mancini President, AIIM @jmancini77 DigitalLandfill.
The New Normal: Get Ready for the Era of Extreme Information Management John Mancini President, AIIM @jmancini77 DigitalLandfill.org Giving Credit Where Credit is Due I didn t make up the term Extreme
More information22 SMARTENTERPRISEMAG.COM
22 SMARTENTERPRISEMAG.COM Smart Strategies BIG DATA, Big Innovation Smart CIOs are mining their organizations huge data stores for insights that lead to business innovation. By Tom Farre ILLUSTRATION:
More informationREDEFINING ANALYTICS WWW.EMCIEN.COM. This White Paper does the following: Examines current and emerging technologies.
WHITE PAPER 2015 Emcien REDEFINING ANALYTICS This White Paper does the following: Examines current and emerging technologies. Proposes that rather than search through data, organizations need the ability
More informationHow To Handle Big Data With A Data Scientist
III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution
More informationBIG DATA APPLIANCES. July 23, TDWI. R Sathyanarayana. Enterprise Information Management & Analytics Practice EMC Consulting
BIG DATA APPLIANCES July 23, TDWI R Sathyanarayana Enterprise Information Management & Analytics Practice EMC Consulting 1 Big data are datasets that grow so large that they become awkward to work with
More informationAnalytics in the Cloud. Peter Sirota, GM Elastic MapReduce
Analytics in the Cloud Peter Sirota, GM Elastic MapReduce Data-Driven Decision Making Data is the new raw material for any business on par with capital, people, and labor. What is Big Data? Terabytes of
More informationCustomized Report- Big Data
GINeVRA Digital Research Hub Customized Report- Big Data 1 2014. All Rights Reserved. Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 2 2014. All Rights Reserved.
More informationDoing Multidisciplinary Research in Data Science
Doing Multidisciplinary Research in Data Science Assoc.Prof. Abzetdin ADAMOV CeDAWI - Center for Data Analytics and Web Insights Qafqaz University aadamov@qu.edu.az http://ce.qu.edu.az/~aadamov 16 May
More informationBIG DATA CHALLENGES AND PERSPECTIVES
BIG DATA CHALLENGES AND PERSPECTIVES Meenakshi Sharma 1, Keshav Kishore 2 1 Student of Master of Technology, 2 Head of Department, Department of Computer Science and Engineering, A P Goyal Shimla University,
More informationExploiting Data at Rest and Data in Motion with a Big Data Platform
Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, sarah_brader@uk.ibm.com What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags
More informationSELLING PROJECTS ON THE MICROSOFT BUSINESS ANALYTICS PLATFORM
David Chappell SELLING PROJECTS ON THE MICROSOFT BUSINESS ANALYTICS PLATFORM A PERSPECTIVE FOR SYSTEMS INTEGRATORS Sponsored by Microsoft Corporation Copyright 2014 Chappell & Associates Contents Business
More informationHadoop Market - Global Industry Analysis, Size, Share, Growth, Trends, and Forecast, 2012 2018
Transparency Market Research Hadoop Market - Global Industry Analysis, Size, Share, Growth, Trends, and Forecast, 2012 2018 Buy Now Request Sample Published Date: July 2013 Single User License: US $ 4595
More informationBig Data and the new trends for BI and Analytics Juha Teljo Business Intelligence and Predictive Solutions Executive IBM Europe
Big Data and the new trends for BI and Analytics Juha Teljo Business Intelligence and Predictive Solutions Executive IBM Europe 2012 IBM Corporation The Mega Trends Cloud Mobile Social Analytics 2014 International
More informationAnnex: Concept Note. Big Data for Policy, Development and Official Statistics New York, 22 February 2013
Annex: Concept Note Friday Seminar on Emerging Issues Big Data for Policy, Development and Official Statistics New York, 22 February 2013 How is Big Data different from just very large databases? 1 Traditionally,
More informationlocuz.com Big Data Services
locuz.com Big Data Services Big Data At Locuz, we help the enterprise move from being a data-limited to a data-driven one, thereby enabling smarter, faster decisions that result in better business outcome.
More informationBig Data The next big thing
Big Data The next big thing India to capitalize on the growing Big Data market opportunity 1 Global Big Data market opportunity is estimated to grow at 45% annually to reach ~USD 25 billion by 2015, from
More informationADVANCED ANALYTICS AND FRAUD DETECTION THE RIGHT TECHNOLOGY FOR NOW AND THE FUTURE
ADVANCED ANALYTICS AND FRAUD DETECTION THE RIGHT TECHNOLOGY FOR NOW AND THE FUTURE Big Data Big Data What tax agencies are or will be seeing! Big Data Large and increased data volumes New and emerging
More informationDISCOVERING AND SECURING SENSITIVE DATA IN HADOOP DATA STORES
DATAGUISE WHITE PAPER SECURING HADOOP: DISCOVERING AND SECURING SENSITIVE DATA IN HADOOP DATA STORES OVERVIEW: The rapid expansion of corporate data being transferred or collected and stored in Hadoop
More informationMajed Al-Ghandour, PhD, PE, CPM Division of Planning and Programming NCDOT 2016 NCAMPO Conference- Greensboro, NC May 12, 2016
Big Data! Majed Al-Ghandour, PhD, PE, CPM Division of Planning and Programming NCDOT 2016 NCAMPO Conference- Greensboro, NC May 12, 2016 Big Data: Data Analytical Tools for Decision Support 2 Outline Introduce
More informationBig Data and Its Impact on the Data Warehousing Architecture
Big Data and Its Impact on the Data Warehousing Architecture Sponsored by SAP Speaker: Wayne Eckerson, Director of Research, TechTarget Wayne Eckerson: Hi my name is Wayne Eckerson, I am Director of Research
More informationIn-Memory Analytics for Big Data
In-Memory Analytics for Big Data Game-changing technology for faster, better insights WHITE PAPER SAS White Paper Table of Contents Introduction: A New Breed of Analytics... 1 SAS In-Memory Overview...
More informationBig Data a threat or a chance?
Big Data a threat or a chance? Helwig Hauser University of Bergen, Dept. of Informatics Big Data What is Big Data? well, lots of data, right? we come back to this in a moment. certainly, a buzz-word but
More informationBig Data Technologies Compared June 2014
Big Data Technologies Compared June 2014 Agenda What is Big Data Big Data Technology Comparison Summary Other Big Data Technologies Questions 2 What is Big Data by Example The SKA Telescope is a new development
More informationANALYTICS BUILT FOR INTERNET OF THINGS
ANALYTICS BUILT FOR INTERNET OF THINGS Big Data Reporting is Out, Actionable Insights are In In recent years, it has become clear that data in itself has little relevance, it is the analysis of it that
More informationEVERYTHING THAT MATTERS IN ADVANCED ANALYTICS
EVERYTHING THAT MATTERS IN ADVANCED ANALYTICS Marcia Kaufman, Principal Analyst, Hurwitz & Associates Dan Kirsch, Senior Analyst, Hurwitz & Associates Steve Stover, Sr. Director, Product Management, Predixion
More informationUNIFY YOUR (BIG) DATA
UNIFY YOUR (BIG) DATA ANALYTIC STRATEGY GIVE ANY USER ANY ANALYTIC ON ANY DATA Scott Gnau President, Teradata Labs scott.gnau@teradata.com t Unify Your (Big) Data Analytic Strategy Technology excitement:
More informationBig Data and Apache Hadoop Adoption:
Expert Reference Series of White Papers Big Data and Apache Hadoop Adoption: Key Challenges and Rewards 1-800-COURSES www.globalknowledge.com Big Data and Apache Hadoop Adoption: Key Challenges and Rewards
More informationBig Data Big Deal? Salford Systems www.salford-systems.com
Big Data Big Deal? Salford Systems www.salford-systems.com 2015 Copyright Salford Systems 2010-2015 Big Data Is The New In Thing Google trends as of September 24, 2015 Difficult to read trade press without
More informationAdvanced In-Database Analytics
Advanced In-Database Analytics Tallinn, Sept. 25th, 2012 Mikko-Pekka Bertling, BDM Greenplum EMEA 1 That sounds complicated? 2 Who can tell me how best to solve this 3 What are the main mathematical functions??
More informationLaurence Liew General Manager, APAC. Economics Is Driving Big Data Analytics to the Cloud
Laurence Liew General Manager, APAC Economics Is Driving Big Data Analytics to the Cloud Big Data 101 The Analytics Stack Economics of Big Data Convergence of the 3 forces Big Data Analytics in the Cloud
More informationBeyond Watson: The Business Implications of Big Data
Beyond Watson: The Business Implications of Big Data Shankar Venkataraman IBM Program Director, STSM, Big Data August 10, 2011 The World is Changing and Becoming More INSTRUMENTED INTERCONNECTED INTELLIGENT
More informationTUT NoSQL Seminar (Oracle) Big Data
Timo Raitalaakso +358 40 848 0148 rafu@solita.fi TUT NoSQL Seminar (Oracle) Big Data 11.12.2012 Timo Raitalaakso MSc 2000 Work: Solita since 2001 Senior Database Specialist Oracle ACE 2012 Blog: http://rafudb.blogspot.com
More informationINTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY
INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON BIG DATA ISSUES AMRINDER KAUR Assistant Professor, Department of Computer
More informationHadoop for Enterprises:
Hadoop for Enterprises: Overcoming the Major Challenges Introduction to Big Data Big Data are information assets that are high volume, velocity, and variety. Big Data demands cost-effective, innovative
More informationISSN:2321-1156 International Journal of Innovative Research in Technology & Science(IJIRTS)
Nguyễn Thị Thúy Hoài, College of technology _ Danang University Abstract The threading development of IT has been bringing more challenges for administrators to collect, store and analyze massive amounts
More informationDell Information Management solutions
Dell Information Management solutions Uday Tekumalla Solutions Marketing, Information Management 1 10/28/2013 Information Management Solutions My introduction Uday Tekumalla, the ponytail guy Information
More informationWe are Big Data A Sonian Whitepaper
EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed
More informationBig Data. White Paper. Big Data Executive Overview WP-BD-10312014-01. Jafar Shunnar & Dan Raver. Page 1 Last Updated 11-10-2014
White Paper Big Data Executive Overview WP-BD-10312014-01 By Jafar Shunnar & Dan Raver Page 1 Last Updated 11-10-2014 Table of Contents Section 01 Big Data Facts Page 3-4 Section 02 What is Big Data? Page
More informationBig Data and Healthcare Payers WHITE PAPER
Knowledgent White Paper Series Big Data and Healthcare Payers WHITE PAPER Summary With the implementation of the Affordable Care Act, the transition to a more member-centric relationship model, and other
More informationINVESTOR PRESENTATION. First Quarter 2014
INVESTOR PRESENTATION First Quarter 2014 Note to Investors Certain non-gaap financial information regarding operating results may be discussed during this presentation. Reconciliations of the differences
More informationIntroduction to Big Data the four V's
Chapter 1: Introduction to Big Data the four V's This chapter is mainly based on the Big Data script by Donald Kossmann and Nesime Tatbul (ETH Zürich) Big Data Management and Analytics 15 Goal of Today
More informationBIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES
BIG DATA ANALYTICS REFERENCE ARCHITECTURES AND CASE STUDIES Relational vs. Non-Relational Architecture Relational Non-Relational Rational Predictable Traditional Agile Flexible Modern 2 Agenda Big Data
More informationBig Data and Data Science: Behind the Buzz Words
Big Data and Data Science: Behind the Buzz Words Peggy Brinkmann, FCAS, MAAA Actuary Milliman, Inc. April 1, 2014 Contents Big data: from hype to value Deconstructing data science Managing big data Analyzing
More informationUnlocking The Value of the Deep Web. Harvesting Big Data that Google Doesn t Reach
Unlocking The Value of the Deep Web Harvesting Big Data that Google Doesn t Reach Introduction Every day, untold millions search the web with Google, Bing and other search engines. The volumes truly are
More informationBIRT in the World of Big Data
BIRT in the World of Big Data David Rosenbacher VP Sales Engineering Actuate Corporation 2013 Actuate Customer Days Today s Agenda and Goals Introduction to Big Data Compare with Regular Data Common Approaches
More informationInternational Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop
ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com
More informationWelcome to the webinar Does your department or company use the valuable data it collects to plan for future needs and trends?
Welcome to the webinar Does your department or company use the valuable data it collects to plan for future needs and trends? Host: Janet Barker Presenter: Nick Pope Getting more strategic with data Does
More informationBanking On A Customer-Centric Approach To Data
Banking On A Customer-Centric Approach To Data Putting Content into Context to Enhance Customer Lifetime Value No matter which company they interact with, consumers today have far greater expectations
More informationBig Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014
Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014 Defining Big Not Just Massive Data Big data refers to data sets whose size is beyond the ability of typical database software tools
More informationBig Data. Donald Kossmann & Nesime Tatbul Systems Group ETH Zurich
Big Data Donald Kossmann & Nesime Tatbul Systems Group ETH Zurich Goal of Today What is Big Data? introduce all major buzz words What is not Big Data? get a feeling for opportunities & limitations Answering
More informationHow To Understand The Benefits Of Big Data
Findings from the research collaboration of IBM Institute for Business Value and Saïd Business School, University of Oxford Analytics: The real-world use of big data How innovative enterprises extract
More informationIBM: An Early Leader across the Big Data Security Analytics Continuum Date: June 2013 Author: Jon Oltsik, Senior Principal Analyst
ESG Brief IBM: An Early Leader across the Big Data Security Analytics Continuum Date: June 2013 Author: Jon Oltsik, Senior Principal Analyst Abstract: Many enterprise organizations claim that they already
More informationWhy is Internal Audit so Hard?
Why is Internal Audit so Hard? 2 2014 Why is Internal Audit so Hard? 3 2014 Why is Internal Audit so Hard? Waste Abuse Fraud 4 2014 Waves of Change 1 st Wave Personal Computers Electronic Spreadsheets
More informationIBM BigInsights for Apache Hadoop
IBM BigInsights for Apache Hadoop Efficiently manage and mine big data for valuable insights Highlights: Enterprise-ready Apache Hadoop based platform for data processing, warehousing and analytics Advanced
More informationBig Data and Advanced Analytics Applications and Capabilities Steven Hagan, Vice President, Server Technologies
Big Data and Advanced Analytics Applications and Capabilities Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights Big Data, Advanced Analytics:
More informationBig Data and Market Surveillance. April 28, 2014
Big Data and Market Surveillance April 28, 2014 Copyright 2014 Scila AB. All rights reserved. Scila AB reserves the right to make changes to the information contained herein without prior notice. No part
More informationHadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time?
Hadoop and Data Warehouse Friends, Enemies or Profiteers? What about Real Time? Kai Wähner kwaehner@tibco.com @KaiWaehner www.kai-waehner.de Disclaimer! These opinions are my own and do not necessarily
More informationReaping the Rewards of Big Data
Reaping the Rewards of Big Data TABLE OF CONTENTS INTRODUCTION: 2 TABLE OF CONTENTS FINDING #1: BIG DATA PLATFORMS ARE ESSENTIAL FOR A MAJORITY OF ORGANIZATIONS TO MANAGE FUTURE BIG DATA CHALLENGES. 4
More informationThe Big Picture on Big Data. Princeton Section 307 Dinner Meeting December 11, 2013 Richard Herczeg
The Big Picture on Big Data Princeton Section 307 Dinner Meeting December 11, 2013 Richard Herczeg Objective of Talk 1. Deliver a Primer on Big Data. 2. How does this emerging topic apply to Quality? 3.
More informationБиблиотека БГУИР BIG DATA IN BANKING. Constantine DZIK. Dzmitry BALTUNOU. MOHAMMED Utech LLC location Madison, MS USA
BIG DATA IN BANKING Constantine DZIK Utech LLC location Madison, MS USA Utech LLC location Madison, MS USA Farooq MOHAMMED Utech LLC location Madison, MS USA 144 Dzmitry BALTUNOU Utech LLC location Madison,
More informationChapter 6. Foundations of Business Intelligence: Databases and Information Management
Chapter 6 Foundations of Business Intelligence: Databases and Information Management VIDEO CASES Case 1a: City of Dubuque Uses Cloud Computing and Sensors to Build a Smarter, Sustainable City Case 1b:
More information