EXECUTIVE REPORT. Big Data and the 3 V s: Volume, Variety and Velocity

Size: px
Start display at page:

Download "EXECUTIVE REPORT. Big Data and the 3 V s: Volume, Variety and Velocity"

Transcription

1 EXECUTIVE REPORT Big Data and the 3 V s: Volume, Variety and Velocity

2 The three V s are the defining properties of big data. It is critical to understand what these elements mean. The main point of the V-based characterization of big data is to highlight its most serious challenges: the capturing, cleaning, curating, integrating, storing, processing, indexing, searching, sharing, transferring, mining, analyzing, and visualizing of large volumes of fast-moving, highly complex data. The good news is that there are many big data solutions to help out, including the MapR M7 Enterprise Database Edition for Hadoop, which received the highest ranking among big data deployments, according to a recent Forrester report 1. The first V stands for volume. Volume describes the absolute magnitude of the data being analyzed. Terabyte is becoming a relatively small amount, as petabyte becomes the metric being used to quantify data sets in industries across the board. It is easy to revel in the astronomical numbers around data in this new world, a world measured in zettabytes 1,180,591,620,717,411,303,424 bytes. Large numbers like these and the amount of processing power needed to digest this amount of information make it easy to capture the attention of early adopters. The second V stands for variety. Variety in big data refers to the differing types of data. This is where the discussion turns to Social Media. Buried in the monotony of social data, nuggets of advertising gold may be found. The problem with this is the digging process. The information advertisers and B2C businesses want, is buried in mountains of non-structured data. The information one can mine from social media is unlike traditional structured information and as a result, does not fit well into a standard database, where you can run tried and true analytical tools. The information is found in the metadata of photos and videos. It is found in statuses about forgotten anniversaries and in the well-meant birthday wishes of individuals. Footnotes: 1 The Forrester WaveTM: Big Data Hadoop Solutions, Q1 2014, February Copyright (c) 2014, Forrester Research, Inc. 2

3 Even if you limit your data tracking to only text-based information, what one gets is varied. For example, if one wants to track what people think of orange on Twitter, it s not as simple as just tracking the word orange. There s orange the fruit, the color, the French tech company, the city in California, the county in California and that is just the first page of results from a Google search. Variety includes structured, database ready information and unstructured data, including different forms of media and seemingly simple, text-based information that may require context to be analyzed properly. The final V is Velocity. Velocity is the sheer speed of data. Statistics such as every minute, users watch over 138,000 hours of video on YouTube. Every minute, 27,778 new blog posts go live on Tumblr. Every minute, 100,000 Tweets are shared. Every minute, 208,000 pictures are posted on Facebook. Sometimes, these authors will glaze over more industrial statistics that are equally amazing, such as every flight a Virgin Atlantic Boeing 787 takes collects 500 gigs of data. This data is analyzed in real time, allowing preparations for repairs to occur before the plane ever lands at its destination. The speed of incoming data is imperative and the life and usefulness of this data is short. To take advantage of it, the data must be analyzed in real time, requiring a huge amount of computing power. These aspects of big data would cause almost any adopter to pause. However, to continue in the quest towards knowing what big data is and the different ways one can use it, one must wrap ones head around Hadoop. The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using simple programming models. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-availability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-available service on top of a cluster of computers, each of which may be prone to failures

4 Hadoop is an open-source software licensed by the Apache Software Foundation. Part of the features of the software is to provide for scalability within big data applications. Traditional architectures have grids that are for storage only, compute only, and report only. This segregated system makes big data applications inflexible. Data collection has gotten to the point where the volume, velocity and the variety of incoming data has increased the complexity of processing dramatically. Users with traditional architectures are finding their systems cannot finish processing today s load of data before tomorrow s load starts flowing in. With a traditional architecture, it is not possible to add a new server into the architecture and have it help process the query that has been slowing the system down; the computation would have to start over. It is not possible to add new data to the set and continue the computation where you left it; the computation would have to start over. Hadoop solves the dilemma by grouping servers together and then having them act as one clustered system. Within that capability, Hadoop allows for the addition of new data into an ongoing query and it allows for scaling of the physical infrastructure without interrupting current processing. Another key benefit to Hadoop is the systematic process of replication that has been designed into the operation. Each data set is broken up into blocks and then those blocks are replicated on 3 different nodes (servers) in the cluster. That means if any one block goes down, it has 2 backups of replication data. Replicated Data Being analyzed and stored Raw Data There are also some weaknesses with Hadoop such that ultimately, the solutions being implemented are a hybrid architecture, to blend the traditional approaches around structured and lasting historical data, and the evolving approaches for bursting and unstructured data that need extremely fast processing and analyzing. 4

5 An important component to big data, which sometimes goes unnoticed, is the physical data center facility, which is vital to the success of big data architectures. The data center is the backbone for big data applications. For some small companies there are cloud options available. However, for many companies the security of the cloud becomes an issue. As a result, many companies need to manage their own data and their own server clusters. The information big data solutions are trying to collect, crunch and store can be extremely private in nature. The health care industry, for example, has many regulations dealing with the collection and use of data, including the Health Insurance Portability and Accountability Act (HIPAA) which establishes procedures for the exercise of individual health information privacy rights. For some companies, the sheer size of their data makes using cloud based solutions uneconomical. Companies looking to experiment with clusters start with around 100 servers (around 3-4 racks). Adoption leaders have much bigger clusters; Yahoo for example, was reported by Information Week to have 42,000 servers (around 1,400 racks) in their clusters. The space required to store a cluster like that is massive and can start to double in size very rapidly as the data expands. Keeping the clusters cool, powered and accessible to the internet is no easy feat. For many companies, the different aspects of managing a data center are outside of their core competencies. That is why more and more enterprise companies are choosing to outsource their data center needs, by using colocation providers. Big data provides businesses a level of business intelligence that can set them apart from their competition and give them valuable insights into their market. Despite this fact, Gartner research estimates that 85% of Fortune 500 companies will be unable to exploit big data for competitive advantage. 3 5

6 About With over two dozen data centers across the globe, helps many of the world s largest global businesses including 9 of the global Fortune 20 companies and over 140 of the Fortune 1000 and companies of all sizes take advantage of the latest data center technology and realize top operational efficiencies through: Flexible, Scalable Solutions Receive flexible data center solutions that readily scale to match the needs of your growing business. Proven, Innovative Technology Benefit from the latest data center innovations expert technicians can put to work for your IT environment. Exceptional Service Enjoy personalized, consultative service through all stages of the relationship - design, build, installation, management, and reporting. National IX Offers low-cost metro connectivity and city-to-city transport in an ever growing number of cities across the US. About the Author Scott Brueggeman oversees the management of s global marketing, product development, inside sales, and corporate communications including branding, demand creation, and public relations. His 20 years of marketing and sales experience includes Fortune 50 firms, as well as smaller high-growth companies. Prior to, he spent several years with running marketing at a data center hosting and managed services company, as well as Chief Marketing Officer at PEAK6 Investments, an international financial services firm. Prior to that he was VP Marketing for CareerBuilder, and also held leadership positions at AT&T and PepsiCo. Brueggeman serves on several advisory boards. 6

EXECUTIVE REPORT. The Data Center Build-or-Buy Decision: 6 Key Factors You Should Consider

EXECUTIVE REPORT. The Data Center Build-or-Buy Decision: 6 Key Factors You Should Consider EXECUTIVE REPORT The Data Center Build-or-Buy Decision: 6 Key Factors You Should Consider Executive Summary Even through challenging economic times, the need for physical data center capacity continues

More information

CASE STUDY. Nirvanix, Inc. Finds a Secure and Reliable Data Center and a Strategic Partner for Cloud Services at CyrusOne

CASE STUDY. Nirvanix, Inc. Finds a Secure and Reliable Data Center and a Strategic Partner for Cloud Services at CyrusOne CASE STUDY Nirvanix, Inc. Finds a Secure and Reliable Data Center and a Strategic Partner for Cloud Services at CyrusOne The Company Nirvanix, Inc. is the leading provider of enterprise-class cloud storage

More information

EXECUTIVE REPORT. Scalability & Capacity Planning: Build vs. Buy

EXECUTIVE REPORT. Scalability & Capacity Planning: Build vs. Buy EXECUTIVE REPORT Scalability & Capacity Overview This paper explores issues that arise when planning for growth of Information Technology infrastructure. The paper explains how colocation of data centers

More information

EXECUTIVE REPORT. Why Healthcare Providers Seek Out New Ways To Manage and Utilize Big Data

EXECUTIVE REPORT. Why Healthcare Providers Seek Out New Ways To Manage and Utilize Big Data EXECUTIVE REPORT Why Healthcare Providers Seek Out New Ways To Manage and Utilize Big Impact of Healthcare Regulations on the Center The HIPAA and HITECH acts, along with the Affordable Care Act, are changing

More information

CASE STUDY. FuelQuest, Inc. Achieves 100% Uptime for their Cloud-Based Fuel Inventory and Tax Solutions at CyrusOne s Data Center

CASE STUDY. FuelQuest, Inc. Achieves 100% Uptime for their Cloud-Based Fuel Inventory and Tax Solutions at CyrusOne s Data Center CASE STUDY FuelQuest, Inc. Achieves 100% Uptime for their Cloud-Based Fuel Inventory and Tax Solutions at CyrusOne s Data Center The Company FuelQuest, Inc. is the leading provider of software solutions

More information

CARFAX Selects Data Center for Connectivity & Redundancy

CARFAX Selects Data Center for Connectivity & Redundancy CASE STUDY CARFAX Selects Data Center for Enterprise Deploys New IT Footprint in Data Centers Interconnected from Across the U.S. Abstract CARFAX is America s leading provider of vehicle history reports

More information

How to Select a Colocation Provider Offering High Performance Computing

How to Select a Colocation Provider Offering High Performance Computing EXECUTIVE REPORT How to Select a Colocation Provider Offering High Performance Computing How to Select a Colocation HPC computing infrastructures can t use traditional computing environments. Due to the

More information

CIOs Rising in Performance Needs

CIOs Rising in Performance Needs EXECUTIVE REPORT 5 Colocation Most Significant Addresses Challenges Oil & Gas Companies Facing CIOs Rising in Performance 2013 Needs Built for Tomorrow. Ready today. 1649 W Frankford 1649 Frankford Rd,

More information

EXECUTIVE REPORT. Build vs Buy: Key Steps to Overcome Capital Constraints in the Data Center

EXECUTIVE REPORT. Build vs Buy: Key Steps to Overcome Capital Constraints in the Data Center EXECUTIVE REPORT Build vs Buy: Key Steps to Overcome Capital Constraints in the Data Center Overview Data center industry trends are changing the way businesses spend money and invest in IT initiatives.

More information

Big Data. White Paper. Big Data Executive Overview WP-BD-10312014-01. Jafar Shunnar & Dan Raver. Page 1 Last Updated 11-10-2014

Big Data. White Paper. Big Data Executive Overview WP-BD-10312014-01. Jafar Shunnar & Dan Raver. Page 1 Last Updated 11-10-2014 White Paper Big Data Executive Overview WP-BD-10312014-01 By Jafar Shunnar & Dan Raver Page 1 Last Updated 11-10-2014 Table of Contents Section 01 Big Data Facts Page 3-4 Section 02 What is Big Data? Page

More information

The Next Wave of Data Management. Is Big Data The New Normal?

The Next Wave of Data Management. Is Big Data The New Normal? The Next Wave of Data Management Is Big Data The New Normal? Table of Contents Introduction 3 Separating Reality and Hype 3 Why Are Firms Making IT Investments In Big Data? 4 Trends In Data Management

More information

CASE STUDY. CyrusOne Helps City of Houston to Go Green and Reduce Energy Consumption through Data Center Consolidation

CASE STUDY. CyrusOne Helps City of Houston to Go Green and Reduce Energy Consumption through Data Center Consolidation CASE STUDY CyrusOne Helps City of Houston to Go Green and Reduce Energy Consumption through Data Center Consolidation Abstract To handle the administrative needs of America s fourth-largest city, the City

More information

Hadoop for Enterprises:

Hadoop for Enterprises: Hadoop for Enterprises: Overcoming the Major Challenges Introduction to Big Data Big Data are information assets that are high volume, velocity, and variety. Big Data demands cost-effective, innovative

More information

Interconnection for Financial Services

Interconnection for Financial Services EXECUTIVE REPORT 5 IT Most Service Significant Challenges Management Facing CIOs Framework in 2013& Interconnection for Financial Services Built for Tomorrow. Ready today. 1649 W Frankford 1649 Frankford

More information

How T-Systems Solved Its Data Center Challenges to Offer Dynamic Services to the U.S.

How T-Systems Solved Its Data Center Challenges to Offer Dynamic Services to the U.S. Case study How T-Systems Solved Its Data Center Challenges to Offer Dynamic Services to the U.S. The Company T-Systems, part of Deutsche Telekom Group (DT), delivers Information and Communication Technologies

More information

Hadoop. MPDL-Frühstück 9. Dezember 2013 MPDL INTERN

Hadoop. MPDL-Frühstück 9. Dezember 2013 MPDL INTERN Hadoop MPDL-Frühstück 9. Dezember 2013 MPDL INTERN Understanding Hadoop Understanding Hadoop What's Hadoop about? Apache Hadoop project (started 2008) downloadable open-source software library (current

More information

We are Big Data A Sonian Whitepaper

We are Big Data A Sonian Whitepaper EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed

More information

BIG DATA IS MESSY PARTNER WITH SCALABLE

BIG DATA IS MESSY PARTNER WITH SCALABLE BIG DATA IS MESSY PARTNER WITH SCALABLE SCALABLE SYSTEMS HADOOP SOLUTION WHAT IS BIG DATA? Each day human beings create 2.5 quintillion bytes of data. In the last two years alone over 90% of the data on

More information

BIG DATA TECHNOLOGY. Hadoop Ecosystem

BIG DATA TECHNOLOGY. Hadoop Ecosystem BIG DATA TECHNOLOGY Hadoop Ecosystem Agenda Background What is Big Data Solution Objective Introduction to Hadoop Hadoop Ecosystem Hybrid EDW Model Predictive Analysis using Hadoop Conclusion What is Big

More information

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 ISSN 2278-7763. BIG DATA: A New Technology

International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 ISSN 2278-7763. BIG DATA: A New Technology International Journal of Advancements in Research & Technology, Volume 3, Issue 5, May-2014 18 BIG DATA: A New Technology Farah DeebaHasan Student, M.Tech.(IT) Anshul Kumar Sharma Student, M.Tech.(IT)

More information

Big data and its transformational effects

Big data and its transformational effects Big data and its transformational effects Professor Fai Cheng Head of Research & Technology September 2015 Working together for a safer world Topics Lloyd s Register Big Data Data driven world Data driven

More information

Harnessing the Power of Big Data for Real-Time IT: Sumo Logic Log Management and Analytics Service

Harnessing the Power of Big Data for Real-Time IT: Sumo Logic Log Management and Analytics Service Harnessing the Power of Big Data for Real-Time IT: Sumo Logic Log Management and Analytics Service A Sumo Logic White Paper Introduction Managing and analyzing today s huge volume of machine data has never

More information

A Brief Outline on Bigdata Hadoop

A Brief Outline on Bigdata Hadoop A Brief Outline on Bigdata Hadoop Twinkle Gupta 1, Shruti Dixit 2 RGPV, Department of Computer Science and Engineering, Acropolis Institute of Technology and Research, Indore, India Abstract- Bigdata is

More information

Analytics in the Cloud. Peter Sirota, GM Elastic MapReduce

Analytics in the Cloud. Peter Sirota, GM Elastic MapReduce Analytics in the Cloud Peter Sirota, GM Elastic MapReduce Data-Driven Decision Making Data is the new raw material for any business on par with capital, people, and labor. What is Big Data? Terabytes of

More information

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com

More information

Ubuntu and Hadoop: the perfect match

Ubuntu and Hadoop: the perfect match WHITE PAPER Ubuntu and Hadoop: the perfect match February 2012 Copyright Canonical 2012 www.canonical.com Executive introduction In many fields of IT, there are always stand-out technologies. This is definitely

More information

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this

More information

High Performance Computing (HPC) Solutions in High Density Data Centers

High Performance Computing (HPC) Solutions in High Density Data Centers EXECUTIVE REPORT High Performance Computing (HPC) Solutions in High Density Data Centers How s Houston West data center campus delivers the highest density solutions to customers Overview With the ever-increasing

More information

Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014

Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014 Big Data, Why All the Buzz? (Abridged) Anita Luthra, February 20, 2014 Defining Big Not Just Massive Data Big data refers to data sets whose size is beyond the ability of typical database software tools

More information

Buyer s Guide to Big Data Integration

Buyer s Guide to Big Data Integration SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology

More information

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the

More information

EXECUTIVE REPORT. 4 Critical Steps Financial Firms Must Take for IT Uptime, Security, and Connectivity

EXECUTIVE REPORT. 4 Critical Steps Financial Firms Must Take for IT Uptime, Security, and Connectivity EXECUTIVE REPORT 4 Critical Steps Financial Firms Must Take for IT Uptime, Security, and Connectivity When Millions of Dollars of Financial Transactions are On the Line, Downtime is Not an Option The many

More information

SEAIP 2009 Presentation

SEAIP 2009 Presentation SEAIP 2009 Presentation By David Tan Chair of Yahoo! Hadoop SIG, 2008-2009,Singapore EXCO Member of SGF SIG Imperial College (UK), Institute of Fluid Science (Japan) & Chicago BOOTH GSB (USA) Alumni Email:

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing

Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Architecting for Big Data Analytics and Beyond: A New Framework for Business Intelligence and Data Warehousing Wayne W. Eckerson Director of Research, TechTarget Founder, BI Leadership Forum Business Analytics

More information

Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014

Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014 What is Big Data? Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014 Data in the Twentieth Century and before In 1663,

More information

Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges

Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges Prerita Gupta Research Scholar, DAV College, Chandigarh Dr. Harmunish Taneja Department of Computer Science and

More information

Impact of Healthcare Regulations on the Data Center

Impact of Healthcare Regulations on the Data Center Executive Report Impact of Healthcare Regulations on the Data Center Impact of Healthcare Regulations The HIPAA and HITECH acts, along with the Affordable Care Act, are changing the face of the healthcare

More information

Colocation, Hybrid Cloud & Infrastructure As A Service

Colocation, Hybrid Cloud & Infrastructure As A Service www.cloud-grid.net 305.438.7402 Colocation, Hybrid Cloud & Infrastructure As A Service IT managers today need to deal with an everincreasing set of business demands. High speed data networks have made

More information

Where is... How do I get to...

Where is... How do I get to... Big Data, Fast Data, Spatial Data Making Sense of Location Data in a Smart City Hans Viehmann Product Manager EMEA ORACLE Corporation August 19, 2015 Copyright 2014, Oracle and/or its affiliates. All rights

More information

Big Data & Its Bigger Possibilities In The Cloud

Big Data & Its Bigger Possibilities In The Cloud Big Data & Its Bigger Possibilities In The Cloud Chhavi Gupta Software Engineer, EMC Corporation Sai Pattem Professional MBA Candidate 2013 August 15 th, 9:30 10:30 AM Session 13860 Room 200 (Hynes Convention

More information

BIG DATA-AS-A-SERVICE

BIG DATA-AS-A-SERVICE White Paper BIG DATA-AS-A-SERVICE What Big Data is about What service providers can do with Big Data What EMC can do to help EMC Solutions Group Abstract This white paper looks at what service providers

More information

BIG DATA What it is and how to use?

BIG DATA What it is and how to use? BIG DATA What it is and how to use? Lauri Ilison, PhD Data Scientist 21.11.2014 Big Data definition? There is no clear definition for BIG DATA BIG DATA is more of a concept than precise term 1 21.11.14

More information

Beyond Web Application Log Analysis using Apache TM Hadoop. A Whitepaper by Orzota, Inc.

Beyond Web Application Log Analysis using Apache TM Hadoop. A Whitepaper by Orzota, Inc. Beyond Web Application Log Analysis using Apache TM Hadoop A Whitepaper by Orzota, Inc. 1 Web Applications As more and more software moves to a Software as a Service (SaaS) model, the web application has

More information

Scalability & Capacity Planning: Build vs. Buy

Scalability & Capacity Planning: Build vs. Buy EXECUTIVE REPORT Scalability & Capacity Overview This paper explores issues that arise when planning for growth of Information Technology infrastructure. The paper explains how colocation of data centers

More information

Top Considerations in Today s IT Infrastructure

Top Considerations in Today s IT Infrastructure THE INFORMATION SOURCE FOR THE DATA CENTER INDUSTRY Data Center Knowledge Guide to A look at the Private Cloud, Big Data, and Deploying a Cloud-Ready Data Center Bill Kleyman, Cloud and Virtualization

More information

Trends. Big Data...The next frontier

Trends. Big Data...The next frontier IT industry Trends Big Data...The next frontier Space: the final frontier. To paraphrase Star Trek, Big Data may help your business boldly go where no business has gone before. And while it may not be

More information

EXECUTIVE REPORT. 6 Key Considerations for Financial Firms to Improve Security and Scalability of Mobile Banking Services

EXECUTIVE REPORT. 6 Key Considerations for Financial Firms to Improve Security and Scalability of Mobile Banking Services EXECUTIVE REPORT 6 Key Considerations for to Improve Security and Scalability of Mobile Banking Services Consumers Demand Mobile Banking, So Financial Companies Need Best-in- Class Security and Scalable

More information

Cloud Computing and Big Data. What s the Big Deal?

Cloud Computing and Big Data. What s the Big Deal? Cloud Computing and Big Data. What s the Big Deal? Arlene Minkiewicz, Chief Scientist PRICE Systems, LLC arlene.minkiewicz@pricesystems.com 2013 PRICE Systems, LLC All Rights Reserved Decades of Cost Management

More information

locuz.com Big Data Services

locuz.com Big Data Services locuz.com Big Data Services Big Data At Locuz, we help the enterprise move from being a data-limited to a data-driven one, thereby enabling smarter, faster decisions that result in better business outcome.

More information

Big Data: Using ArcGIS with Apache Hadoop

Big Data: Using ArcGIS with Apache Hadoop 2013 Esri International User Conference July 8 12, 2013 San Diego, California Technical Workshop Big Data: Using ArcGIS with Apache Hadoop David Kaiser Erik Hoel Offering 1330 Esri UC2013. Technical Workshop.

More information

BIG DATA TRENDS AND TECHNOLOGIES

BIG DATA TRENDS AND TECHNOLOGIES BIG DATA TRENDS AND TECHNOLOGIES THE WORLD OF DATA IS CHANGING Cloud WHAT IS BIG DATA? Big data are datasets that grow so large that they become awkward to work with using onhand database management tools.

More information

III Big Data Technologies

III Big Data Technologies III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

The 3 questions to ask yourself about BIG DATA

The 3 questions to ask yourself about BIG DATA The 3 questions to ask yourself about BIG DATA Do you have a big data problem? Companies looking to tackle big data problems are embarking on a journey that is full of hype, buzz, confusion, and misinformation.

More information

Generating the Business Value of Big Data:

Generating the Business Value of Big Data: Leveraging People, Processes, and Technology Generating the Business Value of Big Data: Analyzing Data to Make Better Decisions Authors: Rajesh Ramasubramanian, MBA, PMP, Program Manager, Catapult Technology

More information

Fast, Low-Overhead Encryption for Apache Hadoop*

Fast, Low-Overhead Encryption for Apache Hadoop* Fast, Low-Overhead Encryption for Apache Hadoop* Solution Brief Intel Xeon Processors Intel Advanced Encryption Standard New Instructions (Intel AES-NI) The Intel Distribution for Apache Hadoop* software

More information

Hadoop. http://hadoop.apache.org/ Sunday, November 25, 12

Hadoop. http://hadoop.apache.org/ Sunday, November 25, 12 Hadoop http://hadoop.apache.org/ What Is Apache Hadoop? The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using

More information

What are Hadoop and MapReduce and how did we get here?

What are Hadoop and MapReduce and how did we get here? What are Hadoop and MapReduce and how did we get here? Term Big Data coined in 2005 by Roger Magoulas of O Reilly Media But as the idea of big data sets evolved on the Web, organizations began to wonder

More information

Accelerating and Simplifying Apache

Accelerating and Simplifying Apache Accelerating and Simplifying Apache Hadoop with Panasas ActiveStor White paper NOvember 2012 1.888.PANASAS www.panasas.com Executive Overview The technology requirements for big data vary significantly

More information

OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT

OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT WHITEPAPER OPEN MODERN DATA ARCHITECTURE FOR FINANCIAL SERVICES RISK MANAGEMENT A top-tier global bank s end-of-day risk analysis jobs didn t complete in time for the next start of trading day. To solve

More information

SOCIAL MEDIA ADVERTISING STRATEGIES THAT WORK

SOCIAL MEDIA ADVERTISING STRATEGIES THAT WORK SOCIAL MEDIA ADVERTISING STRATEGIES THAT WORK ABSTRACT» Social media advertising is a new and fast growing part of digital advertising. In this White Paper I'll present social media advertising trends,

More information

A REVIEW PAPER ON THE HADOOP DISTRIBUTED FILE SYSTEM

A REVIEW PAPER ON THE HADOOP DISTRIBUTED FILE SYSTEM A REVIEW PAPER ON THE HADOOP DISTRIBUTED FILE SYSTEM Sneha D.Borkar 1, Prof.Chaitali S.Surtakar 2 Student of B.E., Information Technology, J.D.I.E.T, sborkar95@gmail.com Assistant Professor, Information

More information

ATA DRIVEN GLOBAL VISION CLOUD PLATFORM STRATEG N POWERFUL RELEVANT PERFORMANCE SOLUTION CLO IRTUAL BIG DATA SOLUTION ROI FLEXIBLE DATA DRIVEN V

ATA DRIVEN GLOBAL VISION CLOUD PLATFORM STRATEG N POWERFUL RELEVANT PERFORMANCE SOLUTION CLO IRTUAL BIG DATA SOLUTION ROI FLEXIBLE DATA DRIVEN V ATA DRIVEN GLOBAL VISION CLOUD PLATFORM STRATEG N POWERFUL RELEVANT PERFORMANCE SOLUTION CLO IRTUAL BIG DATA SOLUTION ROI FLEXIBLE DATA DRIVEN V WHITE PAPER Create the Data Center of the Future Accelerate

More information

CitusDB Architecture for Real-Time Big Data

CitusDB Architecture for Real-Time Big Data CitusDB Architecture for Real-Time Big Data CitusDB Highlights Empowers real-time Big Data using PostgreSQL Scales out PostgreSQL to support up to hundreds of terabytes of data Fast parallel processing

More information

Databases & Business Intelligence Part 1

Databases & Business Intelligence Part 1 Welcome back! We will have more fun. Databases & Business Intelligence Part 1 BUSA345 Lecture #8-1 Claire Hitosugi, PhD, MBA In the previous lecture We learned Define Open Source Software (OSS) and provide

More information

BIG DATA USING HADOOP

BIG DATA USING HADOOP + Breakaway Session By Johnson Iyilade, Ph.D. University of Saskatchewan, Canada 23-July, 2015 BIG DATA USING HADOOP + Outline n Framing the Problem Hadoop Solves n Meet Hadoop n Storage with HDFS n Data

More information

Hadoop and Map-Reduce. Swati Gore

Hadoop and Map-Reduce. Swati Gore Hadoop and Map-Reduce Swati Gore Contents Why Hadoop? Hadoop Overview Hadoop Architecture Working Description Fault Tolerance Limitations Why Map-Reduce not MPI Distributed sort Why Hadoop? Existing Data

More information

Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases

Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases Introduction The world is awash in data and turning that data into actionable

More information

Understanding Object Storage and How to Use It

Understanding Object Storage and How to Use It SWIFTSTACK WHITEPAPER An IT Expert Guide: Understanding Object Storage and How to Use It November 2014 The explosion of unstructured data is creating a groundswell of interest in object storage, certainly

More information

Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop

Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop Role of Cloud Computing in Big Data Analytics Using MapReduce Component of Hadoop Kanchan A. Khedikar Department of Computer Science & Engineering Walchand Institute of Technoloy, Solapur, Maharashtra,

More information

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research Benchmarking Large-Scale Data Management Insights from Presentation Confidentiality Statement The materials in this presentation are protected under the confidential agreement and/or are copyrighted materials

More information

Big Data on Microsoft Platform

Big Data on Microsoft Platform Big Data on Microsoft Platform Prepared by GJ Srinivas Corporate TEG - Microsoft Page 1 Contents 1. What is Big Data?...3 2. Characteristics of Big Data...3 3. Enter Hadoop...3 4. Microsoft Big Data Solutions...4

More information

Cloud Computing and Advanced Relationship Analytics

Cloud Computing and Advanced Relationship Analytics Cloud Computing and Advanced Relationship Analytics Using Objectivity/DB to Discover the Relationships in your Data By Brian Clark Vice President, Product Management Objectivity, Inc. 408 992 7136 brian.clark@objectivity.com

More information

BIG DATA SOLUTION DATA SHEET

BIG DATA SOLUTION DATA SHEET BIG DATA SOLUTION DATA SHEET Highlight. DATA SHEET HGrid247 BIG DATA SOLUTION Exploring your BIG DATA, get some deeper insight. It is possible! Another approach to access your BIG DATA with the latest

More information

Cloud Computing and Big Data That s Why! Ray Walshe 14 th March 2013

Cloud Computing and Big Data That s Why! Ray Walshe 14 th March 2013 Cloud Computing and Big Data That s Why! Ray Walshe 14 th March 2013 Data Centre Growth We need more data centres??? (c) Ray Walshe 2013 2 By 2015 By 2015, about 24% of all new business software purchases

More information

Customized Report- Big Data

Customized Report- Big Data GINeVRA Digital Research Hub Customized Report- Big Data 1 2014. All Rights Reserved. Agenda Context Challenges and opportunities Solutions Market Case studies Recommendations 2 2014. All Rights Reserved.

More information

Hybrid Software Architectures for Big Data. Laurence.Hubert@hurence.com @hurence http://www.hurence.com

Hybrid Software Architectures for Big Data. Laurence.Hubert@hurence.com @hurence http://www.hurence.com Hybrid Software Architectures for Big Data Laurence.Hubert@hurence.com @hurence http://www.hurence.com Headquarters : Grenoble Pure player Expert level consulting Training R&D Big Data X-data hot-line

More information

THE BIGGER THE DATA THE STRONGER THE STORY FIVE STEPS TO BREAKING DOWN BIG DATA INTO ACTIONABLE INSIGHTS

THE BIGGER THE DATA THE STRONGER THE STORY FIVE STEPS TO BREAKING DOWN BIG DATA INTO ACTIONABLE INSIGHTS THE BIGGER THE DATA THE STRONGER THE STORY FIVE STEPS TO BREAKING DOWN BIG DATA INTO ACTIONABLE INSIGHTS Everything we do becomes data. Every site we visit. Every shopping cart we abandon. Every tweet

More information

Top 10 Automotive Manufacturer Makes the Business Case for OpenStack

Top 10 Automotive Manufacturer Makes the Business Case for OpenStack Top 10 Automotive Manufacturer Makes the Business Case for OpenStack OPENSTACK WHITE PAPER Contributors: SOLINEA: Francesco Paola, CEO Seth Fox, Vice President Operations Brad Vaughan, Vice President Service

More information

Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution

Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights

More information

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities Technology Insight Paper Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities By John Webster February 2015 Enabling you to make the best technology decisions Enabling

More information

Introduction to the Mathematics of Big Data. Philippe B. Laval

Introduction to the Mathematics of Big Data. Philippe B. Laval Introduction to the Mathematics of Big Data Philippe B. Laval Fall 2015 Introduction In recent years, Big Data has become more than just a buzz word. Every major field of science, engineering, business,

More information

Journal of Environmental Science, Computer Science and Engineering & Technology

Journal of Environmental Science, Computer Science and Engineering & Technology JECET; March 2015-May 2015; Sec. B; Vol.4.No.2, 202-209. E-ISSN: 2278 179X Journal of Environmental Science, Computer Science and Engineering & Technology An International Peer Review E-3 Journal of Sciences

More information

Designing a Scalable Database for Online Video Analytics

Designing a Scalable Database for Online Video Analytics Designing a Scalable Database for Online Video Analytics White Paper Ooyala I 800 West El Camino Real, Suite 350 Mountain View CA 94040 I 1-877-366-9252 I www.ooyala.com Online Video Analytics A deep understanding

More information

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage

www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage www.pwc.com/oracle Next presentation starting soon Business Analytics using Big Data to gain competitive advantage If every image made and every word written from the earliest stirring of civilization

More information

Solving the Big Data Intention-Deployment Gap

Solving the Big Data Intention-Deployment Gap Solving the Big Data Intention-Deployment Gap Big Data is on virtually every enterprise s to-do list these days. Recognizing both its potential and competitive advantage, companies are aligning a vast

More information

INTRODUCTION TO CASSANDRA

INTRODUCTION TO CASSANDRA INTRODUCTION TO CASSANDRA This ebook provides a high level overview of Cassandra and describes some of its key strengths and applications. WHAT IS CASSANDRA? Apache Cassandra is a high performance, open

More information

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com;

Microsoft Big Data Solutions. Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Microsoft Big Data Solutions Anar Taghiyev P-TSP E-mail: b-anarta@microsoft.com; Why/What is Big Data and Why Microsoft? Options of storage and big data processing in Microsoft Azure. Real Impact of Big

More information

Open source Google-style large scale data analysis with Hadoop

Open source Google-style large scale data analysis with Hadoop Open source Google-style large scale data analysis with Hadoop Ioannis Konstantinou Email: ikons@cslab.ece.ntua.gr Web: http://www.cslab.ntua.gr/~ikons Computing Systems Laboratory School of Electrical

More information

50x 2020 40 Zettabytes*

50x 2020 40 Zettabytes* IBM Global Technology Services How to integrate cloud-based disaster recovery into your existing business continuity plans Richard Cocchiara: IBM Distinguished Engineer; CTO IBM Business Continuity & Resiliency

More information

There s no way around it: learning about Big Data means

There s no way around it: learning about Big Data means In This Chapter Chapter 1 Introducing Big Data Beginning with Big Data Meeting MapReduce Saying hello to Hadoop Making connections between Big Data, MapReduce, and Hadoop There s no way around it: learning

More information

What happens when Big Data and Master Data come together?

What happens when Big Data and Master Data come together? What happens when Big Data and Master Data come together? Jeremy Pritchard Master Data Management fgdd 1 What is Master Data? Master data is data that is shared by multiple computer systems. The Information

More information

Cloud Computing and Big Data What s the Big Deal

Cloud Computing and Big Data What s the Big Deal Cloud Computing and Big Data What s the Big Deal Arlene Minkiewicz, Chief Scientist PRICE Systems, LLC arlene.minkiewicz@pricesystems.com Optimize tomorrow today. 1 Agenda Introduction Cloud Computing

More information

Hadoop in the Hybrid Cloud

Hadoop in the Hybrid Cloud Presented by Hortonworks and Microsoft Introduction An increasing number of enterprises are either currently using or are planning to use cloud deployment models to expand their IT infrastructure. Big

More information

Capturing Meaningful Competitive Intelligence from the Social Media Movement

Capturing Meaningful Competitive Intelligence from the Social Media Movement Capturing Meaningful Competitive Intelligence from the Social Media Movement Social media has evolved from a creative marketing medium and networking resource to a goldmine for robust competitive intelligence

More information

BIG DATA ANALYTICS For REAL TIME SYSTEM

BIG DATA ANALYTICS For REAL TIME SYSTEM BIG DATA ANALYTICS For REAL TIME SYSTEM Where does big data come from? Big Data is often boiled down to three main varieties: Transactional data these include data from invoices, payment orders, storage

More information

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database

Managing Big Data with Hadoop & Vertica. A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Managing Big Data with Hadoop & Vertica A look at integration between the Cloudera distribution for Hadoop and the Vertica Analytic Database Copyright Vertica Systems, Inc. October 2009 Cloudera and Vertica

More information

GigaSpaces Real-Time Analytics for Big Data

GigaSpaces Real-Time Analytics for Big Data GigaSpaces Real-Time Analytics for Big Data GigaSpaces makes it easy to build and deploy large-scale real-time analytics systems Rapidly increasing use of large-scale and location-aware social media and

More information