THE RWE SERIES BIG DATA ANALYTICS & VISUALISATION RWE TRIA

Size: px
Start display at page:

Download "THE RWE SERIES BIG DATA ANALYTICS & VISUALISATION RWE TRIA"

Transcription

1 THE RWE SERIES Providing the background, the research and the insights. PART III: BIG DATA ANALYTICS & VISUALISATION RWE TRIA Big Data in healthcare is a complex, rapidly evolving and exciting area. It is an important source of Real World Evidence (RWE) - data which has been collected outside of a conventional clinical trial. In Part III of the RWE Series we distil this wideranging and sometimes intimidating topic down to its key features to understand how we can take advantage of this data and maximise its potential. We pay special attention to the visualisation methods for interpreting and presenting Big Data. BY GEM AUDDY [email protected] This is the third part of a regular series available at svmpharma.com SVMPHARMA LIMITED WINCHFIELD LODGE OLD POTBRIDGE RD WINCHFIELD HAMPSHIRE RG27 8BT +44 (0)

2 T he capabilities and potential of Big Data have become a major focus of attention in recent years across many industries. There is no shortage of astounding facts about Big Data, for example, 90% of the data in the world today has been created in the last 2 years alone. 1-3 Furthermore, there have been frequent predictions that Big Data will solve persistent issues or lead to previously unimaginable cost reductions. 4 However, it can be difficult to relate to and contextualise these impressive facts and possibilities. First we need to gain a better understanding of the core principles of healthcare analytics and Big Data. IT CAN BE DIFFICULT TO RELATE TO AND CONTEXTUALISE THESE IMPRESSIVE FACTS AND POSSIBILITIES Big Data has been defined as high volume, high velocity, and high variety information assets that require new forms of processing to enable enhanced decision making, insight discovery and process optimisation. This influential 3Vs model of Big Data was first envisioned in 2001 and has been referred to in the majority of articles since that time. 5,6 More recently a fourth V has been incorporated which emphasises the need for the data to be accurate, this is known as data veracity. 7,8 HEALTHCARE DATA ANALYTICS PROVIDES THE MOST POWERFUL EXAMPLES OF THE CHARACTERISTICS OF BIG DATA This model provides an excellent starting point for exploring the topic, and as you will see, healthcare data analytics provides the most powerful examples of the characteristics of Big Data. In this article we propose for the first time, a fifth V : visualisation. We will highlight the visualisation tools and techniques which are needed to drive meaningful outcomes from Big Data. THE VERACITY OF DATA IS ITS ACCURACY AND IS A KEY PART OF ANY DISCUSSION HEALTHCARE DATA EXISTS IN MANY FORMS AND IS OFTEN UNSTRUCTURED THE SHEER QUANTITY OF DATA IS THE EPONYMOUS CHARACTERISTIC OF BIG DATA Big Data & Healthcare Analytics NEW HEALTH DATA IS GENERATED AND CAPTURED CONTINUOUSLY VISUALISATION VISUALISATION TOOLS AND TECHNIQUES ARE VITAL IN IDENTIFYING RELATIONSHIPS AND TO CONVEY INFORMATION 2

3 Volume The sheer quantity of data that is captured, stored and processed is the eponymous characteristic of Big Data. Compared to other industries, the healthcare services have always generated vast quantities of data. This is through meticulous record keeping, compliance/ regulatory requirements, and comprehensive patient care notes. 9 As we move towards universal electronic health records in primary care and increasing digitisation of hospital data, we now have a remarkable volume of data. 10 Recent technological advancements in data storage capacity is now prepared for this, whilst networking capabilities can handle the movement of large quantities of data. In addition to clinical data, there has been a notable increase in the collection of consumer driven lifestyle data which can provide valuable insights into general health and wellbeing. 11 Velocity New health data is generated and captured continuously and at a rapid pace. There is a constant flow of new data. The health service is moving away from traditional static data such as x- rays films and scripts to more dynamic systems involving multi-dimensional and regular measurements. Real-time data monitoring is associated with critical care units and the operating theatre but can increasingly be applied to care at home and the community. Technology allows for immediate data analysis in real time from any location and any number of patients. The general consensus is that real-time analytics of high volume data has the potential to revolutionise healthcare Variety Healthcare data exists in many forms including written notes and prescriptions, medical imaging, laboratory, pharmacy, insurance and administrative data in addition to sensor data. Increasingly health information can be found within dynamic web content including social media. Big Data can be coded and stored in a structured form, for example, in the large datasets, Hospital Episode Statistics (HES) and the Clinical Practice Research Datalink (CPRD). However a significant amount of data exists in unstructured or semi-structured formats and the processing, storage and analysis of data is adapting to accommodate this. 15 Veracity Veracity of data is its accuracy and conformity to facts. Veracity is an essential part of any discussion on data and is particularly important in healthcare, where the implications of inaccurate data can be severe. To attain accurate analyses in Big Data, there needs to be a scaling up in granularity and performance of the architectures, platforms, algorithms, methodologies and tools. Big Data analysis has been compared to financial data in this regard. 9 As Big Data in healthcare is measuring real-world outcomes, it can offer a more accurate representation of real world practice than controlled trials. Visualisation Due to its volume, variety and velocity, Big Data analysis and presentation can be difficult. Traditional written, tabular and graphical formats can be inadequate in conveying the findings, and key details can be lost in summarising and aggregating the data. There a number of visualisation tools and solutions which have been proven to be valuable in identifying relationships and conveying information. The two most commonly used for Big Data in healthcare are Cytoscape and Gephi. Cytoscape initially began in bioinformatics (gene processing and molecular networks) whilst Gephi has often been used for consumer and social research. Both of these tools can be adapted to enhance healthcare data analytics as our examples will show. Network graphs consists of nodes (a set of objects representing entities in a dataset) and edges (connections between nodes that provide visual cues as to the degree of connectedness). 16 3

4 Visualisation in Cystic Fibrosis 1. Data in Tables 2. Data In Gephi SVMPharma carried out a data visualisation exercise using Gephi to show the multi-disciplinary nature of Cystic Fibrosis (CF) by highlighting its co-morbidities and associated health problems. 15,000 Cystic Fibrosis patients who visited hospital from were selected by their ICD-10 code (diagnosis code) from the Hospital Episodes Statistics (HES) dataset. This provided 3,800 ICD-10 codes and over 20,000 different 3,800 ICD-10 CODES AND OVER 20,000 DIFFERENT CONNECTIONS BETWEEN THEM connections between them. The data was entered into Gephi, with each ICD-10 code represented by a node, and each different connection between them via a line. The radial layout was used in Gephi to create the image on the right (Image 5) which includes the entirety of the data. To take a closer look at the data, the top 100 different connections leading from the CF nodes were identified. This is represented below (Image 8) with both the node size and connecting line representing the strength and volume of the connection, and the nodes positioned and colour-coded according to disease group. The final visual conveys at a glance, the main co-morbidities of CF patients and associated health issues. This shows the strength of the relationships between CF and its secondary complications and directions the disease is likely to progress. 3. Ranking (Colour) 4. Radial Layout 5. Entire Data Connections (Edges) 8. A Closer Look Nodes 6. Top Labelling 4

5 The Technology To cope with Big Data, a number of hardware and software solutions are used and these have replaced the traditional Business Intelligence (BI) tools. The first step involves massively parallel computing and the processing of large datasets across clusters using a Hadoop based program. Specialist tools are available for rapid processing and querying including Spark for structured and semi-structured data, whilst unstructured data can be stored in the document database software MongoDB. Saiku allows users to create, visualize and analyse information in graphical & pivot table formats. These wholesale changes in data storage and processing architecture has been crucial and sets the platform for future innovation and expansion. Big Data analytics in healthcare is almost ready to fulfil its potential: this is due to the rapid digitisation of information, the adaptations in technological architecture and the increasing capabilities for real-time analysis. However, to maximise its potential we need to fully understand the key characteristics of Big Data: volume, variety and velocity. A consideration of the veracity of the data and visualisation techniques make up our 5Vs of Big Data in healthcare and provide a useful framework to explore the key issues. 1. ScienceDaily. Big Data, for better or worse: 90% of world's data generated over last two years Mayer-Schönberger V, Cukier K. Big data: A revolution that will transform how we live, work, and think: Houghton Mifflin Harcourt; Marr B. Big Data: The Eye-Opening Facts Everyone Should Know Gurnett J. Big data could dramatically cut 80bn NHS chronic care bill Ward JS, Barker A. Undefined by data: a survey of big data definitions. arxiv preprint arxiv: Diebold FX. On the Origin (s) and Development of the Term'Big Data' Buhl HU, Röglinger M, Moser D-KF, Heidemann J. Big data. Business & Information Systems Engineering 2013; 5(2): Blount M, Ebling MR, Eklund JM, et al. Real-Time Analysis for Intensive Care: Development and Deployment of the Artemis Analytic System. Engineering in Medicine and Biology Magazine, IEEE 2010; 29(2): Feldman B, Martin EM, Skotnes T. Big Data in Healthcare Hype and Hope. October 2012 Dr Bonnie 2012; Berry A, Milosevic Z. Real-Time Analytics for Legacy Data Streams in Health: Monitoring Health Data Quality. Enterprise Distributed Object Computing Conference (EDOC), th IEEE International; Sept. 2013; p Sawant N, Shah H. Big Data Storage Patterns. Big Data Application Architecture Q & A: Apress; 2013: Cherven K. Network Graph Analysis and Visualization with Gephi: Packt Publishing Ltd; Front Cover Image by Calvinius [CC BY-SA 3.0 ( via Wikimedia Commons 8. Hitzler P, Janowicz K. Linked data, big data, and the 4th paradigm. Semantic Web 2013; 4(3): Raghupathi W, Raghupathi V. Big data analytics in healthcare: promise and potential. Health Inf Sci Syst 2014; 2(1): Takian A, Cornford T. NHS information: Revolution or evolution? Health Policy and Technology 2012; 1(4): Johnson K, Jimison H, Mandl K. Consumer Health Informatics and Personal Health Records. In: Shortliffe EH, Cimino JJ, eds. Biomedical Informatics: Springer London; 2014:

How To Handle Big Data With A Data Scientist

How To Handle Big Data With A Data Scientist III Big Data Technologies Today, new technologies make it possible to realize value from Big Data. Big data technologies can replace highly customized, expensive legacy systems with a standard solution

More information

Big Data and Healthcare Payers WHITE PAPER

Big Data and Healthcare Payers WHITE PAPER Knowledgent White Paper Series Big Data and Healthcare Payers WHITE PAPER Summary With the implementation of the Affordable Care Act, the transition to a more member-centric relationship model, and other

More information

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: [email protected]

More information

BIG DATA AND ANALYTICS

BIG DATA AND ANALYTICS BIG DATA AND ANALYTICS Björn Bjurling, [email protected] Daniel Gillblad, [email protected] Anders Holst, [email protected] Swedish Institute of Computer Science AGENDA What is big data and analytics? and why one must bother

More information

Data Visualisation and Statistical Analysis Within the Decision Making Process

Data Visualisation and Statistical Analysis Within the Decision Making Process Data Visualisation and Statistical Analysis Within the Decision Making Process Jamie Mahoney Centre for Educational Research and Development, University of Lincoln, Lincoln, UK. Keywords: Abstract: Data

More information

ANALYTICS BUILT FOR INTERNET OF THINGS

ANALYTICS BUILT FOR INTERNET OF THINGS ANALYTICS BUILT FOR INTERNET OF THINGS Big Data Reporting is Out, Actionable Insights are In In recent years, it has become clear that data in itself has little relevance, it is the analysis of it that

More information

Big Data Analytics in Health Care

Big Data Analytics in Health Care Big Data Analytics in Health Care S. G. Nandhini 1, V. Lavanya 2, K.Vasantha Kokilam 3 1 13mss032, 2 13mss025, III. M.Sc (software systems), SRI KRISHNA ARTS AND SCIENCE COLLEGE, 3 Assistant Professor,

More information

BIG DATA IN BUSINESS ENVIRONMENT

BIG DATA IN BUSINESS ENVIRONMENT Scientific Bulletin Economic Sciences, Volume 14/ Issue 1 BIG DATA IN BUSINESS ENVIRONMENT Logica BANICA 1, Alina HAGIU 2 1 Faculty of Economics, University of Pitesti, Romania [email protected] 2 Faculty

More information

Big Data and Analytics in Government

Big Data and Analytics in Government Big Data and Analytics in Government Nov 29, 2012 Mark Johnson Director, Engineered Systems Program 2 Agenda What Big Data Is Government Big Data Use Cases Building a Complete Information Solution Conclusion

More information

Machina Research. Where is the value in IoT? IoT data and analytics may have an answer. Emil Berthelsen, Principal Analyst April 28, 2016

Machina Research. Where is the value in IoT? IoT data and analytics may have an answer. Emil Berthelsen, Principal Analyst April 28, 2016 Machina Research Where is the value in IoT? IoT data and analytics may have an answer Emil Berthelsen, Principal Analyst April 28, 2016 About Machina Research Machina Research is the world s leading provider

More information

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014 5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for

More information

Big Data Are You Ready? Jorge Plascencia Solution Architect Manager

Big Data Are You Ready? Jorge Plascencia Solution Architect Manager Big Data Are You Ready? Jorge Plascencia Solution Architect Manager Big Data: The Datafication Of Everything Thoughts Devices Processes Thoughts Things Processes Run the Business Organize data to do something

More information

The 4 Pillars of Technosoft s Big Data Practice

The 4 Pillars of Technosoft s Big Data Practice beyond possible Big Use End-user applications Big Analytics Visualisation tools Big Analytical tools Big management systems The 4 Pillars of Technosoft s Big Practice Overview Businesses have long managed

More information

The challenge of speed in healthcare as technology puts its foot on the accelerator

The challenge of speed in healthcare as technology puts its foot on the accelerator The challenge of speed: Healthcare About the research The report is based on a survey of 461 senior, Europe-based executives. Of these, 59 work in the healthcare sector, including hospitals, medical equipment

More information

CONNECTING DATA WITH BUSINESS

CONNECTING DATA WITH BUSINESS CONNECTING DATA WITH BUSINESS Big Data and Data Science consulting Business Value through Data Knowledge Synergic Partners is a specialized Big Data, Data Science and Data Engineering consultancy firm

More information

How To Turn Big Data Into An Insight

How To Turn Big Data Into An Insight mwd a d v i s o r s Turning Big Data into Big Insights Helena Schwenk A special report prepared for Actuate May 2013 This report is the fourth in a series and focuses principally on explaining what s needed

More information

Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013

Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Big Data & Analytics: Your concise guide (note the irony) Wednesday 27th November 2013 Housekeeping 1. Any questions coming out of today s presentation can be discussed in the bar this evening 2. OCF is

More information

MEDICAL DATA MINING. Timothy Hays, PhD. Health IT Strategy Executive Dynamics Research Corporation (DRC) December 13, 2012

MEDICAL DATA MINING. Timothy Hays, PhD. Health IT Strategy Executive Dynamics Research Corporation (DRC) December 13, 2012 MEDICAL DATA MINING Timothy Hays, PhD Health IT Strategy Executive Dynamics Research Corporation (DRC) December 13, 2012 2 Healthcare in America Is a VERY Large Domain with Enormous Opportunities for Data

More information

ANALYTICS STRATEGY: creating a roadmap for success

ANALYTICS STRATEGY: creating a roadmap for success ANALYTICS STRATEGY: creating a roadmap for success Companies in the capital and commodity markets are looking at analytics for opportunities to improve revenue and cost savings. Yet, many firms are struggling

More information

Big Data and New Paradigms in Information Management. Vladimir Videnovic Institute for Information Management

Big Data and New Paradigms in Information Management. Vladimir Videnovic Institute for Information Management Big Data and New Paradigms in Information Management Vladimir Videnovic Institute for Information Management 2 "I am certainly not an advocate for frequent and untried changes laws and institutions must

More information

The Importance of Analytics

The Importance of Analytics CIPHER Briefing The Importance of Analytics July 2014 Renting 1 machine for 1,000 hours will be nearly equivalent to renting 1,000 machines for 1 hour in the cloud. This will enable users and organizations

More information

Agenda. Big Data & Hadoop ViPR HDFS Pivotal Big Data Suite & ViPR HDFS ViON Customer Feedback #EMCVIPR

Agenda. Big Data & Hadoop ViPR HDFS Pivotal Big Data Suite & ViPR HDFS ViON Customer Feedback #EMCVIPR 1 Agenda Big Data & Hadoop ViPR HDFS Pivotal Big Data Suite & ViPR HDFS ViON Customer Feedback 2 A World of Connected Devices Need a new data management architecture for Internet of Things 21% the % of

More information

BIG DATA & ANALYTICS. Transforming the business and driving revenue through big data and analytics

BIG DATA & ANALYTICS. Transforming the business and driving revenue through big data and analytics BIG DATA & ANALYTICS Transforming the business and driving revenue through big data and analytics Collection, storage and extraction of business value from data generated from a variety of sources are

More information

Big Data 101: Harvest Real Value & Avoid Hollow Hype

Big Data 101: Harvest Real Value & Avoid Hollow Hype Big Data 101: Harvest Real Value & Avoid Hollow Hype 2 Executive Summary Odds are you are hearing the growing hype around the potential for big data to revolutionize our ability to assimilate and act on

More information

Understanding the Value of In-Memory in the IT Landscape

Understanding the Value of In-Memory in the IT Landscape February 2012 Understing the Value of In-Memory in Sponsored by QlikView Contents The Many Faces of In-Memory 1 The Meaning of In-Memory 2 The Data Analysis Value Chain Your Goals 3 Mapping Vendors to

More information

Using Tableau Software with Hortonworks Data Platform

Using Tableau Software with Hortonworks Data Platform Using Tableau Software with Hortonworks Data Platform September 2013 2013 Hortonworks Inc. http:// Modern businesses need to manage vast amounts of data, and in many cases they have accumulated this data

More information

Exploiting the power of Big Data

Exploiting the power of Big Data Exploiting the power of Big Data Timos Sellis School of Computer Science and Information Technology [email protected] ITECHLAW Asia-Pacific Conference, February 26-28, 2014 Melbourne Australia Timeline

More information

ezdi s semantics-enhanced linguistic, NLP, and ML approach for health informatics

ezdi s semantics-enhanced linguistic, NLP, and ML approach for health informatics ezdi s semantics-enhanced linguistic, NLP, and ML approach for health informatics Raxit Goswami*, Neil Shah* and Amit Sheth*, ** ezdi Inc, Louisville, KY and Ahmedabad, India. ** Kno.e.sis-Wright State

More information

Demystifying Big Data Government Agencies & The Big Data Phenomenon

Demystifying Big Data Government Agencies & The Big Data Phenomenon Demystifying Big Data Government Agencies & The Big Data Phenomenon Today s Discussion If you only remember four things 1 Intensifying business challenges coupled with an explosion in data have pushed

More information

locuz.com Big Data Services

locuz.com Big Data Services locuz.com Big Data Services Big Data At Locuz, we help the enterprise move from being a data-limited to a data-driven one, thereby enabling smarter, faster decisions that result in better business outcome.

More information

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.935.4445 F.508.988.7881 www.idc-hi.com

Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.935.4445 F.508.988.7881 www.idc-hi.com Global Headquarters: 5 Speen Street Framingham, MA 01701 USA P.508.935.4445 F.508.988.7881 www.idc-hi.com L e v e raging Big Data to Build a F o undation f o r Accountable Healthcare C U S T O M I N D

More information

Exploration and Visualization of Post-Market Data

Exploration and Visualization of Post-Market Data Exploration and Visualization of Post-Market Data Jianying Hu, PhD Joint work with David Gotz, Shahram Ebadollahi, Jimeng Sun, Fei Wang, Marianthi Markatou Healthcare Analytics Research IBM T.J. Watson

More information

Government Technology Trends to Watch in 2014: Big Data

Government Technology Trends to Watch in 2014: Big Data Government Technology Trends to Watch in 2014: Big Data OVERVIEW The federal government manages a wide variety of civilian, defense and intelligence programs and services, which both produce and require

More information

Johan Hallberg Research Manager / Industry Analyst IDC Nordic Services & Sourcing Digital Transformation Global CIO Agenda

Johan Hallberg Research Manager / Industry Analyst IDC Nordic Services & Sourcing Digital Transformation Global CIO Agenda IDC s Big Data Predictions 2015 Johan Hallberg Research Manager / Industry Analyst IDC Nordic Services & Sourcing Digital Transformation Global CIO Agenda Big Data Opportunity: The Need for Deep Personalization

More information

INTRAFOCUS. DATA VISUALISATION An Intrafocus Guide

INTRAFOCUS. DATA VISUALISATION An Intrafocus Guide DATA VISUALISATION An Intrafocus Guide September 2011 Table of Contents What is Data Visualisation?... 2 Where is Data Visualisation Used?... 3 The Market View... 4 What Should You Look For?... 5 The Key

More information

Accountable Care: Implications for Managing Health Information. Quality Healthcare Through Quality Information

Accountable Care: Implications for Managing Health Information. Quality Healthcare Through Quality Information Accountable Care: Implications for Managing Health Information Quality Healthcare Through Quality Information Introduction Healthcare is currently experiencing a critical shift: away from the current the

More information

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON

SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON SQLstream Blaze and Apache Storm A BENCHMARK COMPARISON 2 The V of Big Data Velocity means both how fast data is being produced and how fast the data must be processed to meet demand. Gartner The emergence

More information

Big Data a threat or a chance?

Big Data a threat or a chance? Big Data a threat or a chance? Helwig Hauser University of Bergen, Dept. of Informatics Big Data What is Big Data? well, lots of data, right? we come back to this in a moment. certainly, a buzz-word but

More information

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the

More information

PDF PREVIEW EMERGING TECHNOLOGIES. Applying Technologies for Social Media Data Analysis

PDF PREVIEW EMERGING TECHNOLOGIES. Applying Technologies for Social Media Data Analysis VOLUME 34 BEST PRACTICES IN BUSINESS INTELLIGENCE AND DATA WAREHOUSING FROM LEADING SOLUTION PROVIDERS AND EXPERTS PDF PREVIEW IN EMERGING TECHNOLOGIES POWERFUL CASE STUDIES AND LESSONS LEARNED FOCUSING

More information

Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges

Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges Managing Cloud Server with Big Data for Small, Medium Enterprises: Issues and Challenges Prerita Gupta Research Scholar, DAV College, Chandigarh Dr. Harmunish Taneja Department of Computer Science and

More information

Big Data and Analytics (Fall 2015)

Big Data and Analytics (Fall 2015) Big Data and Analytics (Fall 2015) Core/Elective: MS CS Elective MS SPM Elective Instructor: Dr. Tariq MAHMOOD Credit Hours: 3 Pre-requisite: All Core CS Courses (Knowledge of Data Mining is a Plus) Every

More information

Big Data Readiness. A QuantUniversity Whitepaper. 5 things to know before embarking on your first Big Data project

Big Data Readiness. A QuantUniversity Whitepaper. 5 things to know before embarking on your first Big Data project A QuantUniversity Whitepaper Big Data Readiness 5 things to know before embarking on your first Big Data project By, Sri Krishnamurthy, CFA, CAP Founder www.quantuniversity.com Summary: Interest in Big

More information

Transforming the Telecoms Business using Big Data and Analytics

Transforming the Telecoms Business using Big Data and Analytics Transforming the Telecoms Business using Big Data and Analytics Event: ICT Forum for HR Professionals Venue: Meikles Hotel, Harare, Zimbabwe Date: 19 th 21 st August 2015 AFRALTI 1 Objectives Describe

More information

A New Era Of Analytic

A New Era Of Analytic Penang egovernment Seminar 2014 A New Era Of Analytic Megat Anuar Idris Head, Project Delivery, Business Analytics & Big Data Agenda Overview of Big Data Case Studies on Big Data Big Data Technology Readiness

More information

Industry 4.0 and Big Data

Industry 4.0 and Big Data Industry 4.0 and Big Data Marek Obitko, [email protected] Senior Research Engineer 03/25/2015 PUBLIC PUBLIC - 5058-CO900H 2 Background Joint work with Czech Institute of Informatics, Robotics and

More information

Big Data Integration: A Buyer's Guide

Big Data Integration: A Buyer's Guide SEPTEMBER 2013 Buyer s Guide to Big Data Integration Sponsored by Contents Introduction 1 Challenges of Big Data Integration: New and Old 1 What You Need for Big Data Integration 3 Preferred Technology

More information

Ali Eghlima Ph.D Director of Bioinformatics. A Bioinformatics Research & Consulting Group

Ali Eghlima Ph.D Director of Bioinformatics. A Bioinformatics Research & Consulting Group A Bioinformatics Research & Consulting Group Adding Omics Data to Electronic Health Record, A paradigm Shift in Big Data Modeling, Analytics and Storage management for Healthcare and Life Sciences Organizations

More information

The Rise of Industrial Big Data

The Rise of Industrial Big Data GE Intelligent Platforms The Rise of Industrial Big Data Leveraging large time-series data sets to drive innovation, competitiveness and growth capitalizing on the big data opportunity The Rise of Industrial

More information

Where is... How do I get to...

Where is... How do I get to... Big Data, Fast Data, Spatial Data Making Sense of Location Data in a Smart City Hans Viehmann Product Manager EMEA ORACLE Corporation August 19, 2015 Copyright 2014, Oracle and/or its affiliates. All rights

More information

Unleash your intuition

Unleash your intuition Introducing Qlik Sense Unleash your intuition Qlik Sense is a next-generation self-service data visualization application that empowers everyone to easily create a range of flexible, interactive visualizations

More information

Data Refinery with Big Data Aspects

Data Refinery with Big Data Aspects International Journal of Information and Computation Technology. ISSN 0974-2239 Volume 3, Number 7 (2013), pp. 655-662 International Research Publications House http://www. irphouse.com /ijict.htm Data

More information

Luncheon Webinar Series May 13, 2013

Luncheon Webinar Series May 13, 2013 Luncheon Webinar Series May 13, 2013 InfoSphere DataStage is Big Data Integration Sponsored By: Presented by : Tony Curcio, InfoSphere Product Management 0 InfoSphere DataStage is Big Data Integration

More information

Sanjeev Kumar. contribute

Sanjeev Kumar. contribute RESEARCH ISSUES IN DATAA MINING Sanjeev Kumar I.A.S.R.I., Library Avenue, Pusa, New Delhi-110012 [email protected] 1. Introduction The field of data mining and knowledgee discovery is emerging as a

More information

Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep. Neil Raden Hired Brains Research, LLC

Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep. Neil Raden Hired Brains Research, LLC Data Catalogs for Hadoop Achieving Shared Knowledge and Re-usable Data Prep Neil Raden Hired Brains Research, LLC Traditionally, the job of gathering and integrating data for analytics fell on data warehouses.

More information

Complexity and Scalability in Semantic Graph Analysis Semantic Days 2013

Complexity and Scalability in Semantic Graph Analysis Semantic Days 2013 Complexity and Scalability in Semantic Graph Analysis Semantic Days 2013 James Maltby, Ph.D 1 Outline of Presentation Semantic Graph Analytics Database Architectures In-memory Semantic Database Formulation

More information

Healthcare, transportation,

Healthcare, transportation, Smart IT Argus456 Dreamstime.com From Data to Decisions: A Value Chain for Big Data H. Gilbert Miller and Peter Mork, Noblis Healthcare, transportation, finance, energy and resource conservation, environmental

More information

Indian Journal of Science The International Journal for Science ISSN 2319 7730 EISSN 2319 7749 2016 Discovery Publication. All Rights Reserved

Indian Journal of Science The International Journal for Science ISSN 2319 7730 EISSN 2319 7749 2016 Discovery Publication. All Rights Reserved Indian Journal of Science The International Journal for Science ISSN 2319 7730 EISSN 2319 7749 2016 Discovery Publication. All Rights Reserved Perspective Big Data Framework for Healthcare using Hadoop

More information

Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases

Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases Big Data and Transactional Databases Exploding Data Volume is Creating New Stresses on Traditional Transactional Databases Introduction The world is awash in data and turning that data into actionable

More information

Turning Big Data into Big Decisions Delivering on the High Demand for Data

Turning Big Data into Big Decisions Delivering on the High Demand for Data Turning Big Data into Big Decisions Delivering on the High Demand for Data Michael Ho, Vice President of Professional Services Digital Government Institute s Government Big Data Conference, October 31,

More information

TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP

TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP Pythian White Paper TAMING THE BIG CHALLENGE OF BIG DATA MICROSOFT HADOOP ABSTRACT As companies increasingly rely on big data to steer decisions, they also find themselves looking for ways to simplify

More information

BEYOND BI: Big Data Analytic Use Cases

BEYOND BI: Big Data Analytic Use Cases BEYOND BI: Big Data Analytic Use Cases Big Data Analytics Use Cases This white paper discusses the types and characteristics of big data analytics use cases, how they differ from traditional business intelligence

More information

Think bigger about business intelligence create an informed healthcare organization.

Think bigger about business intelligence create an informed healthcare organization. KNOWLEDGE DRIVEN HEALTH Think bigger about business intelligence create an informed healthcare organization. Help every healthcare professional contribute to better decision making. Help everyone in your

More information

SQL Server 2012 Parallel Data Warehouse. Solution Brief

SQL Server 2012 Parallel Data Warehouse. Solution Brief SQL Server 2012 Parallel Data Warehouse Solution Brief Published February 22, 2013 Contents Introduction... 1 Microsoft Platform: Windows Server and SQL Server... 2 SQL Server 2012 Parallel Data Warehouse...

More information

A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data

A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data White Paper A Visualization is Worth a Thousand Tables: How IBM Business Analytics Lets Users See Big Data Contents Executive Summary....2 Introduction....3 Too much data, not enough information....3 Only

More information

Business Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? PTR Associates Limited

Business Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? PTR Associates Limited Business Benefits From Microsoft SQL Server Business Intelligence Solutions How Can Business Intelligence Help You? www.ptr.co.uk Business Benefits From Microsoft SQL Server Business Intelligence (September

More information

Big Data and Complex Networks Analytics. Timos Sellis, CSIT Kathy Horadam, MGS

Big Data and Complex Networks Analytics. Timos Sellis, CSIT Kathy Horadam, MGS Big Data and Complex Networks Analytics Timos Sellis, CSIT Kathy Horadam, MGS Big Data What is it? Most commonly accepted definition, by Gartner (the 3 Vs) Big data is high-volume, high-velocity and high-variety

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON BIG DATA ISSUES AMRINDER KAUR Assistant Professor, Department of Computer

More information

Banking On A Customer-Centric Approach To Data

Banking On A Customer-Centric Approach To Data Banking On A Customer-Centric Approach To Data Putting Content into Context to Enhance Customer Lifetime Value No matter which company they interact with, consumers today have far greater expectations

More information

Bringing Big Data to Personalized Healthcare: A Patient-Centered Framework. Nitesh Chawla, PhD (c)

Bringing Big Data to Personalized Healthcare: A Patient-Centered Framework. Nitesh Chawla, PhD (c) Bringing Big Data to Personalized Healthcare: A Patient-Centered Framework Government Administration 1% Retail - Other products 3% Net cost of health insurance 6% Govt. public health activities 3% Investment

More information

Cincom Business Intelligence Solutions

Cincom Business Intelligence Solutions CincomBI Cincom Business Intelligence Solutions Business Users Overview Find the perfect answers to your strategic business questions. SIMPLIFICATION THROUGH INNOVATION Introduction Being able to make

More information

CHALLENGES OF EVOLVING PINCLOUD PHR INTO A PHR-BASED HEALTH ANALYTICS SYSTEM

CHALLENGES OF EVOLVING PINCLOUD PHR INTO A PHR-BASED HEALTH ANALYTICS SYSTEM CHALLENGES OF EVOLVING PINCLOUD PHR INTO A PHR-BASED HEALTH ANALYTICS SYSTEM Abstract M. Poulymenopoulou, F. Malamateniou, A. Prentza and G. Vassilacopoulos Department of Digital Systems, University of

More information

Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014

Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014 What is Big Data? Of all the data in recorded human history, 90 percent has been created in the last two years. - Mark van Rijmenam, Think Bigger, 2014 Data in the Twentieth Century and before In 1663,

More information

Vinay Parisa 1, Biswajit Mohapatra 2 ;

Vinay Parisa 1, Biswajit Mohapatra 2 ; Predictive Analytics for Enterprise Modernization Vinay Parisa 1, Biswajit Mohapatra 2 ; IBM Global Business Services, IBM India Pvt Ltd 1, IBM Global Business Services, IBM India Pvt Ltd 2 [email protected]

More information

Challenges for Data Driven Systems

Challenges for Data Driven Systems Challenges for Data Driven Systems Eiko Yoneki University of Cambridge Computer Laboratory Quick History of Data Management 4000 B C Manual recording From tablets to papyrus to paper A. Payberah 2014 2

More information

Information Visualization WS 2013/14 11 Visual Analytics

Information Visualization WS 2013/14 11 Visual Analytics 1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and

More information

The University of Jordan

The University of Jordan The University of Jordan Master in Web Intelligence Non Thesis Department of Business Information Technology King Abdullah II School for Information Technology The University of Jordan 1 STUDY PLAN MASTER'S

More information

Big Data at Cloud Scale

Big Data at Cloud Scale Big Data at Cloud Scale Pushing the limits of flexible & powerful analytics Copyright 2015 Pentaho Corporation. Redistribution permitted. All trademarks are the property of their respective owners. For

More information

Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com

Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com Big Data Are You Ready? Thomas Kyte http://asktom.oracle.com The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated

More information

Putting IBM Watson to Work In Healthcare

Putting IBM Watson to Work In Healthcare Martin S. Kohn, MD, MS, FACEP, FACPE Chief Medical Scientist, Care Delivery Systems IBM Research [email protected] Putting IBM Watson to Work In Healthcare 2 SB 1275 Medical data in an electronic or

More information

MED 2400 MEDICAL INFORMATICS FUNDAMENTALS

MED 2400 MEDICAL INFORMATICS FUNDAMENTALS MED 2400 MEDICAL INFORMATICS FUNDAMENTALS NEW YORK CITY COLLEGE OF TECHNOLOGY The City University Of New York School of Arts and Sciences Biological Sciences Department Course title: Course code: MED 2400

More information

Big Data and Your Data Warehouse Philip Russom

Big Data and Your Data Warehouse Philip Russom Big Data and Your Data Warehouse Philip Russom TDWI Research Director for Data Management April 5, 2012 Sponsor Speakers Philip Russom Research Director, Data Management, TDWI Peter Jeffcock Director,

More information

QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM

QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM QLIKVIEW DEPLOYMENT FOR BIG DATA ANALYTICS AT KING.COM QlikView Technical Case Study Series Big Data June 2012 qlikview.com Introduction This QlikView technical case study focuses on the QlikView deployment

More information

COULD VS. SHOULD: BALANCING BIG DATA AND ANALYTICS TECHNOLOGY WITH PRACTICAL OUTCOMES

COULD VS. SHOULD: BALANCING BIG DATA AND ANALYTICS TECHNOLOGY WITH PRACTICAL OUTCOMES COULD VS. SHOULD: BALANCING BIG DATA AND ANALYTICS TECHNOLOGY The business world is abuzz with the potential of data. In fact, most businesses have so much data that it is difficult for them to process

More information

Innovating for Health The Intelligent EHR

Innovating for Health The Intelligent EHR Patients and families Patients in mind Patients in your heart Innovating for Health The Intelligent EHR Kunnskapssenteret Kvalitetsindikatorer baset pa data fra medisinske kvalitetsregistre will be the

More information

Find the signal in the noise

Find the signal in the noise Find the signal in the noise Electronic Health Records: The challenge The adoption of Electronic Health Records (EHRs) in the USA is rapidly increasing, due to the Health Information Technology and Clinical

More information

Client Overview. Engagement Situation. Key Requirements

Client Overview. Engagement Situation. Key Requirements Client Overview Our client is one of the leading providers of business intelligence systems for customers especially in BFSI space that needs intensive data analysis of huge amounts of data for their decision

More information

Optimized Hadoop for Enterprise

Optimized Hadoop for Enterprise Optimized Hadoop for Enterprise Smart Big data Platform provides Reliability, Security, and Ease of Use + Big Data, Valuable Resource for Forecasting the Future of Businesses + Offers integrated and end-to-end

More information

How To Learn To Use Big Data

How To Learn To Use Big Data Information Technologies Programs Big Data Specialized Studies Accelerate Your Career extension.uci.edu/bigdata Offered in partnership with University of California, Irvine Extension s professional certificate

More information