Language Technology for Big Data Analytics

Size: px
Start display at page:

Download "Language Technology for Big Data Analytics"

Transcription

1 Connecting Europe for New Horizons Berlin, 20 September 2013 Language Technology for Big Data Analytics Wolfgang Wahlster Saarbrücken, Kaiserslautern, Bremen, Berlin, Osnabrück Phone: +49 (681) / WWW:

2 Big Data: Data as Tradeable Assets Sensor Data for Weather, Climate, Smart City and Smart Home 3D-Internet-Data and Media Streams Production and Machine Data from Industry 4.0 Mass Data from Individualized Medicine, from Genom Analysis and Imaging Methods Mass Data from Smart Grid and Smart Metering Financial Messaging Data Supervision of Banks, Stock Exchange and High Speed Trade Life Log Data for Individuals and Objects Digital Product Memories Mass Data from Mobility by Car2Car-Communication and Logs from Single Vehicles Mass Data from Social Networks 95% of 1.2 zettabyte worldwide digital data are unstructured with a data growth of 62% per year.

3 Outline of the Talk 1.Human- and Machine-generated Big Data 2.Major German and European Big Data Initiatives 3.The Role of Language Technology for Big Data Analytics 4. The Need for Real-Time NL Analysis and Generation for Application Impact 5. Conclusion

4 Development of Global Data Volumes by 2020 (in Zettabyte) Source: AT Kearney 2013 : Mainly Machine-Generated Data, but also encoded in Natural Language for Human Inspection, Multilingual Natural Language Generation becomes more and more important

5 Human-Generated Internet Content: Zettabyte of Unstructured BIG Data Exponential Growth of Internet Data: Commercial Spoken Language Access: New Tweets 48 Hours Videos uploaded Siri (Apple) Google Now (Google) S Voice (Samsung) Cortana (Microsoft) Still Missing: Crosslingual Information Retrieval More than 2 Million Queries 3125 new Photos uploaded messages Every Minute 571 new homepages Apps new s send

6 From DB to BD: New BIG DATA Services New Services based on Cloud Nets Decision Support, Prediction, Simulation, Knowledge Discovery, Information Trading, Fusion, Optimization, Modeling Machine Learning Multimodal Interaction Information Extraction from Text and Video Language Technology as a Key Enabler for BIG DATA Analytics Lower degree of Structure unstructured structured BIG DATA Databases, Data Warehouses, WWW =EXA - ZETTA=10 21 New Data Material Low Information Density Less used for ICT =GIGA - PETA=10 15 Classical Data Material High Information Density Much used for ICT Complexity

7 The Era of BIG DATA: Increasing Importance of Real-Time Natural Language Processing Digital Data ~ 1960 Data Warehousing ~1980 Data Mining ~1990 Big Data Analytics Today Digital data collection First databases Data cubes Relational databases Financial data Statistics Artificial Intelligence Machine learning Knowledge discovery Unstructured data Stream processing Smart Data Engineering Collective intelligence Massively distributed analytics NoSQL databases Heterogeneous data and knowledge Petabytes and Zettabytes of data Documentation Enterprise Management Process Optimization Real-time Decision Support and Control Adapted from Siemens

8 Focus of Data Analytics Is Changing from Description of Past to Decision Support of Today Value & Complexity Act Inform Descriptive Analytics Analyze Diagnostic Analytics Predictive Analytics Prescriptive Analytics What happened? Why did it happen? What will happen? What shall we do? Current penetration across all industries (according to Gartner 2013) Adopt by vast Adopted by Still few majority but not 99% all data 30% minorities 13% adopters 3% Very few early adopters Adapted from Siemens

9 The Processing Cycle for BIG DATA Language Technology Search for BIG DATA Sources Linked Data Potential Data Fusion Potential Sensor Selection and Sensor Positioning Search for Open Data Sources and Streams BIG DATA Collection Unstructured Data Multimodal Data Uncertain Data Complex Events Sensor Data Data Streams Deep Web Data BIG DATA Analysis Data Cleansing Information Extraction Semantic Analysis Sentiment Analysis Data Correlation Pattern Recognition Real-Time Analytics Machine Learning BIG DATA Exploitation Decision Support in Real Time Prediction Simulation Exploration Modeling Monitoring, Alerting, Reporting Controlling Smart Data Engineering BIG DATA Maintenance Backtracing Data Origins Data Enrichment Annotation and Tagging Data Validation Redundancy Avoidance Consistency Checking Inference & Abstraction Data Storage & Retrieval In-Memory Technologies HANA, TERRACOTTA Column Databases NoSQL Cloud Storage Densification Technology Aggregation Procedures Compression Techniques

10 Preparation of Second ICT Future Project for German Chancellor ( M funding, Start 2014): for Smart Services : Internet-based Services for Economy Business Designer Cloud Infrastructure Clerk BPaaS: Business Process as a Service SaaS: Software as a Service PaaS: Plattform as a Service IaaS: Infrastructure as a Service KaaS: Knowledge as a Service BDaaS: Big Data as a Service Knowledge Worker Application Developer System Administrator Increased Value Creation Virtualization Chain 1 Hardware 2 Software 3 Information & Knowledge (Big Data) Quelle: DFKI

11 German BIG DATA Conferences First National Conference 3 June 2013, Berlin BIG DATA: Exploring Data Treasures in Science and Industry BIG DATA Summit 24 June 2013, Bonn Second National Conference November 2013, Berlin BIG DATA: Potentials for Germany 10 December 2013, Hamburg BIG DATA Platform CEO Forum

12 German BIG DATA Funding Programms 2-3 National BIG DATA Competence Centers Submission Deadline: 12 July Years Perspective Application Oriented Basic Research Finalist Selection: 12 Sept. 2013, Senior Expert Jury: November 2013 Annoucment: IT Summit, 10 Dec 2013 Consortia Projects between Industry and Academia Submission Deadline: 12 July 2013 Applied Research Consortia Projects between Industry and Academia Program Announcement: November 2013 Emphasis on SME Involvement

13 BIG coordination and support action EU consortium (11 partners, including ATOS) The goal is to help EC define a roadmap for Big Data Technologies for Horizon 2020! Strategic Director: Wolfgang Wahlster, DFKI

14 Key facts about BIG Project Type of project: CSA Project start date: September 2012 Duration: 26 months Call: FP7-ICT Effort: 552,5 PM Budget: 3,038 M Max EC contribution: 2,499 M Consortium: 11 partners

15 Major Activities of the BIG Forum Identification of Sector s requisites Requirements and objectives from all Sectors Industry-driven sector forums Applicability of Big Data technology in each Sector Big Data technologies and its capabilities Technical Working Groups Technical White Papers Elaboration of Sector Roadmap Sectorial roadmap (elaborate a roadmap per sector). Contributions towards integrated roadmap (cross-sectorial)

16 Social Media Analysis: BIG DATA NLP and Sentiment Analysis by the DFKI Spin-Off The Net elects Analyzing Twitter and Facebook feeds for German Federal elections 2013, 22 September Analyze for candidates, parties, and top tweets Online feature of German weekly magazine Wirtschafts-Woche, powered by Attensity

17 Social Media Analysis: BIG DATA NLP and Sentiment Analysis by the DFKI Spin-Off Selection of 10,000 Tweets from 400 Million every day + 17,000 Facebook entries per week Advanced NLP: Negation analysis Analysis of counterfactuals And comparatives

18 Example of Technology Transfer via Brains Massimo Romanelli

19 Multilingual Tweet Analysis for Desaster Management 11 March 2011, Fukushima Users broadcast their experience immediately, number of tweets increases immediately after the earthquake and tsunami: 1.5 Million Twitter messages were analyzed by Collier and his group (cf. An analysis of Twitter messages in the 2011 Tohoku Earthquake: Son Doan, Bao-Khanh Ho Vo, and Nigel Collier, National Institute of Informatics) The first Japanese tweets on the earthquake are as follows: T05:48:08 " 地 震!" [Earthquake!] T05:48:08 " 地 震 だ 縦 揺 れ!" [Earthquake ~ ver;cal shake!] T05:48:14 " 地 震!!!!" [Earthquake!!!!] First two English tweets send from an iphone: T05:48:54 Huge earthquake in TK we are affected! T05:49:01 BIG EARTHQUAKE!!! T05:50:00 Massive quake in Tokyo Challenge: Post-hoc Analysis must be turned into Real-Time Analysis The first tweet about a tsunami was an eye witness tweet 6 minutes after the earthquake occurred at its epicentre: T 05:52:23 "オレ 津 波 の 様 子 見 てくるわ!!!!" [I can see tsunami is coming!!!!] The first concerns about nuclear plants right after the earthquake T09:50:49 " 福 島 原 発 ヤバい 状 況 らしい" [The Fukushima plant is in a really bad situa;on.]

20 BioCaster: Early Alerting for Public Health Events - detects seasonal influenza and hay fever. Event database search Trend graphs Ontology browsing /GeoRSS alerting Up to date news in m u l t i p l e languages Event maps WHO IT JP CA GHSAG partners US UK FR DE Event alerts born.nii.ac.jp: Real-time Twitter analysis

21 Alignment of European and German National Projects Dealing with BIG DATA PPPs BIG DATA PPP Forum Chair of Advisory Committee Strategic Director

22 European and German Software Platforms for BIG DATA Processing Generic Enabler for BIG DATA for batch and online stream processing of BIG DATA BigMemory MAX: Real-time Access to 100s of TBs BIG DATA Platform with up 250 TBs in-memory data bases: SAP HANA Open-source cluster/cloud computing framework for BIG DATA analytics

23 BIG DATA Generic Enabler of the FI-PPP The key technical concept of the FI-PPP is the provisioning of Generic Service Platforms supported by reusable, standardized and commonly shared key technologies and components which shall be termed Generic Enablers, which can be applied by a multiplicity of Smart Application usage domains across multiple sectors. FI-WARE Catalogue Future Internet Smart Application Generic Enabler 1 Generic Enabler 2 Complex Event Generic Enabler FI-WARE Instance Generic Enabler 4 Cloud Generic Enabler Generic Enabler 6 BIG DATA Generic Enabler Generic Enabler 8 Generic Enabler N assemble BIG Data Generic Enabler Streaming and batch processing functionalities both in one single platform. Automatic deployment capabilities in a cloud-based cluster of nodes. Wide range of available data injectors. High speed access to the resulting insights via a NoSQL database.

24 The Vision and Mission of FI-PPP FI-WARE Catalogue FI-WARE Open Innovation Lab FI-WARE Shared Trial Facility Specific Use Case Trial Facility The FI-PPP promotes and enables large-scale experimentation and validation of the platforms in real-life application contexts involving a range of actors across domains, including large companies, SMEs, the research community as well as public administrations and citizens. The open platform approach further creates novel opportunities for entrepreneurship, new businesses and innovative value creation models based on cross-sector industrial partnerships. 24

25 BIG DATA Analytics for Financial Fraud Detection and Prevention Use of the Terracotta Platform of DFKI Shareholder Software AG Mitigated 100s of millions in fraudulent credit card transactions Reduced fraud detection processing time from 45 minutes to less than 4 seconds NLP Analysis of Sales Items 99,999% completed transactions with fraud detection rules checked Reduced fraud processing time from 800 ms to less than 20 ms

26 New Business Models of DHL Exploiting BIG DATA Collected by their Employees during the Delivery of Parcels GEOVISTA: BIG DATA TOOL for estimating earnings opportunities and analyzing business potential. Dr. Helbig, CIO of DHL Prepare a realistic sales forecast Evaluate a desired location by using high-quality geodata and NLP CRM reports provided by the subsidiary Deutsche Post Direct. Local competitors are analyzed with the aid of up-to-date data provided by bedirect. Visualization of business-location factors and the area being studied are presented on a digital map.

27 BIG DATA Analytics for Intelligent Urban Management Trento EIT ICT Labs DFKI GmbH

28 DFKI Is a Founding Core Partner of EIT ICT Labs and Has a Strong Collaboration with the Trento Node Trentino Open Living Data (TOLD) The action line leader for Intelligent Mobility and Transportation systems is Dr. Christian Müller from DFKI

29 Living Big Data: The Trentino Territory as a BIG DATA Lab Transportation Energy Telecommunication

30 EIT ICT Labs Business Framework for BIG DATA at Trento Rise

31 DFKI s Social Media BIG DATA Analytics App for Crowd Management London Lord Mayor s Show, Olympics 2012 Coronation of the new Dutch King, 30 April 2013

32 Conclusions 1.Big data technologies are an innovation motor for industry, science and government. Real-Time Multilingual Natural Language Analysis and Generation as well as Translation Technologies are a Key Enabler for Big Data Analytics. 2. Key research challenges are smart tools for real-time analytics and decision support based on intelligent information extraction from unstructured data. 3. Europe s and in particular Germany s strength in big data technology are commercial in-memory computing platforms like Hana or Terracotta and open-source platforms like FI-Ware GEs and Stratosphere and multilingual language technologies. 4. In Germany, the focus is on big data applications for Industry 4.0, smart grids, advanced mobility and personalized medicine.

33 Thank you very much for your a0en1on. Design by R.O.

Sustainable Technology Transfer: The German Way

Sustainable Technology Transfer: The German Way Transfer of Technology Stream Dublin, Wednesday 8th May Sustainable Technology Transfer: The German Way Prof. Dr. Wolfgang Wahlster CEO and Scientific Director of the German Research Center for AI, DFKI

More information

From Big Data to Smart Data Thomas Hahn

From Big Data to Smart Data Thomas Hahn Siemens Future Forum @ HANNOVER MESSE 2014 From Big to Smart Hannover Messe 2014 The Evolution of Big Digital data ~ 1960 warehousing ~1986 ~1993 Big data analytics Mining ~2015 Stream processing Digital

More information

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS.

HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. HOW TO MAKE SENSE OF BIG DATA TO BETTER DRIVE BUSINESS PROCESSES, IMPROVE DECISION-MAKING, AND SUCCESSFULLY COMPETE IN TODAY S MARKETS. ALTILIA turns Big Data into Smart Data and enables businesses to

More information

BIG DATA PUBLIC PRIVATE FORUM

BIG DATA PUBLIC PRIVATE FORUM BIG DATA PUBLIC PRIVATE FORUM Agenda 09:00-10:30 9:00-9:20 9:20-9:55 9:55-10:30 The Big Project Results (Session 1) - The Big Project - Welcome and Introduction Nuria De Lama (ATOS Spain) - Key Technology

More information

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014

5 Keys to Unlocking the Big Data Analytics Puzzle. Anurag Tandon Director, Product Marketing March 26, 2014 5 Keys to Unlocking the Big Data Analytics Puzzle Anurag Tandon Director, Product Marketing March 26, 2014 1 A Little About Us A global footprint. A proven innovator. A leader in enterprise analytics for

More information

BIG Big Data Public Private Forum

BIG Big Data Public Private Forum DATA STORAGE Martin Strohbach, AGT International (R&D) THE DATA VALUE CHAIN Value Chain Data Acquisition Data Analysis Data Curation Data Storage Data Usage Structured data Unstructured data Event processing

More information

Text Analytics and Big Data

Text Analytics and Big Data Text Analytics and Big Data META-FORUM 2012 Brussels, 20 th June 2012 Atos Research & Innovation 1 Table of Contents 1. Atos and why we are here 2. Examples 3. BIG: Big Data Public Private Forum 2 2 Atos:

More information

BIG. Big Data Analysis John Domingue (STI International and The Open University) Big Data Public Private Forum

BIG. Big Data Analysis John Domingue (STI International and The Open University) Big Data Public Private Forum Big Data Analysis John Domingue (STI International and The Open University) Project co-funded by the European Commission within the 7th Framework Program (Grant Agreement No. 257943) 1 The Data landscape

More information

Internet of Things Value Proposition for Europe

Internet of Things Value Proposition for Europe Internet of Things Value Proposition for Europe European Commission - DG CONNECT Dr Florent Frederix, (Online) Trust and Cybersecurity unit 7 th European Conference on ICT for Transport Logistics 5 th

More information

Exploiting Data at Rest and Data in Motion with a Big Data Platform

Exploiting Data at Rest and Data in Motion with a Big Data Platform Exploiting Data at Rest and Data in Motion with a Big Data Platform Sarah Brader, sarah_brader@uk.ibm.com What is Big Data? Where does it come from? 12+ TBs of tweet data every day 30 billion RFID tags

More information

Towards a Thriving Data Economy: Open Data, Big Data, and Data Ecosystems

Towards a Thriving Data Economy: Open Data, Big Data, and Data Ecosystems Towards a Thriving Data Economy: Open Data, Big Data, and Data Ecosystems Volker Markl volker.markl@tu-berlin.de dima.tu-berlin.de dfki.de/web/research/iam/ bbdc.berlin Based on my 2014 Vision Paper On

More information

The Next Wave of Data Management. Is Big Data The New Normal?

The Next Wave of Data Management. Is Big Data The New Normal? The Next Wave of Data Management Is Big Data The New Normal? Table of Contents Introduction 3 Separating Reality and Hype 3 Why Are Firms Making IT Investments In Big Data? 4 Trends In Data Management

More information

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services

Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012. Viswa Sharma Solutions Architect Tata Consultancy Services Hadoop Beyond Hype: Complex Adaptive Systems Conference Nov 16, 2012 Viswa Sharma Solutions Architect Tata Consultancy Services 1 Agenda What is Hadoop Why Hadoop? The Net Generation is here Sizing the

More information

How can the Future Internet enable Smart Energy?

How can the Future Internet enable Smart Energy? How can the Future Internet enable Smart Energy? FINSENY overview presentation on achieved results Prepared by the FINSENY PMT April 2013 Outline Motivation and basic requirements FI-PPP approach FINSENY

More information

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA

Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA http://kzhang6.people.uic.edu/tutorial/amcis2014.html August 7, 2014 Schedule I. Introduction to big data

More information

Computer-Based Text- and Data Analysis Technologies and Applications. Mark Cieliebak 9.6.2015

Computer-Based Text- and Data Analysis Technologies and Applications. Mark Cieliebak 9.6.2015 Computer-Based Text- and Data Analysis Technologies and Applications Mark Cieliebak 9.6.2015 Data Scientist analyze Data Library use 2 About Me Mark Cieliebak + Software Engineer & Data Scientist + PhD

More information

Big Data and Healthcare Payers WHITE PAPER

Big Data and Healthcare Payers WHITE PAPER Knowledgent White Paper Series Big Data and Healthcare Payers WHITE PAPER Summary With the implementation of the Affordable Care Act, the transition to a more member-centric relationship model, and other

More information

Aligning Your Strategic Initiatives with a Realistic Big Data Analytics Roadmap

Aligning Your Strategic Initiatives with a Realistic Big Data Analytics Roadmap Aligning Your Strategic Initiatives with a Realistic Big Data Analytics Roadmap 3 key strategic advantages, and a realistic roadmap for what you really need, and when 2012, Cognizant Topics to be discussed

More information

BIG DATA: STORAGE, ANALYSIS AND IMPACT GEDIMINAS ŽYLIUS

BIG DATA: STORAGE, ANALYSIS AND IMPACT GEDIMINAS ŽYLIUS BIG DATA: STORAGE, ANALYSIS AND IMPACT GEDIMINAS ŽYLIUS WHAT IS BIG DATA? describes any voluminous amount of structured, semi-structured and unstructured data that has the potential to be mined for information

More information

Beyond Watson: The Business Implications of Big Data

Beyond Watson: The Business Implications of Big Data Beyond Watson: The Business Implications of Big Data Shankar Venkataraman IBM Program Director, STSM, Big Data August 10, 2011 The World is Changing and Becoming More INSTRUMENTED INTERCONNECTED INTELLIGENT

More information

Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution

Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Sustainable Development with Geospatial Information Leveraging the Data and Technology Revolution Steven Hagan, Vice President, Server Technologies 1 Copyright 2011, Oracle and/or its affiliates. All rights

More information

The Future of Communication

The Future of Communication Future Technologies I: Communication Session 2 Hannover, 3 November 2010 The Future of Communication Wolfgang Wahlster German Research Center for Artificial Intelligence Saarbrücken, Kaiserslautern, Bremen,

More information

Big Data Challenges and Success Factors. Deloitte Analytics Your data, inside out

Big Data Challenges and Success Factors. Deloitte Analytics Your data, inside out Big Data Challenges and Success Factors Deloitte Analytics Your data, inside out Big Data refers to the set of problems and subsequent technologies developed to solve them that are hard or expensive to

More information

Smart Data THE driving force for industrial applications

Smart Data THE driving force for industrial applications Smart Data THE driving force for industrial applications European Data Forum Luxembourg, siemens.com The world is becoming digital User behavior is radically changing based on new business models Newspaper,

More information

FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA. Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region

FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA. Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region FOR A FEW TERABYTES MORE THE GOOD, THE BAD and THE BIG DATA Cenk Kiral Senior Director of BI&EPM solutions ECEMEA region Big Data Buzz The promise of big data Intelligent Utility - 8/28/11 Big data, analytics

More information

The future of Big Data A United Hitachi View

The future of Big Data A United Hitachi View The future of Big Data A United Hitachi View Alex van Die Pre-Sales Consultant 1 Oktober 2014 1 Agenda Evolutie van Data en Analytics Internet of Things Hitachi Social Innovation Vision and Solutions 2

More information

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research &

BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & BIG DATA Alignment of Supply & Demand Nuria de Lama Representative of Atos Research & Innovation 04-08-2011 to the EC 8 th February, Luxembourg Your Atos business Research technologists. and Innovation

More information

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith Now, Next and the Future: IT, Big Data and other Implications for RIM Agenda for This Afternoon Now: What trends are creating implications within the profession? Next: Why is IT now concerned about RIM?

More information

Are You Ready for Big Data?

Are You Ready for Big Data? Are You Ready for Big Data? Jim Gallo National Director, Business Analytics April 10, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?

More information

Big Data & Security. Aljosa Pasic 12/02/2015

Big Data & Security. Aljosa Pasic 12/02/2015 Big Data & Security Aljosa Pasic 12/02/2015 Welcome to Madrid!!! Big Data AND security: what is there on our minds? Big Data tools and technologies Big Data T&T chain and security/privacy concern mappings

More information

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract

W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and the

More information

Big Data Buzzwords From A to Z. By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012

Big Data Buzzwords From A to Z. By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012 Big Data Buzzwords From A to Z By Rick Whiting, CRN 4:00 PM ET Wed. Nov. 28, 2012 Big Data Buzzwords Big data is one of the, well, biggest trends in IT today, and it has spawned a whole new generation

More information

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop

International Journal of Advanced Engineering Research and Applications (IJAERA) ISSN: 2454-2377 Vol. 1, Issue 6, October 2015. Big Data and Hadoop ISSN: 2454-2377, October 2015 Big Data and Hadoop Simmi Bagga 1 Satinder Kaur 2 1 Assistant Professor, Sant Hira Dass Kanya MahaVidyalaya, Kala Sanghian, Distt Kpt. INDIA E-mail: simmibagga12@gmail.com

More information

Kimmo Rossi. European Commission DG CONNECT

Kimmo Rossi. European Commission DG CONNECT Kimmo Rossi European Commission DG CONNECT Unit G.3 - Data Value Chain SC1 info day, Brussels 5/12/2014 1 What we do Unit CNECT.G3 Data Value Chain FP7/CIP/H2020 project portfolio: Big Data, analytics,

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

FITMAN Future Internet Enablers for the Sensing Enterprise: A FIWARE Approach & Industrial Trialing

FITMAN Future Internet Enablers for the Sensing Enterprise: A FIWARE Approach & Industrial Trialing FITMAN Future Internet Enablers for the Sensing Enterprise: A FIWARE Approach & Industrial Trialing Oscar Lazaro. olazaro@innovalia.org Ainara Gonzalez agonzalez@innovalia.org June Sola jsola@innovalia.org

More information

Doing Multidisciplinary Research in Data Science

Doing Multidisciplinary Research in Data Science Doing Multidisciplinary Research in Data Science Assoc.Prof. Abzetdin ADAMOV CeDAWI - Center for Data Analytics and Web Insights Qafqaz University aadamov@qu.edu.az http://ce.qu.edu.az/~aadamov 16 May

More information

Big Data. Fast Forward. Putting data to productive use

Big Data. Fast Forward. Putting data to productive use Big Data Putting data to productive use Fast Forward What is big data, and why should you care? Get familiar with big data terminology, technologies, and techniques. Getting started with big data to realize

More information

Mohan Sawhney Robert R. McCormick Tribune Foundation Clinical Professor of Technology Kellogg School of Management mohans@kellogg.northwestern.

Mohan Sawhney Robert R. McCormick Tribune Foundation Clinical Professor of Technology Kellogg School of Management mohans@kellogg.northwestern. Mohan Sawhney Robert R. McCormick Tribune Foundation Clinical Professor of Technology Kellogg School of Management mohans@kellogg.northwestern.edu Transportation Center Business Advisory Committee Meeting

More information

SAP HANA Vora : Gain Contextual Awareness for a Smarter Digital Enterprise

SAP HANA Vora : Gain Contextual Awareness for a Smarter Digital Enterprise Frequently Asked Questions SAP HANA Vora SAP HANA Vora : Gain Contextual Awareness for a Smarter Digital Enterprise SAP HANA Vora software enables digital businesses to innovate and compete through in-the-moment

More information

12/7/2015. Data Science Master s programs

12/7/2015. Data Science Master s programs Data Science Master s programs 1 1 Who are we? Willem-Jan van den Heuvel Tilburg University Ksenia Podoynitsyna Eindhoven University of Technology 2 2 Program What is Data Science? The Data Science Initiative

More information

What do Big Data & HAVEn mean? Robert Lejnert HP Autonomy

What do Big Data & HAVEn mean? Robert Lejnert HP Autonomy What do Big Data & HAVEn mean? Robert Lejnert HP Autonomy Much higher Volumes. Processed with more Velocity. With much more Variety. Is Big Data so big? Big Data Smart Data Project HAVEn: Adaptive Intelligence

More information

Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome

Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Enhance Collaboration and Data Sharing for Faster Decisions and Improved Mission Outcome Richard Breakiron Senior Director, Cyber Solutions Rbreakiron@vion.com Office: 571-353-6127 / Cell: 803-443-8002

More information

Intelligent Business Operations

Intelligent Business Operations Intelligent Business Operations Echtzeit-Datenanalyse und Aktionen im Zusammenspiel Dr. Jürgen Krämer VP Product Strategy IBO & Product Management Apama 23.06.2014 Helping Organizations Transform into

More information

End to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ

End to End Solution to Accelerate Data Warehouse Optimization. Franco Flore Alliance Sales Director - APJ End to End Solution to Accelerate Data Warehouse Optimization Franco Flore Alliance Sales Director - APJ Big Data Is Driving Key Business Initiatives Increase profitability, innovation, customer satisfaction,

More information

Why big data? Lessons from a Decade+ Experiment in Big Data

Why big data? Lessons from a Decade+ Experiment in Big Data Why big data? Lessons from a Decade+ Experiment in Big Data David Belanger PhD Senior Research Fellow Stevens Institute of Technology dbelange@stevens.edu 1 What Does Big Look Like? 7 Image Source Page:

More information

Zero-in on business decisions through innovation solutions for smart big data management. How to turn volume, variety and velocity into value

Zero-in on business decisions through innovation solutions for smart big data management. How to turn volume, variety and velocity into value Zero-in on business decisions through innovation solutions for smart big data management How to turn volume, variety and velocity into value ON THE LOOKOUT FOR NEW SOURCES OF VALUE CREATION WHAT WILL DRIVE

More information

Getting Started Practical Input For Your Roadmap

Getting Started Practical Input For Your Roadmap Getting Started Practical Input For Your Roadmap Mike Ferguson Managing Director, Intelligent Business Strategies BA4ALL Big Data & Analytics Insight Conference Stockholm, May 2015 About Mike Ferguson

More information

A U T H O R S : G a n e s h S r i n i v a s a n a n d S a n d e e p W a g h Social Media Analytics

A U T H O R S : G a n e s h S r i n i v a s a n a n d S a n d e e p W a g h Social Media Analytics contents A U T H O R S : G a n e s h S r i n i v a s a n a n d S a n d e e p W a g h Social Media Analytics Abstract... 2 Need of Social Content Analytics... 3 Social Media Content Analytics... 4 Inferences

More information

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 美 國 13 歲 學 生 用 Big Data 找 出 霸 淩 熱 點 Puri 架 設 網 站 Bullyvention, 藉 由 分 析 Twitter 上 找 出 提 到 跟 霸 凌 相 關 的 詞, 搭 配 地 理 位 置

More information

Decisyon/Engage. Connecting you to the voice of the market. Contacts. www.decisyon.com

Decisyon/Engage. Connecting you to the voice of the market. Contacts. www.decisyon.com Connecting you to the voice of the market Contacts www.decisyon.com Corporate Headquarters 795 Folsom Street, 1st Floor San Francisco, CA 94107 1 844-329-3972 European Office Viale P. L. Nervi Directional

More information

How to Leverage Big Data in the Cloud to Gain Competitive Advantage

How to Leverage Big Data in the Cloud to Gain Competitive Advantage How to Leverage Big Data in the Cloud to Gain Competitive Advantage James Kobielus, IBM Big Data Evangelist Editor-in-Chief, IBM Data Magazine Senior Program Director, Product Marketing, Big Data Analytics

More information

User Needs and Requirements Analysis for Big Data Healthcare Applications

User Needs and Requirements Analysis for Big Data Healthcare Applications User Needs and Requirements Analysis for Big Data Healthcare Applications Sonja Zillner, Siemens AG In collaboration with: Nelia Lasierra, Werner Faix, and Sabrina Neururer MIE 2014 in Istanbul: 01-09-2014

More information

Are You Ready for Big Data?

Are You Ready for Big Data? Are You Ready for Big Data? Jim Gallo National Director, Business Analytics February 11, 2013 Agenda What is Big Data? How do you leverage Big Data in your company? How do you prepare for a Big Data initiative?

More information

See the wood for the trees

See the wood for the trees See the wood for the trees Dr. Harald Schöning Head of Research The world is becoming digital socienty government economy Digital Society Digital Government Digital Enterprise 2 Data is Getting Bigger

More information

Big Data a threat or a chance?

Big Data a threat or a chance? Big Data a threat or a chance? Helwig Hauser University of Bergen, Dept. of Informatics Big Data What is Big Data? well, lots of data, right? we come back to this in a moment. certainly, a buzz-word but

More information

Standards for Big Data in the Cloud

Standards for Big Data in the Cloud Standards for Big Data in the Cloud International Cloud Symposium 15/10/2013 Carola Carstens (Project Officer) DG CONNECT, Unit G3 Data Value Chain European Commission Outline 1) Data Value Chain Unit

More information

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research

The Challenge of Big Data Benchmarking Large-Scale Data Management Insights from Benchmark Research Benchmarking Large-Scale Data Management Insights from Presentation Confidentiality Statement The materials in this presentation are protected under the confidential agreement and/or are copyrighted materials

More information

BI Market Dynamics and Future Directions

BI Market Dynamics and Future Directions Inaugural Keynote Address Business Intelligence Conference Nov 19, 2011, New Delhi BI Market Dynamics and Future Directions Shashikant Brahmankar Head Business Intelligence & Analytics, HCL Content Evolution

More information

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities

Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities Technology Insight Paper Converged, Real-time Analytics Enabling Faster Decision Making and New Business Opportunities By John Webster February 2015 Enabling you to make the best technology decisions Enabling

More information

Automating Big Data Management, by DISIT Lab Distributed [Systems and Internet, Data Intelligence] Technologies Lab Prof. Ph.D. Eng.

Automating Big Data Management, by DISIT Lab Distributed [Systems and Internet, Data Intelligence] Technologies Lab Prof. Ph.D. Eng. Automating Big Data Management, by DISIT Lab Distributed [Systems and Internet, Data Intelligence] Technologies Lab Prof. Ph.D. Eng. Paolo Nesi Dipartimento di Ingegneria dell Informazione, DINFO Università

More information

IEEE International Conference on Computing, Analytics and Security Trends CAST-2016 (19 21 December, 2016) Call for Paper

IEEE International Conference on Computing, Analytics and Security Trends CAST-2016 (19 21 December, 2016) Call for Paper IEEE International Conference on Computing, Analytics and Security Trends CAST-2016 (19 21 December, 2016) Call for Paper CAST-2015 provides an opportunity for researchers, academicians, scientists and

More information

H2020-LEIT-ICT WP2016-17. Big Data PPP

H2020-LEIT-ICT WP2016-17. Big Data PPP H2020-LEIT-ICT WP2016-17 Big Data PPP H2020-LEIT-ICT-2016 ICT 14 Big Data PPP: cross-sectorial and cross-lingual data integration and experimentation (IA) - Budget 27 M ICT 15 Big Data PPP: large scale

More information

The Big Data Paradigm Shift. Insight Through Automation

The Big Data Paradigm Shift. Insight Through Automation The Big Data Paradigm Shift Insight Through Automation Agenda The Problem Emcien s Solution: Algorithms solve data related business problems How Does the Technology Work? Case Studies 2013 Emcien, Inc.

More information

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics

Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Surfing the Data Tsunami: A New Paradigm for Big Data Processing and Analytics Dr. Liangxiu Han Future Networks and Distributed Systems Group (FUNDS) School of Computing, Mathematics and Digital Technology,

More information

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW

AGENDA. What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story. Our BIG DATA Roadmap. Hadoop PDW AGENDA What is BIG DATA? What is Hadoop? Why Microsoft? The Microsoft BIG DATA story Hadoop PDW Our BIG DATA Roadmap BIG DATA? Volume 59% growth in annual WW information 1.2M Zetabytes (10 21 bytes) this

More information

INTELLIGENT BUSINESS STRATEGIES WHITE PAPER

INTELLIGENT BUSINESS STRATEGIES WHITE PAPER INTELLIGENT BUSINESS STRATEGIES WHITE PAPER Improving Access to Data for Successful Business Intelligence Part 2: Supporting Multiple Analytical Workloads in a Changing Analytical Landscape By Mike Ferguson

More information

Getting to Know Big Data

Getting to Know Big Data Getting to Know Big Data Dr. Putchong Uthayopas Department of Computer Engineering, Faculty of Engineering, Kasetsart University Email: putchong@ku.th Information Tsunami Rapid expansion of Smartphone

More information

Better Decision Making

Better Decision Making Better Decision Making Big Data Analytics Webinar, November 2013 Dr. Wolfgang Martin Analyst and Member of the Boulder BI Brain Trust Better Decision Making Process Oriented Businesses. Decision Making:

More information

Enabling Manufacturing Transformation in a Connected World. John Shewchuk Technical Fellow DX

Enabling Manufacturing Transformation in a Connected World. John Shewchuk Technical Fellow DX Enabling Manufacturing Transformation in a Connected World John Shewchuk Technical Fellow DX Internet of Things What is the Internet of Things? The network of physical objects that contain embedded technology

More information

Big Analytics: A Next Generation Roadmap

Big Analytics: A Next Generation Roadmap Big Analytics: A Next Generation Roadmap Cloud Developers Summit & Expo: October 1, 2014 Neil Fox, CTO: SoftServe, Inc. 2014 SoftServe, Inc. Remember Life Before The Web? 1994 Even Revolutions Take Time

More information

Strategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014

Strategic Decisions Supported by SAP Big Data Solutions. Angélica Bedoya / Strategic Solutions GTM Mar /2014 Strategic Decisions Supported by SAP Big Data Solutions Angélica Bedoya / Strategic Solutions GTM Mar /2014 What critical new signals Might you be missing? Use Analytics Today 10% 75% Need Analytics by

More information

Future Internet Public-Private Partnership Call 3 (Objectives 1.8-1.9) European Commission Communications Networks, Content and Technology DG

Future Internet Public-Private Partnership Call 3 (Objectives 1.8-1.9) European Commission Communications Networks, Content and Technology DG Future Internet Public-Private Partnership Call 3 (Objectives 1.8-1.9) European Commission Communications Networks, Content and Technology DG FI-PPP Leadership beyond R&D ICT applications research Application

More information

Big Data Use Cases Update

Big Data Use Cases Update Big Data Use Cases Update Sanat Joshi Industry Solutions Manufacturing Industries Business Unit 1 Data Explosion Web & social networks experienced it first Infographic by Go-gulf.com 2 Number Of Connected

More information

Keywords Big Data; OODBMS; RDBMS; hadoop; EDM; learning analytics, data abundance.

Keywords Big Data; OODBMS; RDBMS; hadoop; EDM; learning analytics, data abundance. Volume 4, Issue 11, November 2014 ISSN: 2277 128X International Journal of Advanced Research in Computer Science and Software Engineering Research Paper Available online at: www.ijarcsse.com Analytics

More information

White Paper on CLOUD COMPUTING

White Paper on CLOUD COMPUTING White Paper on CLOUD COMPUTING INDEX 1. Introduction 2. Features of Cloud Computing 3. Benefits of Cloud computing 4. Service models of Cloud Computing 5. Deployment models of Cloud Computing 6. Examples

More information

DATAMEER WHITE PAPER. Beyond BI. Big Data Analytic Use Cases

DATAMEER WHITE PAPER. Beyond BI. Big Data Analytic Use Cases DATAMEER WHITE PAPER Beyond BI Big Data Analytic Use Cases This white paper discusses the types and characteristics of big data analytics use cases, how they differ from traditional business intelligence

More information

Industry 4.0 and Big Data

Industry 4.0 and Big Data Industry 4.0 and Big Data Marek Obitko, mobitko@ra.rockwell.com Senior Research Engineer 03/25/2015 PUBLIC PUBLIC - 5058-CO900H 2 Background Joint work with Czech Institute of Informatics, Robotics and

More information

Industrial Internet @GE. Dr. Stefan Bungart

Industrial Internet @GE. Dr. Stefan Bungart Industrial Internet @GE Dr. Stefan Bungart The vision is clear The real opportunity for change surpassing the magnitude of the consumer Internet is the Industrial Internet, an open, global network that

More information

Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada

Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada What is big data? Raul F. Chong Senior program manager Big data, DB2, and Cloud IM Cloud Computing Center of Competence - IBM Toronto Lab, Canada 1 2011 IBM Corporation Agenda The world is changing What

More information

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON

BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON BIG DATA IN THE CLOUD : CHALLENGES AND OPPORTUNITIES MARY- JANE SULE & PROF. MAOZHEN LI BRUNEL UNIVERSITY, LONDON Overview * Introduction * Multiple faces of Big Data * Challenges of Big Data * Cloud Computing

More information

Chapter 6 8/12/2015. Foundations of Business Intelligence: Databases and Information Management. Problem:

Chapter 6 8/12/2015. Foundations of Business Intelligence: Databases and Information Management. Problem: Foundations of Business Intelligence: Databases and Information Management VIDEO CASES Chapter 6 Case 1a: City of Dubuque Uses Cloud Computing and Sensors to Build a Smarter, Sustainable City Case 1b:

More information

Workprogramme 2014-15

Workprogramme 2014-15 Workprogramme 2014-15 e-infrastructures DCH-RP final conference 22 September 2014 Wim Jansen einfrastructure DG CONNECT European Commission DEVELOPMENT AND DEPLOYMENT OF E-INFRASTRUCTURES AND SERVICES

More information

European activities in the area of Big Data

European activities in the area of Big Data Connecting Europe for New Horizon European activities in the area of Big Data Márta Nagy-Rothengass DG CONNECT, Head of Unit "Data Value Chain" META-Forum 2013, 19 September 2013, Berlin OUTLINE 1. Data

More information

Deploying Big Data to the Cloud: Roadmap for Success

Deploying Big Data to the Cloud: Roadmap for Success Deploying Big Data to the Cloud: Roadmap for Success James Kobielus Chair, CSCC Big Data in the Cloud Working Group IBM Big Data Evangelist. IBM Data Magazine, Editor-in- Chief. IBM Senior Program Director,

More information

Industry Impact of Big Data in the Cloud: An IBM Perspective

Industry Impact of Big Data in the Cloud: An IBM Perspective Industry Impact of Big Data in the Cloud: An IBM Perspective Inhi Cho Suh IBM Software Group, Information Management Vice President, Product Management and Strategy email: inhicho@us.ibm.com twitter: @inhicho

More information

Business Analytics In a Big Data World Ted Malone Solutions Architect Data Platform and Cloud Microsoft Federal

Business Analytics In a Big Data World Ted Malone Solutions Architect Data Platform and Cloud Microsoft Federal Business Analytics In a Big Data World Ted Malone Solutions Architect Data Platform and Cloud Microsoft Federal Information has gone from scarce to super-abundant. That brings huge new benefits. The Economist

More information

Big data and its transformational effects

Big data and its transformational effects Big data and its transformational effects Professor Fai Cheng Head of Research & Technology September 2015 Working together for a safer world Topics Lloyd s Register Big Data Data driven world Data driven

More information

Modern Data Warehouse

Modern Data Warehouse 1 Modern Data Warehouse Are you ready for Big Data? Does your DWH / BI roadmap contain all the necessary components? IDG: Big data technologies describe a new generation of technologies and architectures,

More information

SAP Predictive Analytics

SAP Predictive Analytics SAP Predictive Analytics What s the best that COULD happen? Bringing predictive analytics to the end user SAP Forum Belgium September 9, 2015 Waldemar Adams @adamsw SVP & GM Analytics SAP Europe, Middle-East

More information

Survey Results: Requirements and Use Cases for Linguistic Linked Data

Survey Results: Requirements and Use Cases for Linguistic Linked Data Survey Results: Requirements and Use Cases for Linguistic Linked Data 1 Introduction This survey was conducted by the FP7 Project LIDER (http://www.lider-project.eu/) as input into the W3C Community Group

More information

What s Happening to the Mainframe? Mobile? Social? Cloud? Big Data?

What s Happening to the Mainframe? Mobile? Social? Cloud? Big Data? December, 2014 What s Happening to the Mainframe? Mobile? Social? Cloud? Big Data? Glenn Anderson IBM Lab Services and Training Today s mainframe is a hybrid system z/os Linux on Sys z DB2 Analytics Accelerator

More information

Chapter 6. Foundations of Business Intelligence: Databases and Information Management

Chapter 6. Foundations of Business Intelligence: Databases and Information Management Chapter 6 Foundations of Business Intelligence: Databases and Information Management VIDEO CASES Case 1a: City of Dubuque Uses Cloud Computing and Sensors to Build a Smarter, Sustainable City Case 1b:

More information

HOW TO DO A SMART DATA PROJECT

HOW TO DO A SMART DATA PROJECT April 2014 Smart Data Strategies HOW TO DO A SMART DATA PROJECT Guideline www.altiliagroup.com Summary ALTILIA s approach to Smart Data PROJECTS 3 1. BUSINESS USE CASE DEFINITION 4 2. PROJECT PLANNING

More information

An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise

An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise An Integrated Analytics & Big Data Infrastructure September 21, 2012 Robert Stackowiak, Vice President Data Systems Architecture Oracle Enterprise Solutions Group The following is intended to outline our

More information

The 3 questions to ask yourself about BIG DATA

The 3 questions to ask yourself about BIG DATA The 3 questions to ask yourself about BIG DATA Do you have a big data problem? Companies looking to tackle big data problems are embarking on a journey that is full of hype, buzz, confusion, and misinformation.

More information

Big Data Executive Survey

Big Data Executive Survey Big Data Executive Full Questionnaire Big Date Executive Full Questionnaire Appendix B Questionnaire Welcome The survey has been designed to provide a benchmark for enterprises seeking to understand the

More information

Language Technologies in Europe: trends and future perspectives

Language Technologies in Europe: trends and future perspectives Language Technologies in Europe: trends and future perspectives European Commission Márta Nagy-Rothengass, DG CONNECT Data Value Chain Unit Berlin, 24 January 2013 META - Creation of language resources

More information

Big Data and Analytics in Government

Big Data and Analytics in Government Big Data and Analytics in Government Nov 29, 2012 Mark Johnson Director, Engineered Systems Program 2 Agenda What Big Data Is Government Big Data Use Cases Building a Complete Information Solution Conclusion

More information