BIG DATA POSSIBILITIES AND CHALLENGES

Size: px
Start display at page:

Download "BIG DATA POSSIBILITIES AND CHALLENGES"

Transcription

1 BIG DATA POSSIBILITIES AND CHALLENGES PROFESSOR AND CENTER DIRECTOR

2 WHY BIG DATA? In God we trust - all others must bring data W. Edwards Deming (US engineer and statistician, )

3 WHAT IS BIG DATA? Wikipedia (en.wikipedia.org/wiki/big_data) All-encompassing term for any collection of data sets so large and complex that it becomes difficult to process using traditional data processing applications Big Data characteristics Volume (often very large) Velocity (often arrives very fast) Variety (often varied/complex format/type/meaning) Veracity (often uncertain or imprecise)

4 BIG DATA AVAILABILITY Pervasive use of computers and sensors Ability to acquire/store/process data Big Data collected everywhere Society increasingly data driven Today as much data created in two days as we did until 2003!

5 BIG DATA EXAMPLE: THE INTERNET What happens in an internet minute?

6 BIG DATA EXAMPLE: TERRAIN DATA Previously meter data E.g Shuttle Radar Topography Mission (SRTM) near global 90-meter dataset Now accurate meter or sub-meter data (e.g. LiDAR) Europe: Denmark, Sweden, Netherlands, USA: NC, OH, PA, DE, IA, LA, Denmark Denmark at 30-meter: ~46 million data points (GB) Current 2-meter model: ~12 billion data points (TB) Upcoming ½-meter model: ~ 168 billion data points

7 BIG DATA IMPORTANCE Nature/Science: Paradigm shift; Science will be about mining data The economist: Managing data deluge difficult; doing so will transform business and public life Value is not in data creation but in data analysis!

8 BIG DATA ANALYSIS IMPORTANCE New York Times, 11/2/2012: The age of Big Data What is Big Data? A meme and a marketing term, for sure, but also shorthand for advancing trends in technology that open the door to a new approach to understanding the world and making decisions.

9 BIG DATA ANALYSIS IMPORTANCE Dan Ariely: Big Data is like teenage sex: Everyone talks about it Nobody really knows how to do it Everyone thinks everyone is doing it So everyone claims they are doing it And like sex, the ones getting the most are smart enough not to talk about it

10 BIG DATA INCREASING IMPORTANCE Increasing government awareness of importance of Big Data analysis Big Data as a driver for growth Governments are increasingly supporting use of data through free data programs

11 POPULAR BIG DATA ANALYSIS EXAMPLES Google: Power of statistical methods on Big Data from the web Google flue-trends - Statistically certain search terms are good indicators of flu activity Google translate - Not : Linguistic analysis to extract the meaning from syntax and vocabulary - Instead : Statistically most probable translation based on similar translations on web

12 POPULAR BIG DATA ANALYSIS EXAMPLES Netflix: The power of recommendation systems Analysis of subscriber preferences created hit series House of Cards - Old (1990) British TV series still popular - Films featuring Kevin Spacey had always done well - Movies directed by David Fincher ( the social network ) had a healthy share

13 BIG DATA ANALYSIS CHALLENGES What questions should be asked What questions can be answered How can questions be answered How is Big Data processed efficiently How can different data be combined How is uncertainly handled What about legal issues What about privacy issues Researcher-industry-society collaboration important!

14 AFTERNOON CASES Many interesting projects/collaborations, including on Releasing and exploiting government, social media and newspaper data and how they are accesses Utilizing health care data to help mothers, newborn, school kids and hip patients alike including in Africa Improving indoor service logistics, recycling systems and personal products offerings - as well as national and global markets Collecting data to model, analyze and improve air quality, traffic behavior, food perception - as well as animal farming Many good Big Data Big Impact examples involving researchers, industry and government

15 MADALGO CASES MADALGO cases involve efficient processing of big terrain data Cleaning ocean floor scanning data Flood risk screening both strong research/publications and new/improved products Important for success MADALGO algorithms research Domain and market knowledge of industry Startup SCALGO as development glue

16 CENTER FOR MASSIVE DATA ALGORITHMICS Established 2007 funded by Danish National Research Foundation 5 year renewal in 2012 (10 year budget > $25 million) - International evaluation: MADALGO is the world-leading center in the area of massive dataset algorithmics High level objectives Advance algorithmic knowledge in massive data algorithms area Train researchers in world-leading international environment Be catalyst for multidisciplinary collaboration

17 CENTER FOR MASSIVE DATA ALGORITHMICS Established 2007 funded by Danish National Research Foundation 5 year renewal in 2012 (10 year budget > $25 million) - International evaluation: MADALGO is the world-leading center in the area of massive dataset algorithmics Building on: Algorithms research focus areas: - I/O-efficient, cache-oblivious and streaming - Algorithm engineering Strong international team/environment Multidisciplinary and industry collaboration

18 I/O-EFFICIENT ALGORITHMS Problems involving Big Data on disk Disk access is 10 6 times slower than main memory access Large access time amortized by transferring large blocks of data Important to store/access data to take advantage of blocks I/O-efficient The algorithms: difference in speed between modern CPU and disk technologies is Move as analogous few disk blocks to the as difference possible to in solve speed problem in sharpening a pencil using a sharpener on one s desk or by taking an airplane to the other side of the world and using a sharpener on someone else s desk. (D. Comer)

19 I/O-EFFICIENT ALGORITHMS MATTER Example: Visiting data in order Array size N = 10 elements Disk block size B = 2 elements Main memory size M = 4 elements Algorithm 1: N=10 disk accesses Algorithm 2: N/B=5 disk assesses Difference between N and N/B huge N = 256 x10 6, B = 8000, 1 ms disk access time N accesses take 256 x10 3 sec = 4266 min = 71 hours N/B assesses take 256/8 sec = 32 seconds

20 ALGORITHM ENGINEERING & COLLABORATION Much of centers collaboration driven by algorithm engineering Design/implementation of practical algorithms & experimentation - Often provide valuable input to theoretical research work - Sometime leads to practical breakthroughs MADALGO, COWI and SCALGO flood risk collaboration Started in 2006 as part of Strategic Research Council project Builds on MADALGO I/O-efficient algorithms research Unique big terrain data solutions and establishment of SCALGO Collaboration continues, including in Innovation Fond project Unique flood risk products

21 FLOOD RISK ANALYSIS IMPORTANCE Important to screen extreme rain or sea-level rise flood risk 50% of Danes worry about their homes being flooded (Userneeds) 90% of Danes say high flood risk affect decision to buy house Cost of 2011 Copenhagen flood over 6 billion kroner (Swiss Re) Potential to do so using detailed national elevation model Elevation for roughly every 2x2 meter of soon ½x½ meter hundreds or even thousands of points in family home lot!

22 DETAILED (BIG) TERRAIN DATA ESSENTIAL Mandø 2 meter sea-level rise 90 meter terrain model 2 meter terrain model

23 DETAILED (BIG) TERRAIN DATA ESSENTIAL Drainage network (flow accumulation) 90 meter terrain model 2 meter terrain model

24 SURFACE FLOW MODELING Flow accumulation on grid terrain model: Initially one unit of water in each grid cell Water (initial and received) distributed from each cell to lowest lower neighbor cell Flow accumulation of cell is total flow through it Note Flow accumulation of cell = size of upstream area Drainage network = cells with high flow accumulation Flow stops/disappears in depressions -> model often filled

25 FLOW ACCUMULATION PERFORMANCE Natural algorithm access disk for each grid cell Push flow down the terrain by visiting cells in height order Problem since cells of same height scattered over terrain Performance of commercial systems often not satifactory Cannot handle Denmark at 2-meter resolution We developed I/O-optimal algorithms Now handle Denmark 2-meter model in a day on limited 4GB desktop!

26 FLOW ACCUMULATION SUCCESS STORY Shuttle Radar Topography Mission (SRTM) Near global dataset 3-arc seconds (90-meter at equator) raster ~60 billion cells stored in roughly files Large USGS Hydrosheds project produced hydrological conditioned 90-meter data But upscaled to 500-meter to compute flow accumulation Using I/O-efficient algorithms: One day on standard 4GB workstation!

27 FLASH FLOOD MAPPING Models how surface water gathers in depressions as it rains Water from watershed of depression gathers in the depression Depressions fill, leading to (dramatic) increase in neighbor depression watershed size Watershed Watershed area area Volume Volume Flash Flood Mapping: Amount of rain before any given raster cell is below water

28 FLASH FLOOD MAPPING EXAMPLE After 10mm rain After 50mm rain After 100mm rain After 150mm rain

29 FLASH FLOOD MAPPING SUCCESS STORY Based on collaborative research, COWI markets SCALGO produced Flash Flood Mapping product in Denmark under name Skybrudskort Produced for entire country Sold to over half of local governments Jones Edmunds compared Flash Flood Mapping to result of advanced dynamic model (ICPR) for Marion County, Florida Results very close Significantly more detailed Cost under 5%

30 AFTERNOON: ONLINE DEMONSTRATION

31 CONCLUSIONS Hope to have convinced you that Big Data has huge potential - in research, industry and society Exploiting Big Data challenging - research-industry-society collaboration one way to success Thanks!

32

Data Centric Computing Revisited

Data Centric Computing Revisited Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data

More information

A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model

A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model High resolution topography derived from LiDAR data is becoming more readily available. This new data source of topography

More information

The following was presented at DMT 14 (June 1-4, 2014, Newark, DE).

The following was presented at DMT 14 (June 1-4, 2014, Newark, DE). DMT 2014 The following was presented at DMT 14 (June 1-4, 2014, Newark, DE). The contents are provisional and will be superseded by a paper in the DMT 14 Proceedings. See also presentations and Proceedings

More information

Statistics, Big Data and Data Science!?

Statistics, Big Data and Data Science!? Statistics, Big Data and Data Science!? Prof. Dr. Göran Kauermann Ludwig-Maximilians-Universität Munich, Germany Statistics, Big Data and Data Science Statistics Founded around 1900 with the seminal work

More information

Big Data in the context of Preservation and Value Adding

Big Data in the context of Preservation and Value Adding Big Data in the context of Preservation and Value Adding R. Leone, R. Cosac, I. Maggio, D. Iozzino ESRIN 06/11/2013 ESA UNCLASSIFIED Big Data Background ESA/ESRIN organized a 'Big Data from Space' event

More information

Big-data Analytics: Challenges and Opportunities

Big-data Analytics: Challenges and Opportunities Big-data Analytics: Challenges and Opportunities Chih-Jen Lin Department of Computer Science National Taiwan University Talk at 台 灣 資 料 科 學 愛 好 者 年 會, August 30, 2014 Chih-Jen Lin (National Taiwan Univ.)

More information

Big Data Analytics. Prof. Dr. Lars Schmidt-Thieme

Big Data Analytics. Prof. Dr. Lars Schmidt-Thieme Big Data Analytics Prof. Dr. Lars Schmidt-Thieme Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany 33. Sitzung des Arbeitskreises Informationstechnologie,

More information

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith Now, Next and the Future: IT, Big Data and other Implications for RIM Agenda for This Afternoon Now: What trends are creating implications within the profession? Next: Why is IT now concerned about RIM?

More information

Veracity in Big Data Reliability of Routes

Veracity in Big Data Reliability of Routes Veracity in Big Data Reliability of Routes Dr. Tobias Emrich Post-Doctoral Scholar Integrated Media Systems Center (IMSC) Viterbi School of Engineering University of Southern California Los Angeles, CA

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms

More information

Big Data Challenges in Bioinformatics

Big Data Challenges in Bioinformatics Big Data Challenges in Bioinformatics BARCELONA SUPERCOMPUTING CENTER COMPUTER SCIENCE DEPARTMENT Autonomic Systems and ebusiness Pla?orms Jordi Torres Jordi.Torres@bsc.es Talk outline! We talk about Petabyte?

More information

RevoScaleR Speed and Scalability

RevoScaleR Speed and Scalability EXECUTIVE WHITE PAPER RevoScaleR Speed and Scalability By Lee Edlefsen Ph.D., Chief Scientist, Revolution Analytics Abstract RevoScaleR, the Big Data predictive analytics library included with Revolution

More information

Global environmental information Examples of EIS Data sets and applications

Global environmental information Examples of EIS Data sets and applications METIER Graduate Training Course n 2 Montpellier - february 2007 Information Management in Environmental Sciences Global environmental information Examples of EIS Data sets and applications Global datasets

More information

High-Performance Visualization of Geographic Data

High-Performance Visualization of Geographic Data High-Performance Visualization of Geographic Data Presented by Budhendra Bhaduri Alexandre Sorokine Geographic Information Science and Technology Computational Sciences and Engineering Managed by UT-Battelle

More information

Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan

Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan H. S. M. Hilmi 1, M.Y. Mohamed 2, E. S. Ganawa 3 1 Faculty of agriculture, Alzaiem

More information

Big Data Challenges. technology basics for data scientists. Spring - 2014. Jordi Torres, UPC - BSC www.jorditorres.

Big Data Challenges. technology basics for data scientists. Spring - 2014. Jordi Torres, UPC - BSC www.jorditorres. Big Data Challenges technology basics for data scientists Spring - 2014 Jordi Torres, UPC - BSC www.jorditorres.eu @JordiTorresBCN Data Deluge: Due to the changes in big data generation Example: Biomedicine

More information

Transforming ecommerce Big Data into Big Fast Data

Transforming ecommerce Big Data into Big Fast Data Transforming ecommerce Big Data into Big Fast Data Gagan Mehra, Chief Evangelist, Terracotta, Inc. October 22 nd 2013 2013 Terracotta Inc. 1 2013 Terracotta Inc. 1 WHAT IS BIG DATA? 2013 Terracotta Inc.

More information

A Novel Cloud Based Elastic Framework for Big Data Preprocessing

A Novel Cloud Based Elastic Framework for Big Data Preprocessing School of Systems Engineering A Novel Cloud Based Elastic Framework for Big Data Preprocessing Omer Dawelbeit and Rachel McCrindle October 21, 2014 University of Reading 2008 www.reading.ac.uk Overview

More information

Advanced Methods for Pedestrian and Bicyclist Sensing

Advanced Methods for Pedestrian and Bicyclist Sensing Advanced Methods for Pedestrian and Bicyclist Sensing Yinhai Wang PacTrans STAR Lab University of Washington Email: yinhai@uw.edu Tel: 1-206-616-2696 For Exchange with University of Nevada Reno Sept. 25,

More information

Big Data Hope or Hype?

Big Data Hope or Hype? Big Data Hope or Hype? David J. Hand Imperial College, London and Winton Capital Management Big data science, September 2013 1 Google trends on big data Google search 1 Sept 2013: 1.6 billion hits on big

More information

EIVA NaviModel3. Efficient Sonar Data Cleaning. Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3. Lars Dall, EIVA A/S

EIVA NaviModel3. Efficient Sonar Data Cleaning. Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3. Lars Dall, EIVA A/S EIVA NaviModel3 Efficient Sonar Data Cleaning Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3 Lars Dall, EIVA A/S Contents: Introduction to NaviModel3 Cleaning functionalities

More information

Data deluge (and it s applications) Gianluigi Zanetti. Data deluge. (and its applications) Gianluigi Zanetti

Data deluge (and it s applications) Gianluigi Zanetti. Data deluge. (and its applications) Gianluigi Zanetti Data deluge (and its applications) Prologue Data is becoming cheaper and cheaper to produce and store Driving mechanism is parallelism on sensors, storage, computing Data directly produced are complex

More information

Cloud Computing Trends

Cloud Computing Trends UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered

More information

Web analytics: Data Collected via the Internet

Web analytics: Data Collected via the Internet Database Marketing Fall 2016 Web analytics (incl real-time data) Collaborative filtering Facebook advertising Mobile marketing Slide set 8 1 Web analytics: Data Collected via the Internet Customers can

More information

DIGITAL UNIVERSE UNIVERSE

DIGITAL UNIVERSE UNIVERSE - - - - - - The - - DIGITAL - - - - - - - - - - - E M C D I G I T A L of OPPORTUNITIES RICH DATA & the Increasing Value of the INTERNET OF THINGS - - - - - - - - - - - - - - - - - - - - - - - - - GET STARTED

More information

Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics?

Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics? Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics? Ali FOULADKAR (ali.fouladkar@upmf-grenoble.fr) PhD candidate, Grenoble University (UPMF),

More information

12/7/2015. Data Science Master s programs

12/7/2015. Data Science Master s programs Data Science Master s programs 1 1 Who are we? Willem-Jan van den Heuvel Tilburg University Ksenia Podoynitsyna Eindhoven University of Technology 2 2 Program What is Data Science? The Data Science Initiative

More information

D.K. Schroder, Introduction to Engineering Design. Problems and Solutions

D.K. Schroder, Introduction to Engineering Design. Problems and Solutions Problems and Solutions Effective Problem Solving Seven Habits of Highly Effective People Be proactive Take initiative, make things happen Begin with the end in mind Know where you are going Put first things

More information

BIG DATA AND ANALYTICS

BIG DATA AND ANALYTICS BIG DATA AND ANALYTICS Björn Bjurling, bgb@sics.se Daniel Gillblad, dgi@sics.se Anders Holst, aho@sics.se Swedish Institute of Computer Science AGENDA What is big data and analytics? and why one must bother

More information

Earth Data Science in The Era of Big Data and Compute

Earth Data Science in The Era of Big Data and Compute Earth Data Science in The Era of Big Data and Compute E. Lynn Usery U.S. Geological Survey usery@usgs.gov http://cegis.usgs.gov U.S. Department of the Interior U.S. Geological Survey Board on Earth Sciences

More information

Modern (Computational) Approaches to Big Data Analytics. CSC 576 Computer Science, University of Rochester Instructor: Ji Liu

Modern (Computational) Approaches to Big Data Analytics. CSC 576 Computer Science, University of Rochester Instructor: Ji Liu Modern (Computational) Approaches to Big Data Analytics CSC 576 Computer Science, University of Rochester Instructor: Ji Liu Big Data in Academy SIGKDD 2014 (program page, found 14 big data, 50+ large

More information

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait CSC590: Selected Topics BIG DATA & DATA MINING Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait Agenda Introduction What is Big Data Why Big Data? Characteristics of Big Data Applications of Big Data Problems

More information

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010 Flash Memory Arrays Enabling the Virtualized Data Center July 2010 2 Flash Memory Arrays Enabling the Virtualized Data Center This White Paper describes a new product category, the flash Memory Array,

More information

Proposal for the Theme on Big Data. Analytics. Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK. May 2015

Proposal for the Theme on Big Data. Analytics. Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK. May 2015 Proposal for the Theme on Big Data Analytics May 2015 Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK Motivation The world's technological per-capita capacity to store information doubled every

More information

Statistical Challenges with Big Data in Management Science

Statistical Challenges with Big Data in Management Science Statistical Challenges with Big Data in Management Science Arnab Kumar Laha Indian Institute of Management Ahmedabad Analytics vs Reporting Competitive Advantage Reporting Prescriptive Analytics (Decision

More information

Flood Modelling for Cities using Cloud Computing FINAL REPORT. Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby

Flood Modelling for Cities using Cloud Computing FINAL REPORT. Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby Summary Flood Modelling for Cities using Cloud Computing FINAL REPORT Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby Assessment of pluvial flood risk is particularly difficult

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON BIG DATA ISSUES AMRINDER KAUR Assistant Professor, Department of Computer

More information

Name(s) Class Date. Q1. In 2009, kids ages 11 to 14 spent the most time with this type of media:

Name(s) Class Date. Q1. In 2009, kids ages 11 to 14 spent the most time with this type of media: Name(s) Class Date Directions Kids and parents face off! Find out who is the bigger master of media. Begin by filling out the quiz together. If there are questions that you don t agree on, circle two answers.

More information

Big Data Mining Services and Knowledge Discovery Applications on Clouds

Big Data Mining Services and Knowledge Discovery Applications on Clouds Big Data Mining Services and Knowledge Discovery Applications on Clouds Domenico Talia DIMES, Università della Calabria & DtoK Lab Italy talia@dimes.unical.it Data Availability or Data Deluge? Some decades

More information

Using big data in product design. Executive Director Jesper N. Pedersen

Using big data in product design. Executive Director Jesper N. Pedersen Using big data in product design Executive Director Jesper N. Pedersen Agenda The challenge is Big data a Big thing? Danish Innovation approach 1. Product innovation 2. New online services 3. Smart city

More information

Mobile Monetization Scenario Design & Big Data. Arther Wu Senior Director of Monetization and Business Operation

Mobile Monetization Scenario Design & Big Data. Arther Wu Senior Director of Monetization and Business Operation Mobile Monetization Scenario Design & Big Data Arther Wu Senior Director of Monetization and Business Operation Agenda Quick update of Cheetah Mobile Ad Scenario Design Big Data / Relation with Advertising

More information

What is the number one issue that Organizational Leaders are facing today?

What is the number one issue that Organizational Leaders are facing today? What is the number one issue that Organizational Leaders are facing today? Managing time and energy in the face of growing complexity...the sense that the world is moving faster -Chris Zook (Bain & Company

More information

06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH

06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH 06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH Richard Kellagher 1, Mike Panzeri 1, Julien L Homme 1, Yannick Cesses 1, Ben Gouldby 1 John Martin 2, Oliver Nicholson 2, Mark

More information

Big Data Driven Knowledge Discovery for Autonomic Future Internet

Big Data Driven Knowledge Discovery for Autonomic Future Internet Big Data Driven Knowledge Discovery for Autonomic Future Internet Professor Geyong Min Chair in High Performance Computing and Networking Department of Mathematics and Computer Science College of Engineering,

More information

Data Mining: Benefits for business.

Data Mining: Benefits for business. Data Mining: Benefits for business. Data Mining enables businesses of all types and sizes to empower their data and gain valuable insight into what decisions to take. Since 2005 the Oversea-Chinese Banking

More information

AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP

AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP Asst.Prof Mr. M.I Peter Shiyam,M.E * Department of Computer Science and Engineering, DMI Engineering college, Aralvaimozhi.

More information

1. Understanding Big Data

1. Understanding Big Data Big Data and its Real Impact on Your Security & Privacy Framework: A Pragmatic Overview Erik Luysterborg Partner, Deloitte EMEA Data Protection & Privacy leader Prague, SCCE, March 22 nd 2016 1. 2016 Deloitte

More information

Why Modern B2B Marketers Need Predictive Marketing

Why Modern B2B Marketers Need Predictive Marketing Why Modern B2B Marketers Need Predictive Marketing Sponsored by www.raabassociatesinc.com info@raabassociatesinc.com www.mintigo.com info@mintigo.com Introduction Marketers have used predictive modeling

More information

Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition

Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition Michael A. Schuh1, Rafal A. Angryk2 1 Montana State University, Bozeman, MT 2 Georgia State University, Atlanta, GA Introduction

More information

This blog entry is targeted at both users (customers) and implementers (Business Partners/Technology companies) of Big Data.

This blog entry is targeted at both users (customers) and implementers (Business Partners/Technology companies) of Big Data. Preface Why I am writing this blog entry now? I am guessing in part that many companies out there would like to engage around Big Data, however back in the Fall of 2011 Big Data was not really on their

More information

Exploiting the power of Big Data

Exploiting the power of Big Data Exploiting the power of Big Data Timos Sellis School of Computer Science and Information Technology timos.sellis@rmit.edu.au ITECHLAW Asia-Pacific Conference, February 26-28, 2014 Melbourne Australia Timeline

More information

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 美 國 13 歲 學 生 用 Big Data 找 出 霸 淩 熱 點 Puri 架 設 網 站 Bullyvention, 藉 由 分 析 Twitter 上 找 出 提 到 跟 霸 凌 相 關 的 詞, 搭 配 地 理 位 置

More information

PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015

PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015 PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015 [THE SPOKEN WORD APPLIES] Dear Danish Chamber of Commerce; Lady Neville-Rolfe; ladies and gentlemen.

More information

Collaborations between Official Statistics and Academia in the Era of Big Data

Collaborations between Official Statistics and Academia in the Era of Big Data Collaborations between Official Statistics and Academia in the Era of Big Data World Statistics Day October 20-21, 2015 Budapest Vijay Nair University of Michigan Past-President of ISI vnn@umich.edu What

More information

Big Trouble. Does Big Data spell. for Lawyers? Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado

Big Trouble. Does Big Data spell. for Lawyers? Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado Does Big Data spell Big Trouble for Lawyers? Paul Karlzen Director HR Information & Analytics April 1, 2015 Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado

More information

Big Data and Open Data

Big Data and Open Data Big Data and Open Data Bebo White SLAC National Accelerator Laboratory/ Stanford University!! bebo@slac.stanford.edu dekabytes hectobytes Big Data IS a buzzword! The Data Deluge From the beginning of

More information

Use Data Budgets to Manage Large Acoustic Datasets

Use Data Budgets to Manage Large Acoustic Datasets Use Data Budgets to Manage Large Acoustic Datasets Introduction Efforts to understand the health of the ocean have increased significantly in the recent past. These efforts involve among other things,

More information

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP NST STORAGE FOR THE VIRTUAL DESKTOP Nexsan s innovative product, the NST5000, is a hybrid storage system with unified protocols and highly dense storage for a combination of great performance, low cost,

More information

Ratings, Audiences, & Failed Shows

Ratings, Audiences, & Failed Shows Ratings, Audiences, & Failed Shows TELEVISION RATINGS Before the Show Airs A New Season TV networks test programs Subjects view pilots or season finales for current shows in theaters. Meters record their

More information

Big Data and the Internet of Things

Big Data and the Internet of Things Financial institutions Energy Infrastructure, mining and commodities Transport Technology and innovation Life sciences and healthcare Big Data and the Internet of Things Protecting rights, controlling

More information

ETCIC Internships Open to Sophomores:

ETCIC Internships Open to Sophomores: ETCIC Internships Open to Sophomores: If interested in applying for any of these positions, please email emassey1@swarthmore.edu with your resume (and cover letter if required) by Sunday, 9/20 at 11:59pm.

More information

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications Big Data Big Data: Introduction and Applications August 20, 2015 HKU-HKJC ExCEL3 Seminar Michael Chau, Associate Professor School of Business, The University of Hong Kong Ample opportunities for business

More information

Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research

Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research Trends: Data on an Exponential Scale Scientific data doubles every year Combination of inexpensive sensors + exponentially

More information

Research Note What is Big Data?

Research Note What is Big Data? Research Note What is Big Data? By: Devin Luco Copyright 2012, ASA Institute for Risk & Innovation Keywords: Big Data, Database Management, Data Variety, Data Velocity, Data Volume, Structured Data, Unstructured

More information

New, Unique, and Dedicated dataset for the Global Atlas

New, Unique, and Dedicated dataset for the Global Atlas WFES 2014 EUDP Global Wind Atlas: New, Unique, and Dedicated dataset for the Global Atlas Presented by Jake Badger EUDP is a Danish fund for development and demonstration projects from the Danish Energy

More information

On the CyberShARE site you will find this interpolated version (labeled SRTMv4_90m)

On the CyberShARE site you will find this interpolated version (labeled SRTMv4_90m) SRTM Data on Cyber-ShARE The Shuttle Radar Topography Mission (SRTM) data collected by NASA represents the most up-to-date, globally collected topography data set of the Earth. It makes up the first globally

More information

SEO. People turn to search engines for questions. When they arrive at your website they are expecting immediate answers

SEO. People turn to search engines for questions. When they arrive at your website they are expecting immediate answers SEO People turn to search engines for questions. When they arrive at your website they are expecting immediate answers What is SEO and what are the advantages of using it? SEO stands for search engine

More information

White Paper. Are SaaS and Cloud Computing Your Best Bets?

White Paper. Are SaaS and Cloud Computing Your Best Bets? White Paper Are SaaS and Cloud Computing Your Best Bets? Understanding SaaS and Cloud Computing and Service Delivery Options for Real Estate Technology Solutions Joseph Valeri, MBA, MS President, Lucernex

More information

Chapter-1 : Introduction 1 CHAPTER - 1. Introduction

Chapter-1 : Introduction 1 CHAPTER - 1. Introduction Chapter-1 : Introduction 1 CHAPTER - 1 Introduction This thesis presents design of a new Model of the Meta-Search Engine for getting optimized search results. The focus is on new dimension of internet

More information

HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN

HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN University of Texas at Austin GIS in Water Resources Instructor: Dr. David Maidment HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN Wikipedia Elisabeta Poci December, 2011 1 Table of Contents: 1. Introduction

More information

Weather stations: Providing business critical information

Weather stations: Providing business critical information Weather stations: Providing business critical information As a nation, the U.S. consumes seven percent of the globe s energy, making it the largest energy user in the world by a considerable margin. Weather

More information

Take Control of your future with this residual income, home based business.

Take Control of your future with this residual income, home based business. Take Control of your future with this residual income, home based business. Who is your online niche business? We re in the business of making your life better by helping you earn a part time income working

More information

You re One in Seven Billion!

You re One in Seven Billion! You re One in Seven Billion! We ve all heard the expression, You re one in a million!. With the ever-growing number of people on the planet, it might be more accurate to say, You re one in seven billion!

More information

Semantic Web in 10 years: Semantics with a purpose

Semantic Web in 10 years: Semantics with a purpose Semantic Web in 10 years: Semantics with a purpose [Position paper for the ISWC2012 Workshop on What will the Semantic Web look like 10 years from now? ] Marko Grobelnik, Dunja Mladenić, Blaž Fortuna J.

More information

BMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation

BMW11: Dealing with the Massive Data Generated by Many-Core Systems. Dr Don Grice. 2011 IBM Corporation BMW11: Dealing with the Massive Data Generated by Many-Core Systems Dr Don Grice IBM Systems and Technology Group Title: Dealing with the Massive Data Generated by Many Core Systems. Abstract: Multi-core

More information

Havnepromenade 9, DK-9000 Aalborg, Denmark. Denmark. Sohngaardsholmsvej 57, DK-9000 Aalborg, Denmark

Havnepromenade 9, DK-9000 Aalborg, Denmark. Denmark. Sohngaardsholmsvej 57, DK-9000 Aalborg, Denmark Urban run-off volumes dependency on rainfall measurement method - Scaling properties of precipitation within a 2x2 km radar pixel L. Pedersen 1 *, N. E. Jensen 2, M. R. Rasmussen 3 and M. G. Nicolajsen

More information

The 7 Wonders of Email Marketing. 7 essential tips on how to make email marketing work for you

The 7 Wonders of Email Marketing. 7 essential tips on how to make email marketing work for you Introduction The secret to successful email marketing is being in the know. Knowing your customers, knowing your competitors and knowing your emails. It s more than sending emails, anyone can do that.

More information

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Agenda Big Data in 15 Mins. Goal: Provide a basic understanding of; What is Big Data; Why it s important

More information

Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability

Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability Technology Implications of an Instrumented Planet presented at IFIP WG 10.4 Workshop on Challenges and Directions in Dependability Nick Bowen Colin Harrison IBM June 2008 1 Background Global Technology

More information

Internet Safety Guide for Parents

Internet Safety Guide for Parents Internet Safety Guide for Parents How to Talk to Your Kids about Staying Safe Online Presented by Keith Dunn http://www.kdcop.com Page 1 Now I know each and every single one of you is extremely busy. Both

More information

Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data.

Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data. Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data. 1 Advances in information technologies are transforming the fabric of our society and data represent

More information

We are Big Data A Sonian Whitepaper

We are Big Data A Sonian Whitepaper EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed

More information

Notable near-global DEMs include

Notable near-global DEMs include Visualisation Developing a very high resolution DEM of South Africa by Adriaan van Niekerk, Stellenbosch University DEMs are used in many applications, including hydrology [1, 2], terrain analysis [3],

More information

Evaluation of surface runoff conditions. scanner in an intensive apple orchard

Evaluation of surface runoff conditions. scanner in an intensive apple orchard Evaluation of surface runoff conditions by high resolution terrestrial laser scanner in an intensive apple orchard János Tamás 1, Péter Riczu 1, Attila Nagy 1, Éva Lehoczky 2 1 Faculty of Agricultural

More information

class 1 welcome to CS265! BIG DATA SYSTEMS prof. Stratos Idreos

class 1 welcome to CS265! BIG DATA SYSTEMS prof. Stratos Idreos class 1 welcome to CS265 BIG DATA SYSTEMS prof. plan for today big data + systems class structure + logistics who is who project ideas 2 data vs knowledge 3 big data 4 daily data 2.5 exabytes years 2012

More information

Big data, big business, Big Brother?

Big data, big business, Big Brother? Big data, big business, Big Brother? portrait of hacker and laptop meaning safety data Editor's note: Gerd Leonhard is futurist, keynote speaker, strategist, author and CEO of The Futures Agency. Follow

More information

Geospatial Information for disaster risk reduction and natural resources management. Rolando Ocampo Alcántar

Geospatial Information for disaster risk reduction and natural resources management. Rolando Ocampo Alcántar Geospatial Information for disaster risk reduction and natural resources management Rolando Ocampo Alcántar Content Background Geospatial Information for Disaster Management Risk Atlas Information Exchange

More information

Using the HP Vertica Analytics Platform to Manage Massive Volumes of Smart Meter Data

Using the HP Vertica Analytics Platform to Manage Massive Volumes of Smart Meter Data Technical white paper Using the HP Vertica Analytics Platform to Manage Massive Volumes of Smart Meter Data The Internet of Things is expected to connect billions of sensors that continuously gather data

More information

Are You Part of the. modernhomes.org

Are You Part of the. modernhomes.org Are You Part of the Internet A study by the National Association of Realtors, Profile of Home Buyers and Sellers, recently pointed out that 80 percent of homebuyers begin their home search on the Internet,

More information

COMP9321 Web Application Engineering

COMP9321 Web Application Engineering COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 11 (Part II) http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411

More information

Conservation Applications of LiDAR Data

Conservation Applications of LiDAR Data Program: Funding: Conservation Applications of LiDAR Data http://tsp.umn.edu/lidar Environment and Natural Resources Trust Fund Module: Instructor: Hydrologic Applications Sean Vaughn, DNR GIS Hydrologist

More information

Archiving and Sharing Big Data Digital Repositories, Libraries, Cloud Storage

Archiving and Sharing Big Data Digital Repositories, Libraries, Cloud Storage Archiving and Sharing Big Data Digital Repositories, Libraries, Cloud Storage Cyrus Shahabi, Ph.D. Professor of Computer Science & Electrical Engineering Director, Integrated Media Systems Center (IMSC)

More information

Capitalizing on Smarter and Faster Insight with Flash

Capitalizing on Smarter and Faster Insight with Flash 89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com 212.367.7400 Capitalizing on Smarter and Faster Insight with Flash IBM FlashSystem and IBM InfoSphere Identity Insight Printed in the United

More information

Parallelism and Cloud Computing

Parallelism and Cloud Computing Parallelism and Cloud Computing Kai Shen Parallel Computing Parallel computing: Process sub tasks simultaneously so that work can be completed faster. For instances: divide the work of matrix multiplication

More information

Big Data Analytics. Lucas Rego Drumond

Big Data Analytics. Lucas Rego Drumond Big Data Analytics Lucas Rego Drumond Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany Big Data Analytics Big Data Analytics 1 / 36 Outline

More information

Innovative Approaches in Flood Damage Reduction

Innovative Approaches in Flood Damage Reduction Innovative Approaches in Flood Damage Reduction Solutions for the Stormwater Management High Level Results 3D geospatial model of storm water management pond (GRCA, 2013) Enhanced understanding of storm

More information

Unprecedented Performance and Scalability Demonstrated For Meter Data Management:

Unprecedented Performance and Scalability Demonstrated For Meter Data Management: Unprecedented Performance and Scalability Demonstrated For Meter Data Management: Ten Million Meters Scalable to One Hundred Million Meters For Five Billion Daily Meter Readings Performance testing results

More information

Big Data Systems CS 5965/6965 FALL 2014

Big Data Systems CS 5965/6965 FALL 2014 Big Data Systems CS 5965/6965 FALL 2014 Today General course overview Q&A Introduction to Big Data Data Collection Assignment #1 General Course Information Course Web Page http://www.cs.utah.edu/~hari/teaching/fall2014.html

More information

3D Model of the City Using LiDAR and Visualization of Flood in Three-Dimension

3D Model of the City Using LiDAR and Visualization of Flood in Three-Dimension 3D Model of the City Using LiDAR and Visualization of Flood in Three-Dimension R.Queen Suraajini, Department of Civil Engineering, College of Engineering Guindy, Anna University, India, suraa12@gmail.com

More information