BIG DATA POSSIBILITIES AND CHALLENGES

Size: px
Start display at page:

Download "BIG DATA POSSIBILITIES AND CHALLENGES"

Transcription

1 BIG DATA POSSIBILITIES AND CHALLENGES PROFESSOR AND CENTER DIRECTOR

2 WHY BIG DATA? In God we trust - all others must bring data W. Edwards Deming (US engineer and statistician, )

3 WHAT IS BIG DATA? Wikipedia (en.wikipedia.org/wiki/big_data) All-encompassing term for any collection of data sets so large and complex that it becomes difficult to process using traditional data processing applications Big Data characteristics Volume (often very large) Velocity (often arrives very fast) Variety (often varied/complex format/type/meaning) Veracity (often uncertain or imprecise)

4 BIG DATA AVAILABILITY Pervasive use of computers and sensors Ability to acquire/store/process data Big Data collected everywhere Society increasingly data driven Today as much data created in two days as we did until 2003!

5 BIG DATA EXAMPLE: THE INTERNET What happens in an internet minute?

6 BIG DATA EXAMPLE: TERRAIN DATA Previously meter data E.g Shuttle Radar Topography Mission (SRTM) near global 90-meter dataset Now accurate meter or sub-meter data (e.g. LiDAR) Europe: Denmark, Sweden, Netherlands, USA: NC, OH, PA, DE, IA, LA, Denmark Denmark at 30-meter: ~46 million data points (GB) Current 2-meter model: ~12 billion data points (TB) Upcoming ½-meter model: ~ 168 billion data points

7 BIG DATA IMPORTANCE Nature/Science: Paradigm shift; Science will be about mining data The economist: Managing data deluge difficult; doing so will transform business and public life Value is not in data creation but in data analysis!

8 BIG DATA ANALYSIS IMPORTANCE New York Times, 11/2/2012: The age of Big Data What is Big Data? A meme and a marketing term, for sure, but also shorthand for advancing trends in technology that open the door to a new approach to understanding the world and making decisions.

9 BIG DATA ANALYSIS IMPORTANCE Dan Ariely: Big Data is like teenage sex: Everyone talks about it Nobody really knows how to do it Everyone thinks everyone is doing it So everyone claims they are doing it And like sex, the ones getting the most are smart enough not to talk about it

10 BIG DATA INCREASING IMPORTANCE Increasing government awareness of importance of Big Data analysis Big Data as a driver for growth Governments are increasingly supporting use of data through free data programs

11 POPULAR BIG DATA ANALYSIS EXAMPLES Google: Power of statistical methods on Big Data from the web Google flue-trends - Statistically certain search terms are good indicators of flu activity Google translate - Not : Linguistic analysis to extract the meaning from syntax and vocabulary - Instead : Statistically most probable translation based on similar translations on web

12 POPULAR BIG DATA ANALYSIS EXAMPLES Netflix: The power of recommendation systems Analysis of subscriber preferences created hit series House of Cards - Old (1990) British TV series still popular - Films featuring Kevin Spacey had always done well - Movies directed by David Fincher ( the social network ) had a healthy share

13 BIG DATA ANALYSIS CHALLENGES What questions should be asked What questions can be answered How can questions be answered How is Big Data processed efficiently How can different data be combined How is uncertainly handled What about legal issues What about privacy issues Researcher-industry-society collaboration important!

14 AFTERNOON CASES Many interesting projects/collaborations, including on Releasing and exploiting government, social media and newspaper data and how they are accesses Utilizing health care data to help mothers, newborn, school kids and hip patients alike including in Africa Improving indoor service logistics, recycling systems and personal products offerings - as well as national and global markets Collecting data to model, analyze and improve air quality, traffic behavior, food perception - as well as animal farming Many good Big Data Big Impact examples involving researchers, industry and government

15 MADALGO CASES MADALGO cases involve efficient processing of big terrain data Cleaning ocean floor scanning data Flood risk screening both strong research/publications and new/improved products Important for success MADALGO algorithms research Domain and market knowledge of industry Startup SCALGO as development glue

16 CENTER FOR MASSIVE DATA ALGORITHMICS Established 2007 funded by Danish National Research Foundation 5 year renewal in 2012 (10 year budget > $25 million) - International evaluation: MADALGO is the world-leading center in the area of massive dataset algorithmics High level objectives Advance algorithmic knowledge in massive data algorithms area Train researchers in world-leading international environment Be catalyst for multidisciplinary collaboration

17 CENTER FOR MASSIVE DATA ALGORITHMICS Established 2007 funded by Danish National Research Foundation 5 year renewal in 2012 (10 year budget > $25 million) - International evaluation: MADALGO is the world-leading center in the area of massive dataset algorithmics Building on: Algorithms research focus areas: - I/O-efficient, cache-oblivious and streaming - Algorithm engineering Strong international team/environment Multidisciplinary and industry collaboration

18 I/O-EFFICIENT ALGORITHMS Problems involving Big Data on disk Disk access is 10 6 times slower than main memory access Large access time amortized by transferring large blocks of data Important to store/access data to take advantage of blocks I/O-efficient The algorithms: difference in speed between modern CPU and disk technologies is Move as analogous few disk blocks to the as difference possible to in solve speed problem in sharpening a pencil using a sharpener on one s desk or by taking an airplane to the other side of the world and using a sharpener on someone else s desk. (D. Comer)

19 I/O-EFFICIENT ALGORITHMS MATTER Example: Visiting data in order Array size N = 10 elements Disk block size B = 2 elements Main memory size M = 4 elements Algorithm 1: N=10 disk accesses Algorithm 2: N/B=5 disk assesses Difference between N and N/B huge N = 256 x10 6, B = 8000, 1 ms disk access time N accesses take 256 x10 3 sec = 4266 min = 71 hours N/B assesses take 256/8 sec = 32 seconds

20 ALGORITHM ENGINEERING & COLLABORATION Much of centers collaboration driven by algorithm engineering Design/implementation of practical algorithms & experimentation - Often provide valuable input to theoretical research work - Sometime leads to practical breakthroughs MADALGO, COWI and SCALGO flood risk collaboration Started in 2006 as part of Strategic Research Council project Builds on MADALGO I/O-efficient algorithms research Unique big terrain data solutions and establishment of SCALGO Collaboration continues, including in Innovation Fond project Unique flood risk products

21 FLOOD RISK ANALYSIS IMPORTANCE Important to screen extreme rain or sea-level rise flood risk 50% of Danes worry about their homes being flooded (Userneeds) 90% of Danes say high flood risk affect decision to buy house Cost of 2011 Copenhagen flood over 6 billion kroner (Swiss Re) Potential to do so using detailed national elevation model Elevation for roughly every 2x2 meter of soon ½x½ meter hundreds or even thousands of points in family home lot!

22 DETAILED (BIG) TERRAIN DATA ESSENTIAL Mandø 2 meter sea-level rise 90 meter terrain model 2 meter terrain model

23 DETAILED (BIG) TERRAIN DATA ESSENTIAL Drainage network (flow accumulation) 90 meter terrain model 2 meter terrain model

24 SURFACE FLOW MODELING Flow accumulation on grid terrain model: Initially one unit of water in each grid cell Water (initial and received) distributed from each cell to lowest lower neighbor cell Flow accumulation of cell is total flow through it Note Flow accumulation of cell = size of upstream area Drainage network = cells with high flow accumulation Flow stops/disappears in depressions -> model often filled

25 FLOW ACCUMULATION PERFORMANCE Natural algorithm access disk for each grid cell Push flow down the terrain by visiting cells in height order Problem since cells of same height scattered over terrain Performance of commercial systems often not satifactory Cannot handle Denmark at 2-meter resolution We developed I/O-optimal algorithms Now handle Denmark 2-meter model in a day on limited 4GB desktop!

26 FLOW ACCUMULATION SUCCESS STORY Shuttle Radar Topography Mission (SRTM) Near global dataset 3-arc seconds (90-meter at equator) raster ~60 billion cells stored in roughly files Large USGS Hydrosheds project produced hydrological conditioned 90-meter data But upscaled to 500-meter to compute flow accumulation Using I/O-efficient algorithms: One day on standard 4GB workstation!

27 FLASH FLOOD MAPPING Models how surface water gathers in depressions as it rains Water from watershed of depression gathers in the depression Depressions fill, leading to (dramatic) increase in neighbor depression watershed size Watershed Watershed area area Volume Volume Flash Flood Mapping: Amount of rain before any given raster cell is below water

28 FLASH FLOOD MAPPING EXAMPLE After 10mm rain After 50mm rain After 100mm rain After 150mm rain

29 FLASH FLOOD MAPPING SUCCESS STORY Based on collaborative research, COWI markets SCALGO produced Flash Flood Mapping product in Denmark under name Skybrudskort Produced for entire country Sold to over half of local governments Jones Edmunds compared Flash Flood Mapping to result of advanced dynamic model (ICPR) for Marion County, Florida Results very close Significantly more detailed Cost under 5%

30 AFTERNOON: ONLINE DEMONSTRATION

31 CONCLUSIONS Hope to have convinced you that Big Data has huge potential - in research, industry and society Exploiting Big Data challenging - research-industry-society collaboration one way to success Thanks!

32

Data Centric Computing Revisited

Data Centric Computing Revisited Piyush Chaudhary Technical Computing Solutions Data Centric Computing Revisited SPXXL/SCICOMP Summer 2013 Bottom line: It is a time of Powerful Information Data volume is on the rise Dimensions of data

More information

Statistics, Big Data and Data Science!?

Statistics, Big Data and Data Science!? Statistics, Big Data and Data Science!? Prof. Dr. Göran Kauermann Ludwig-Maximilians-Universität Munich, Germany Statistics, Big Data and Data Science Statistics Founded around 1900 with the seminal work

More information

A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model

A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model A Method Using ArcMap to Create a Hydrologically conditioned Digital Elevation Model High resolution topography derived from LiDAR data is becoming more readily available. This new data source of topography

More information

Big-data Analytics: Challenges and Opportunities

Big-data Analytics: Challenges and Opportunities Big-data Analytics: Challenges and Opportunities Chih-Jen Lin Department of Computer Science National Taiwan University Talk at 台 灣 資 料 科 學 愛 好 者 年 會, August 30, 2014 Chih-Jen Lin (National Taiwan Univ.)

More information

OVERLAND FLOW PATH AND DEPRESSION MAPPING FOR THE AUCKLAND REGION

OVERLAND FLOW PATH AND DEPRESSION MAPPING FOR THE AUCKLAND REGION OVERLAND FLOW PATH AND DEPRESSION MAPPING FOR THE AUCKLAND REGION Josh Irvine and Nick Brown Auckland Council ABSTRACT A significant proportion of flooding issues in an urban environment can be attributed

More information

Big Data in the context of Preservation and Value Adding

Big Data in the context of Preservation and Value Adding Big Data in the context of Preservation and Value Adding R. Leone, R. Cosac, I. Maggio, D. Iozzino ESRIN 06/11/2013 ESA UNCLASSIFIED Big Data Background ESA/ESRIN organized a 'Big Data from Space' event

More information

The following was presented at DMT 14 (June 1-4, 2014, Newark, DE).

The following was presented at DMT 14 (June 1-4, 2014, Newark, DE). DMT 2014 The following was presented at DMT 14 (June 1-4, 2014, Newark, DE). The contents are provisional and will be superseded by a paper in the DMT 14 Proceedings. See also presentations and Proceedings

More information

Big Data Analytics. Prof. Dr. Lars Schmidt-Thieme

Big Data Analytics. Prof. Dr. Lars Schmidt-Thieme Big Data Analytics Prof. Dr. Lars Schmidt-Thieme Information Systems and Machine Learning Lab (ISMLL) Institute of Computer Science University of Hildesheim, Germany 33. Sitzung des Arbeitskreises Informationstechnologie,

More information

Big Data Challenges. technology basics for data scientists. Spring - 2014. Jordi Torres, UPC - BSC www.jorditorres.

Big Data Challenges. technology basics for data scientists. Spring - 2014. Jordi Torres, UPC - BSC www.jorditorres. Big Data Challenges technology basics for data scientists Spring - 2014 Jordi Torres, UPC - BSC www.jorditorres.eu @JordiTorresBCN Data Deluge: Due to the changes in big data generation Example: Biomedicine

More information

Big Data Challenges in Bioinformatics

Big Data Challenges in Bioinformatics Big Data Challenges in Bioinformatics BARCELONA SUPERCOMPUTING CENTER COMPUTER SCIENCE DEPARTMENT Autonomic Systems and ebusiness Pla?orms Jordi Torres Jordi.Torres@bsc.es Talk outline! We talk about Petabyte?

More information

Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan

Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan Impact of water harvesting dam on the Wadi s morphology using digital elevation model Study case: Wadi Al-kanger, Sudan H. S. M. Hilmi 1, M.Y. Mohamed 2, E. S. Ganawa 3 1 Faculty of agriculture, Alzaiem

More information

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank

Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Danny Wang, Ph.D. Vice President of Business Strategy and Risk Management Republic Bank Agenda» Overview» What is Big Data?» Accelerates advances in computer & technologies» Revolutionizes data measurement»

More information

RevoScaleR Speed and Scalability

RevoScaleR Speed and Scalability EXECUTIVE WHITE PAPER RevoScaleR Speed and Scalability By Lee Edlefsen Ph.D., Chief Scientist, Revolution Analytics Abstract RevoScaleR, the Big Data predictive analytics library included with Revolution

More information

Veracity in Big Data Reliability of Routes

Veracity in Big Data Reliability of Routes Veracity in Big Data Reliability of Routes Dr. Tobias Emrich Post-Doctoral Scholar Integrated Media Systems Center (IMSC) Viterbi School of Engineering University of Southern California Los Angeles, CA

More information

Big Data Hope or Hype?

Big Data Hope or Hype? Big Data Hope or Hype? David J. Hand Imperial College, London and Winton Capital Management Big data science, September 2013 1 Google trends on big data Google search 1 Sept 2013: 1.6 billion hits on big

More information

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith

Now, Next and the Future: IT, Big Data and other Implications for RIM. Presented by Michael S. Smith / http://about.me/mikessmith Now, Next and the Future: IT, Big Data and other Implications for RIM Agenda for This Afternoon Now: What trends are creating implications within the profession? Next: Why is IT now concerned about RIM?

More information

High-Performance Visualization of Geographic Data

High-Performance Visualization of Geographic Data High-Performance Visualization of Geographic Data Presented by Budhendra Bhaduri Alexandre Sorokine Geographic Information Science and Technology Computational Sciences and Engineering Managed by UT-Battelle

More information

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum

Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Trends and Research Opportunities in Spatial Big Data Analytics and Cloud Computing NCSU GeoSpatial Forum Siva Ravada Senior Director of Development Oracle Spatial and MapViewer 2 Evolving Technology Platforms

More information

Data deluge (and it s applications) Gianluigi Zanetti. Data deluge. (and its applications) Gianluigi Zanetti

Data deluge (and it s applications) Gianluigi Zanetti. Data deluge. (and its applications) Gianluigi Zanetti Data deluge (and its applications) Prologue Data is becoming cheaper and cheaper to produce and store Driving mechanism is parallelism on sensors, storage, computing Data directly produced are complex

More information

DIGITAL UNIVERSE UNIVERSE

DIGITAL UNIVERSE UNIVERSE - - - - - - The - - DIGITAL - - - - - - - - - - - E M C D I G I T A L of OPPORTUNITIES RICH DATA & the Increasing Value of the INTERNET OF THINGS - - - - - - - - - - - - - - - - - - - - - - - - - GET STARTED

More information

D.K. Schroder, Introduction to Engineering Design. Problems and Solutions

D.K. Schroder, Introduction to Engineering Design. Problems and Solutions Problems and Solutions Effective Problem Solving Seven Habits of Highly Effective People Be proactive Take initiative, make things happen Begin with the end in mind Know where you are going Put first things

More information

Working with Imagery & LiDAR in ArcGIS 10.2

Working with Imagery & LiDAR in ArcGIS 10.2 Working with Imagery & LiDAR in ArcGIS 10.2 Today s Agenda Online content Tools for working with imagery & LiDAR Data management using mosaic dataset Data dissemination ArcGIS is a Complete Geospatial

More information

Statistical Challenges with Big Data in Management Science

Statistical Challenges with Big Data in Management Science Statistical Challenges with Big Data in Management Science Arnab Kumar Laha Indian Institute of Management Ahmedabad Analytics vs Reporting Competitive Advantage Reporting Prescriptive Analytics (Decision

More information

Transforming ecommerce Big Data into Big Fast Data

Transforming ecommerce Big Data into Big Fast Data Transforming ecommerce Big Data into Big Fast Data Gagan Mehra, Chief Evangelist, Terracotta, Inc. October 22 nd 2013 2013 Terracotta Inc. 1 2013 Terracotta Inc. 1 WHAT IS BIG DATA? 2013 Terracotta Inc.

More information

Proposal for the Theme on Big Data. Analytics. Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK. May 2015

Proposal for the Theme on Big Data. Analytics. Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK. May 2015 Proposal for the Theme on Big Data Analytics May 2015 Qiang Yang, HKUST Jiannong Cao, PolyU Qi-man Shao, CUHK Motivation The world's technological per-capita capacity to store information doubled every

More information

Global environmental information Examples of EIS Data sets and applications

Global environmental information Examples of EIS Data sets and applications METIER Graduate Training Course n 2 Montpellier - february 2007 Information Management in Environmental Sciences Global environmental information Examples of EIS Data sets and applications Global datasets

More information

A Novel Cloud Based Elastic Framework for Big Data Preprocessing

A Novel Cloud Based Elastic Framework for Big Data Preprocessing School of Systems Engineering A Novel Cloud Based Elastic Framework for Big Data Preprocessing Omer Dawelbeit and Rachel McCrindle October 21, 2014 University of Reading 2008 www.reading.ac.uk Overview

More information

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait

CSC590: Selected Topics BIG DATA & DATA MINING. Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait CSC590: Selected Topics BIG DATA & DATA MINING Lecture 2 Feb 12, 2014 Dr. Esam A. Alwagait Agenda Introduction What is Big Data Why Big Data? Characteristics of Big Data Applications of Big Data Problems

More information

This blog entry is targeted at both users (customers) and implementers (Business Partners/Technology companies) of Big Data.

This blog entry is targeted at both users (customers) and implementers (Business Partners/Technology companies) of Big Data. Preface Why I am writing this blog entry now? I am guessing in part that many companies out there would like to engage around Big Data, however back in the Fall of 2011 Big Data was not really on their

More information

SEO. People turn to search engines for questions. When they arrive at your website they are expecting immediate answers

SEO. People turn to search engines for questions. When they arrive at your website they are expecting immediate answers SEO People turn to search engines for questions. When they arrive at your website they are expecting immediate answers What is SEO and what are the advantages of using it? SEO stands for search engine

More information

Web analytics: Data Collected via the Internet

Web analytics: Data Collected via the Internet Database Marketing Fall 2016 Web analytics (incl real-time data) Collaborative filtering Facebook advertising Mobile marketing Slide set 8 1 Web analytics: Data Collected via the Internet Customers can

More information

Big Trouble. Does Big Data spell. for Lawyers? Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado

Big Trouble. Does Big Data spell. for Lawyers? Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado Does Big Data spell Big Trouble for Lawyers? Paul Karlzen Director HR Information & Analytics April 1, 2015 Presented to Colorado Bar Association, Communications & Technology Law Section Denver, Colorado

More information

1. Understanding Big Data

1. Understanding Big Data Big Data and its Real Impact on Your Security & Privacy Framework: A Pragmatic Overview Erik Luysterborg Partner, Deloitte EMEA Data Protection & Privacy leader Prague, SCCE, March 22 nd 2016 1. 2016 Deloitte

More information

Cloud Computing Trends

Cloud Computing Trends UT DALLAS Erik Jonsson School of Engineering & Computer Science Cloud Computing Trends What is cloud computing? Cloud computing refers to the apps and services delivered over the internet. Software delivered

More information

Advanced Methods for Pedestrian and Bicyclist Sensing

Advanced Methods for Pedestrian and Bicyclist Sensing Advanced Methods for Pedestrian and Bicyclist Sensing Yinhai Wang PacTrans STAR Lab University of Washington Email: yinhai@uw.edu Tel: 1-206-616-2696 For Exchange with University of Nevada Reno Sept. 25,

More information

Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics?

Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics? Big and Smart Data for efficient decisions: How to share with decision makers the practices of Big Data Analytics? Ali FOULADKAR (ali.fouladkar@upmf-grenoble.fr) PhD candidate, Grenoble University (UPMF),

More information

BIG DATA AND ANALYTICS

BIG DATA AND ANALYTICS BIG DATA AND ANALYTICS Björn Bjurling, bgb@sics.se Daniel Gillblad, dgi@sics.se Anders Holst, aho@sics.se Swedish Institute of Computer Science AGENDA What is big data and analytics? and why one must bother

More information

What is the number one issue that Organizational Leaders are facing today?

What is the number one issue that Organizational Leaders are facing today? What is the number one issue that Organizational Leaders are facing today? Managing time and energy in the face of growing complexity...the sense that the world is moving faster -Chris Zook (Bain & Company

More information

12/7/2015. Data Science Master s programs

12/7/2015. Data Science Master s programs Data Science Master s programs 1 1 Who are we? Willem-Jan van den Heuvel Tilburg University Ksenia Podoynitsyna Eindhoven University of Technology 2 2 Program What is Data Science? The Data Science Initiative

More information

Big Data Mining Services and Knowledge Discovery Applications on Clouds

Big Data Mining Services and Knowledge Discovery Applications on Clouds Big Data Mining Services and Knowledge Discovery Applications on Clouds Domenico Talia DIMES, Università della Calabria & DtoK Lab Italy talia@dimes.unical.it Data Availability or Data Deluge? Some decades

More information

Big Data and Open Data

Big Data and Open Data Big Data and Open Data Bebo White SLAC National Accelerator Laboratory/ Stanford University!! bebo@slac.stanford.edu dekabytes hectobytes Big Data IS a buzzword! The Data Deluge From the beginning of

More information

Semantic Web in 10 years: Semantics with a purpose

Semantic Web in 10 years: Semantics with a purpose Semantic Web in 10 years: Semantics with a purpose [Position paper for the ISWC2012 Workshop on What will the Semantic Web look like 10 years from now? ] Marko Grobelnik, Dunja Mladenić, Blaž Fortuna J.

More information

Using big data in product design. Executive Director Jesper N. Pedersen

Using big data in product design. Executive Director Jesper N. Pedersen Using big data in product design Executive Director Jesper N. Pedersen Agenda The challenge is Big data a Big thing? Danish Innovation approach 1. Product innovation 2. New online services 3. Smart city

More information

Mobile Monetization Scenario Design & Big Data. Arther Wu Senior Director of Monetization and Business Operation

Mobile Monetization Scenario Design & Big Data. Arther Wu Senior Director of Monetization and Business Operation Mobile Monetization Scenario Design & Big Data Arther Wu Senior Director of Monetization and Business Operation Agenda Quick update of Cheetah Mobile Ad Scenario Design Big Data / Relation with Advertising

More information

EIVA NaviModel3. Efficient Sonar Data Cleaning. Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3. Lars Dall, EIVA A/S

EIVA NaviModel3. Efficient Sonar Data Cleaning. Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3. Lars Dall, EIVA A/S EIVA NaviModel3 Efficient Sonar Data Cleaning Implementation of the S-CAN Automatic Cleaning Algorithm in EIVAs NaviModel3 Lars Dall, EIVA A/S Contents: Introduction to NaviModel3 Cleaning functionalities

More information

You re One in Seven Billion!

You re One in Seven Billion! You re One in Seven Billion! We ve all heard the expression, You re one in a million!. With the ever-growing number of people on the planet, it might be more accurate to say, You re one in seven billion!

More information

class 1 welcome to CS265! BIG DATA SYSTEMS prof. Stratos Idreos

class 1 welcome to CS265! BIG DATA SYSTEMS prof. Stratos Idreos class 1 welcome to CS265 BIG DATA SYSTEMS prof. plan for today big data + systems class structure + logistics who is who project ideas 2 data vs knowledge 3 big data 4 daily data 2.5 exabytes years 2012

More information

Exploiting the power of Big Data

Exploiting the power of Big Data Exploiting the power of Big Data Timos Sellis School of Computer Science and Information Technology timos.sellis@rmit.edu.au ITECHLAW Asia-Pacific Conference, February 26-28, 2014 Melbourne Australia Timeline

More information

Data Mining: Benefits for business.

Data Mining: Benefits for business. Data Mining: Benefits for business. Data Mining enables businesses of all types and sizes to empower their data and gain valuable insight into what decisions to take. Since 2005 the Oversea-Chinese Banking

More information

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010

Flash Memory Arrays Enabling the Virtualized Data Center. July 2010 Flash Memory Arrays Enabling the Virtualized Data Center July 2010 2 Flash Memory Arrays Enabling the Virtualized Data Center This White Paper describes a new product category, the flash Memory Array,

More information

Modern (Computational) Approaches to Big Data Analytics. CSC 576 Computer Science, University of Rochester Instructor: Ji Liu

Modern (Computational) Approaches to Big Data Analytics. CSC 576 Computer Science, University of Rochester Instructor: Ji Liu Modern (Computational) Approaches to Big Data Analytics CSC 576 Computer Science, University of Rochester Instructor: Ji Liu Big Data in Academy SIGKDD 2014 (program page, found 14 big data, 50+ large

More information

Name(s) Class Date. Q1. In 2009, kids ages 11 to 14 spent the most time with this type of media:

Name(s) Class Date. Q1. In 2009, kids ages 11 to 14 spent the most time with this type of media: Name(s) Class Date Directions Kids and parents face off! Find out who is the bigger master of media. Begin by filling out the quiz together. If there are questions that you don t agree on, circle two answers.

More information

Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition

Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition Massive Labeled Solar Image Data Benchmarks for Automated Feature Recognition Michael A. Schuh1, Rafal A. Angryk2 1 Montana State University, Bozeman, MT 2 Georgia State University, Atlanta, GA Introduction

More information

PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015

PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015 PERMANENT SECRETARY MICHAEL DITHMERS SPEECH AT THE CONFERENCE THE EU IN A DIGITAL AGE, 25. FEBRU- ARY 2015 [THE SPOKEN WORD APPLIES] Dear Danish Chamber of Commerce; Lady Neville-Rolfe; ladies and gentlemen.

More information

Why Modern B2B Marketers Need Predictive Marketing

Why Modern B2B Marketers Need Predictive Marketing Why Modern B2B Marketers Need Predictive Marketing Sponsored by www.raabassociatesinc.com info@raabassociatesinc.com www.mintigo.com info@mintigo.com Introduction Marketers have used predictive modeling

More information

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY

INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY INTERNATIONAL JOURNAL OF PURE AND APPLIED RESEARCH IN ENGINEERING AND TECHNOLOGY A PATH FOR HORIZING YOUR INNOVATIVE WORK A SURVEY ON BIG DATA ISSUES AMRINDER KAUR Assistant Professor, Department of Computer

More information

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料

Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 Big Data: Opportunities & Challenges, Myths & Truths 資 料 來 源 : 台 大 廖 世 偉 教 授 課 程 資 料 美 國 13 歲 學 生 用 Big Data 找 出 霸 淩 熱 點 Puri 架 設 網 站 Bullyvention, 藉 由 分 析 Twitter 上 找 出 提 到 跟 霸 凌 相 關 的 詞, 搭 配 地 理 位 置

More information

Parallelism and Cloud Computing

Parallelism and Cloud Computing Parallelism and Cloud Computing Kai Shen Parallel Computing Parallel computing: Process sub tasks simultaneously so that work can be completed faster. For instances: divide the work of matrix multiplication

More information

ETCIC Internships Open to Sophomores:

ETCIC Internships Open to Sophomores: ETCIC Internships Open to Sophomores: If interested in applying for any of these positions, please email emassey1@swarthmore.edu with your resume (and cover letter if required) by Sunday, 9/20 at 11:59pm.

More information

COMP9321 Web Application Engineering

COMP9321 Web Application Engineering COMP9321 Web Application Engineering Semester 2, 2015 Dr. Amin Beheshti Service Oriented Computing Group, CSE, UNSW Australia Week 11 (Part II) http://webapps.cse.unsw.edu.au/webcms2/course/index.php?cid=2411

More information

Ratings, Audiences, & Failed Shows

Ratings, Audiences, & Failed Shows Ratings, Audiences, & Failed Shows TELEVISION RATINGS Before the Show Airs A New Season TV networks test programs Subjects view pilots or season finales for current shows in theaters. Meters record their

More information

Big Data and the Internet of Things

Big Data and the Internet of Things Financial institutions Energy Infrastructure, mining and commodities Transport Technology and innovation Life sciences and healthcare Big Data and the Internet of Things Protecting rights, controlling

More information

Research Note What is Big Data?

Research Note What is Big Data? Research Note What is Big Data? By: Devin Luco Copyright 2012, ASA Institute for Risk & Innovation Keywords: Big Data, Database Management, Data Variety, Data Velocity, Data Volume, Structured Data, Unstructured

More information

Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research

Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research Cloud Computing for Research Roger Barga Cloud Computing Futures, Microsoft Research Trends: Data on an Exponential Scale Scientific data doubles every year Combination of inexpensive sensors + exponentially

More information

Math: Unit Two Vocabulary

Math: Unit Two Vocabulary (2.2) Algorithm- a set of step-by-step instructions for doing something, such as carrying out a computation or solving a problem. (2.8) Ballpark Estimate- A rough estimate 47 + 62 =? Using a ballpark estimate:

More information

Value from Big Data really?

Value from Big Data really? Value from Big Data really? DAMA SA Chapter Meeting: Johannesburg 24 June 2014 Let s talk about Big Data! Page 2 Is Digital Transformation really happening? 1993 2013 Page 3 But before we do that; where

More information

Earth Data Science in The Era of Big Data and Compute

Earth Data Science in The Era of Big Data and Compute Earth Data Science in The Era of Big Data and Compute E. Lynn Usery U.S. Geological Survey usery@usgs.gov http://cegis.usgs.gov U.S. Department of the Interior U.S. Geological Survey Board on Earth Sciences

More information

Internet Safety Guide for Parents

Internet Safety Guide for Parents Internet Safety Guide for Parents How to Talk to Your Kids about Staying Safe Online Presented by Keith Dunn http://www.kdcop.com Page 1 Now I know each and every single one of you is extremely busy. Both

More information

Big Data better business benefits

Big Data better business benefits Big Data better business benefits Paul Edwards, HouseMark 2 December 2014 What I ll cover.. Explain what big data is Uses for Big Data and the potential for social housing What Big Data means for HouseMark

More information

ENHANCING CUSTOMER EXPERIENCE

ENHANCING CUSTOMER EXPERIENCE ENHANCING CUSTOMER EXPERIENCE INSIGHT CONNECTION EXPERIENCE Your Medicare customer has changed forever. INSIGHT CONNECTION EXPERIENCE HISTORY OF CHANGE HMO PPO CDHP HDHP MA PDP POS EPO FSA HSA ACA ACO

More information

White Paper. Are SaaS and Cloud Computing Your Best Bets?

White Paper. Are SaaS and Cloud Computing Your Best Bets? White Paper Are SaaS and Cloud Computing Your Best Bets? Understanding SaaS and Cloud Computing and Service Delivery Options for Real Estate Technology Solutions Joseph Valeri, MBA, MS President, Lucernex

More information

Take Control of your future with this residual income, home based business.

Take Control of your future with this residual income, home based business. Take Control of your future with this residual income, home based business. Who is your online niche business? We re in the business of making your life better by helping you earn a part time income working

More information

Sentrollers and The Internet of Things

Sentrollers and The Internet of Things White Paper May-2013 Sentrollers and The Internet of Things By: Cees Links, Founder and CEO GreenPeak Technologies www.greenpeak.com The new buzzword floating around the world is the Internet of Things,

More information

AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP

AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP AN EFFICIENT SELECTIVE DATA MINING ALGORITHM FOR BIG DATA ANALYTICS THROUGH HADOOP Asst.Prof Mr. M.I Peter Shiyam,M.E * Department of Computer Science and Engineering, DMI Engineering college, Aralvaimozhi.

More information

Harvard Computing Group Report

Harvard Computing Group Report Return On ing business goals Mining for savings Estimating costs Selecting applications Calculating Best Practices of Knowledge Management Recycle Republish Reduce Remove Relevance Harvard Computing Group

More information

HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN

HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN University of Texas at Austin GIS in Water Resources Instructor: Dr. David Maidment HYDROLOGY OF THE TRANSBOUNDARY DRIN RIVER BASIN Wikipedia Elisabeta Poci December, 2011 1 Table of Contents: 1. Introduction

More information

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice

Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Big Data (Adv. Analytics) in 15 Mins. Peter LePine Managing Director Sales Support IM & BI Practice Agenda Big Data in 15 Mins. Goal: Provide a basic understanding of; What is Big Data; Why it s important

More information

Flood Modelling for Cities using Cloud Computing FINAL REPORT. Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby

Flood Modelling for Cities using Cloud Computing FINAL REPORT. Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby Summary Flood Modelling for Cities using Cloud Computing FINAL REPORT Vassilis Glenis, Vedrana Kutija, Stephen McGough, Simon Woodman, Chris Kilsby Assessment of pluvial flood risk is particularly difficult

More information

Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data.

Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data. Good morning. It is a pleasure to be with you here today to talk about the value and promise of Big Data. 1 Advances in information technologies are transforming the fabric of our society and data represent

More information

Big Data Driven Knowledge Discovery for Autonomic Future Internet

Big Data Driven Knowledge Discovery for Autonomic Future Internet Big Data Driven Knowledge Discovery for Autonomic Future Internet Professor Geyong Min Chair in High Performance Computing and Networking Department of Mathematics and Computer Science College of Engineering,

More information

Are You Part of the. modernhomes.org

Are You Part of the. modernhomes.org Are You Part of the Internet A study by the National Association of Realtors, Profile of Home Buyers and Sellers, recently pointed out that 80 percent of homebuyers begin their home search on the Internet,

More information

Collaborations between Official Statistics and Academia in the Era of Big Data

Collaborations between Official Statistics and Academia in the Era of Big Data Collaborations between Official Statistics and Academia in the Era of Big Data World Statistics Day October 20-21, 2015 Budapest Vijay Nair University of Michigan Past-President of ISI vnn@umich.edu What

More information

NEW TOOLS, NEW HEIGHTS IN PERFORMANCE AND EFFECTIVENESS 4.9

NEW TOOLS, NEW HEIGHTS IN PERFORMANCE AND EFFECTIVENESS 4.9 NEW TOOLS, NEW HEIGHTS IN PERFORMANCE AND EFFECTIVENESS 4.9 Intellect PSIM Intellect is a platform for physical security information management with a modular architecture, scaling up to create integrated

More information

We are Big Data A Sonian Whitepaper

We are Big Data A Sonian Whitepaper EXECUTIVE SUMMARY Big Data is not an uncommon term in the technology industry anymore. It s of big interest to many leading IT providers and archiving companies. But what is Big Data? While many have formed

More information

Big data, big business, Big Brother?

Big data, big business, Big Brother? Big data, big business, Big Brother? portrait of hacker and laptop meaning safety data Editor's note: Gerd Leonhard is futurist, keynote speaker, strategist, author and CEO of The Futures Agency. Follow

More information

businessenglishpod.com The Business English podcast for professionals on the move

businessenglishpod.com The Business English podcast for professionals on the move businessenglishpod.com The Business English podcast for professionals on the move Business News 11 iphone Launch Today, were talking about Apple s new mobile phone the iphone actually it s a combination

More information

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP

NEXSAN NST STORAGE FOR THE VIRTUAL DESKTOP NST STORAGE FOR THE VIRTUAL DESKTOP Nexsan s innovative product, the NST5000, is a hybrid storage system with unified protocols and highly dense storage for a combination of great performance, low cost,

More information

Capitalizing on Smarter and Faster Insight with Flash

Capitalizing on Smarter and Faster Insight with Flash 89 Fifth Avenue, 7th Floor New York, NY 10003 www.theedison.com 212.367.7400 Capitalizing on Smarter and Faster Insight with Flash IBM FlashSystem and IBM InfoSphere Identity Insight Printed in the United

More information

Lab 10. Solar and Wind Power

Lab 10. Solar and Wind Power 1 Name Lab 10. Solar and Wind Power INTRODUCTION Sunlight can be used to create heat or generate electrical power. This is referred to as solar energy. It is a clean form of energy production, which doesn't

More information

Big Table in Plain Language

Big Table in Plain Language Big Table in Plain Language Some people remember exactly where they were when JFK was shot. Other people remember exactly where they were when Neil Armstrong stepped on the moon. I remember exactly where

More information

Finding Big Savings in Big Data:

Finding Big Savings in Big Data: Finding Big Savings in Big Data: UNLOCKING THE FULL VALUE OF ENERGY EFFICIENCY PREPARED BY Ethan Goldman Energy Informatics Architect at VEIC Efficiency Vermont Vermont Energy Investment Corporation April

More information

Big Data in Healthcare: Myth, Hype, and Hope

Big Data in Healthcare: Myth, Hype, and Hope Big Data in Healthcare: Myth, Hype, and Hope Woojin Kim, MD Insert Organization Logo Here or Remove Disclosure Co-founder/Shareholder Montage Healthcare Solutions, Inc Consultant Infiniti Medical, LLC

More information

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications

Big Data. What is Big Data? Over the past years. Big Data. Big Data: Introduction and Applications Big Data Big Data: Introduction and Applications August 20, 2015 HKU-HKJC ExCEL3 Seminar Michael Chau, Associate Professor School of Business, The University of Hong Kong Ample opportunities for business

More information

Big Data Systems CS 5965/6965 FALL 2014

Big Data Systems CS 5965/6965 FALL 2014 Big Data Systems CS 5965/6965 FALL 2014 Today General course overview Q&A Introduction to Big Data Data Collection Assignment #1 General Course Information Course Web Page http://www.cs.utah.edu/~hari/teaching/fall2014.html

More information

The Right Stuff: How to Find Good Information

The Right Stuff: How to Find Good Information The Right Stuff: How to Find Good Information David D. Thornburg, PhD Executive Director, Thornburg Center for Space Exploration dthornburg@aol.com One of the most frustrating tasks you can have as a student

More information

On the CyberShARE site you will find this interpolated version (labeled SRTMv4_90m)

On the CyberShARE site you will find this interpolated version (labeled SRTMv4_90m) SRTM Data on Cyber-ShARE The Shuttle Radar Topography Mission (SRTM) data collected by NASA represents the most up-to-date, globally collected topography data set of the Earth. It makes up the first globally

More information

Unprecedented Performance and Scalability Demonstrated For Meter Data Management:

Unprecedented Performance and Scalability Demonstrated For Meter Data Management: Unprecedented Performance and Scalability Demonstrated For Meter Data Management: Ten Million Meters Scalable to One Hundred Million Meters For Five Billion Daily Meter Readings Performance testing results

More information

5 - Low Cost Ways to Increase Your

5 - Low Cost Ways to Increase Your - 5 - Low Cost Ways to Increase Your DIGITAL MARKETING Presence Contents Introduction Social Media Email Marketing Blogging Video Marketing Website Optimization Final Note 3 4 7 9 11 12 14 2 Taking a Digital

More information

06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH

06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH 06 - NATIONAL PLUVIAL FLOOD MAPPING FOR ALL IRELAND THE MODELLING APPROACH Richard Kellagher 1, Mike Panzeri 1, Julien L Homme 1, Yannick Cesses 1, Ben Gouldby 1 John Martin 2, Oliver Nicholson 2, Mark

More information

The Future of Data Management

The Future of Data Management The Future of Data Management with Hadoop and the Enterprise Data Hub Amr Awadallah (@awadallah) Cofounder and CTO Cloudera Snapshot Founded 2008, by former employees of Employees Today ~ 800 World Class

More information