Demystifying Data Science and Big Data. Natasha Balac, Ph.D. September, 2016

Transcription

1 Demystifying Data Science and Big Data Natasha Balac, Ph.D. September, 2016

2 Background Over 25 Years of Experience in Data Mining Ph.D. in Machine Learning with emphasis on Big Data and Mobile Robots Director of Interdisciplinary Center for Data Science(ICData) at the Qualcomm Institute(CaliIT2) at UCSD Founder and CEO of Data Insight Discovery, Inc. Lecturer UCSD MAS in Data Science and Engineering UCSD Extension Data Mining Certificate Coursera Big Data Specialization

3 University of California, San Diego UCSD CalIT2 Qualcomm Institute Calit2 is taking ideas beyond theory into practice, accelerating innovation and shortening the time to product development and job creation. Where the university traditionally has focused on education and research, Calit2 extends that focus to include development and deployment of prototype infrastructure for testing new solutions in a real-world context.

4 Interdisciplinary Center for Data Science ICData Bridge the Industry and Academia Gap Data Science across discipline and verticals Open Standards and Methodology ICData is a non-profit, public academic organization oto promote, educate and innovate in the area of Data Science Inform, Educate and Train Interdisciplinary Center of for Data Science Research and Collaboration oto utilize the power of Data Science for social good Big Data Technologies oto develop innovative, practical curriculum to broaden participation in the field of Data Science

5 Data Insight Discovery Founded in January 2014 San Diego, CA Women Owned Service Offerings Include Data Driven solutions Predictive Analytics Services Business Intelligence and Analytics Condition Based Maintenance Digital Marketing Systems and IoT Integration Services Big Data Technologies Key Strengths include - Numerous successfully deployed Predictive Analytics Projects - Over 25 years of experience and expertise

6 Interdisciplinary Data Science Research and Collaborations Data Science across discipline and verticals Fraud Detection Modeling Behaviors UCSD s World-renowned Microgrid Bridge the Industry and Academia Gap Interdisciplinary Center of for Data Science Open Standards and Methodology Biomedical Informatics Smart Grid Analytics Anomaly detection Smart City Generates 92% of campus electricity $8 Million+ in annual savings One of the world s most advanced microgrids Inform, Educate and Train Research and Collaboration Sport Analytics Big Data Technologies IoT Population Health, mhealth Nano-engineering White House Big Data Event: Data to Knowledge to Action Launch Partners Award

7 What is Big Data? Extremely large data sets that may be analyzed computationally to reveal patterns, trends, and associations, especially relating to human behavior and interactions IBM, 2012

8 What is Big Data? Wikipedia: an all-encompassing term for any collection of data sets so large and complex that it becomes difficult to process using on-hand data management tools or traditional data processing applications Oxford English Dictionary: data of a very large size, typically to the extent that its manipulation and management present significant logistical challenges

9 How Big is Big Data?

10

11

12 Gartner Hype Cycle for Emerging Technologies 7/16

13 Growing Internet of Things Data

14 What Is The Value In Big Data?

15 Transforming Data Into Insight For Making Better Decisions Gartner, 2013

16 What is Data Mining? A set of technologies that uncovers relationships and patterns within large volumes of data that can be used to predict future behavior and events Predictive Analytics is technology that learns form experience to predict the future outcomes in order to drive better business decisions Extracting / Mining Information/Meaning from data Interesting knowledge (rules, regularities, patterns, constraints) from raw data Implicit, previously unknown and unexpected, potentially extremely useful information from data

17 Terminology Data Science Data Mining Big Data Machine Learning Predictive Analytics Advanced Analytics

18 Predictive Analytics Process Explore Data Find Patterns Perform Prediction s

19 Analytics Maturity Levels

20 Data scientist: The hot new gig in tech Data Scientist: The Sexiest Job of the 21st Century The next sexy job in next 10 years will be statistician Hal Varian, Google Chief Economist Geek Chic Wall Street Journal new cool kids on campus Gartner in 2012 said there would be a shortage of 100,000 data scientists in the United States by 2020 McKinsey Global Institute Big data Report in 2011 By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analytical skills as well as 1.5 million managers and analysts with the know-how to use the analysis of big data to make effective decisions - demand that s 60 percent greater than supply The human expertise to capture and analyze big data is both the most expensive and the most constraining factor for most organizations pursuing big data initiatives Thomas Davenport

21 Data Science Job Growth Not enough Data Scientist Crowdflower survey report: A full 83% of respondents said there weren t enough data scientists to go around By 2018 shortage of ,000 predictive analysts and 1.5M managers / analysts in the US Gartner says the current demand for data scientist exceeds the current supply by factor of three

22 Data Scientist Skill and Characteristics Intellectual curiosity, Intuition Find needle in a haystack Ask the right questions value to the business Communication and engagements Presentation skills Let the data speak but tell a story Story teller drive business value not just data insights Creativity Guide further investigation Business Savvy Discovering patterns that identify risks and opportunities Measure

23 Strata Survey Skills

24 Scoop.it World the Data Science Tools

25 Citizen Data Scientist This is Bob, our new Citizen Data Scientist. He previously worked as a citizen dentist and a citizen pilot. This cartoon was ably drawn by Jon Carter.

26 Thank you! Natasha Balac