What Managers Need to Know about Data Science. Annie Flippo

Transcription

1 What Managers Need to Know about Data Science Annie Flippo

2 Outline What is data science Industry trends What is data The Optimal Data Scientist The Optimal Manager Topics in Data Science Topics in Cloud Computing

3 Who am I? Annie Flippo Data Scientist Software Engineer Product Manager Database Developer

4 What is Data Science?

5 Usage of Data Science Finance: fraud detecaon, score buying habits, calculate risks Insurance: inspect driving habits, assess risks, determine premiums

6 Usage of Data Science Biometrics: wearable devices to monitor and improve health Digital MarkeAng: recommender systems, audience segmentaaon, retargeang, churn predicaon

7 Usage of Data Science Retail: Walmart launches compeaaon to solve business problems and to recruit talent Online: NeHlix launched $1 million prize to improve recommendaaon system

8 Usage of Data Science Healthcare: Heritage Network launched a compeaaon to predict the probability of hospitalizaaon of paaents. ScienAfic: NaAonal Data Science Bowl to predict ocean health: one plankton at a Ame

9 Why Should YOU Care? According to McKinsey 1 (2011), Big Data: The next fron5er for innova5on, compe55on, and produc5vity. By 2018, the United States alone could face a shortage of 140,000 to 190,000 people with deep analyacal skills as well as 1.5 million managers and analysts with the know- how to use the analysis of big data to make effecave decisions

10 Why Should YOU Care? According to Forbes 2 (Oct 2015), The Hunt For Unicorn Data Scien5sts LiCs Salaries For All Data Analy5cs Professionals Experienced data scienasts are paid more than $200k per year Median salary for data scienast increased from $115,250 to $125,000 in one year Managers managing large teams can expect a median salary of $235,000

11 Because it s a growing and exciang field with high compensaaon!

12 Explosion of Data Science Why now? Storage cost has decreased dramaacally CompuAng power has increased exponenaally People are carrying smartphones, mini supercomputers in their pockets Perfect intersecaon of data availability and compuang power for analyacs

13 Massive amount of data Streaming into your company

14 What is data? It can be raw web traffic logs

15 What is data? Semi- structured data from APIs

16 What is data? Or, structured data from databases what to do with all this data?

17 The Data ScienAst Can wrangle data from many sources or formats

18 The Data ScienAst do deep data exploraaons and perform thorough analyses

19 DS Skills Inferred by Job Openings Ph.D. in math, staasacs, engineering or physical science (Is it really required?) Has 5+ years in programming experience in Java, Scala, Python, R, SQL, MapReduce, etc. Has 5+ years experience in most of the Apache Open Source Technologies (e.g. Hadoop, Spark, Hive, Pig, Kaka, etc) * Tell a story like a novelist (coherently and beauafully) * By the Ame you read this footnote, the Apache stack has already grown.

20 The OpAmal Data ScienAst Is a person with deep staasacal and machine learning knowledge, extensive somware engineering skills and well- versed in business strategy!

21 The OpAmal Data ScienAst Take 2 Personality Traits 3 Compulsive Propulsive laziness Drive to create and learn Irritable determinaaon InsensiAvity to pain (hmm ) Integrity Humility

22 The OpAmal DS Manager Former data scienast (good to have but not necessary; that s just asking for another unicorn!) Actually interested in managing people Thirst to learn Apt in managing different projects PaAent and diplomaac to manage a diverse group of data scienasts and business owners Understand when to go with an 80/20 approach

23 Data ScienAsts: The Challenge of Managing Stubbornly Autonomous Experts 4 I no5ced that data scien5sts, but also sta5s5cians and top coders, ocen have difficul5es accep5ng orders from managers who don t have technical skills themselves. - Istvan Hajnal

24 Journey to become a DS Manager Nate Silver on Finding a Mentor, Teaching Yourself StaAsAcs, and Not Sesling in Your Career 5 Find a Mentor (Yes, even if you re already a senior manager) Teach Yourself (online resources, MOOCs) Understand the life- cycle of a data- driven project Just do it!

25 Why Just Do It? Why do I need to learn about data science and manage data projects? I have [insert # of years] years of experience in [insert my industry]. I m comfortable and successful being a [insert your Atle here].

26 Company Structures

27 Data Sources Data projects are lurking everywhere

28 Machine Learning

29 Machine Learning

30 Machine Learning

31 Machine Learning Google X laboratory 5

32 Machine Learning Google Research 6

33 Data Science Concepts PredicAve AnalyAcs ClassificaAon RecommendaAon Systems

34 Big Data Technology

35 Topics in Cloud CompuAng New services added:

36 Your Job: Provide Guidance Do you understand the outcome? What is your recommendaaon to the business? Tell us a data story about your business

37 Gezng Started: Locally Meetups LA R users group LA Machine Learning LA Data Warehouse, BI & AnalyAcs LA Big Data Users Group Conferences: datascience.la bigdatadayla.org

38 Gezng Started: Podcasts dataskepac.com thetalkingmachines.com

39 Gezng Started: MOOCs

40 Good Places to Start Data Science for Business by Foster Provost & Tom Fawces

41 Good Places to Start Doing Data Science by Rachel Schus & Cathy O Neil (mathbabe.org) Free at

42 Good Places to Start The Art of Data Science by Roger Peng & Elizabeth Matsui hsps://leanpub.com/artofdatascience

43 Get Kids Started scratch.mit.edu

44 Slides are available at goo.gl/1x2nmh Thank You! Annie

45 References 1. hsp:// big_data_the_next_fronaer_for_innovaaon 2. hsp:// hunt- for- unicorn- data- scienasts- lims- salaries- for- all- data- analyacs- professionals/ 3. hsp://cdn.oreillystaac.com/en/assets/1/event/119/data%20science %20Bootcamp%20PresentaAon.pdf 4. hsp:// scienasts- challenge- managing- stubbornly- autonomous- experts 5. hsps://hbr.org/2013/09/nate- silver- on- finding- a- mentor- teaching- yourself- staasacs- and- not- sesling- in- your- career/ 6. hsp:// a- big- network- of- computers- evidence- of- machine- learning.html 7. hsp://research.google.com/archive/unsupervised_icml2012.html