Decoding the Readiness of Big Data Vincent Ng. The Hong Kong Institution of Engineers Information Technology Division

Transcription

1 Decoding the Readiness of Big Data Vincent Ng The Hong Kong Institution of Engineers Information Technology Division

2 Big Data TB (10 12 bytes) PB (10 15 bytes) EB (10 18 bytes) ZB (10 21 bytes)... The World creates about 2.5EB data every day The total amount of global ldata reached 2.8ZB report by International Data Corporation(IDC) in Dec Where does the data coming from Internet & Web Sensing & IoT (M2M) Enterprises Government

3 Big Data Big Volume Sizes of the data Big Velocity Speed of data processing Big Variety Large number of diverse data sources to integrate

4 Will Big Data change our Life Computers in cars know where you go, when you go, how fast you go, how many times you stop along the way, whether you stay in your lane, what your average MPG is, how you like your temperature, how close you get before stepping on the brake, and tens of thousands of other facts.instantly. Analyzing all of this data rapidly allows a self driving car to: Anticipate where you are going by looking at driving history Check road signs using sensors to know what the speed limit is or if a stop sign is approaching Alert and activate your braking and steering systems if pedestrians are in the street or you re too close to the curb or you drift into another lane or you doze off.

5 Will Big Data change our Life

6 Opportunities of Big Data Answer formerly unanswerable questions Traditional applications but with real time processing of big volume of data, faster andmoreaccurate accurate Formulate new questions Newapplications wheresolutions exist only whenvolume ofdata becomes big enough Discover invisible knowledge New knowledge is discovered from different separate sources of data Mk id b d di ti / d i i Make evidence based predictions / decisions In particular, shift from causality (why) to correlations (what happens)

7 Elderly Care program of the Evangelical Lutheran Good Samaritan Society Proactively monitor and manage for home based eldercare Using sensor technology to identify developing medical conditions before they become problems Big Data analytics software consolidates sensor information along with clinical and operational data on patients. The data is collected 24/7 and delivered securely online via an integrated dashboard to a licensed nurse who reviews it daily. big data analytics support elderly care good samaritanit society 24552

8 Are you ready 5 Stages of analytical capability Analytically impaired Localized analytics Analytic aspirations i Analytic companies Analytic competitors Ernest and Young 2014

9 Are you ready To what extent does the organization possess analytics skills? To what extent do the organizations technology tools enable analytics lti capabilities? To what extent has the organization set analytical objectives? To what extent is the organization s senior leadership supportive of analytics initiatives, or taking a lead on them? To what extent has the organization embedded a culture of analytics? To what extent has the organization developed analytics? To what extent has the organization considered the legal challenges of big data? To what extent has the organization sought to mitigate other potential risks, including cybersecurity issues, related to big data? Ernest and Young 2014

10 Are you ready Data People Big data Tools culture How to start

11 Data Your data Hong Kong PSI Dataset

12 People 5 key roles (Internal/External) Data Hygienists Data Explorers Business Solution Architects Data Scientists Campaign Experts

13 Big Data Technologies/Tools

14 Joint IBM/PolyU Enterprise Data Analytics Laboratory EDAL focuses on the big data research on design of software tools, and analytical algorithms for enterprise and social media data. Aim to support knowledge transfer to the communities and enterprises

15 Thank You!