Copyright (c) 2012, Meta Business Systems. Mario Bojilov Meta Business Systems 20 February 2013

Transcription

1 Mario Bojilov Meta Business Systems 20 February 2013

2 What is Big Data Volume 90% of data in the world was created in the last 2 years

3 What is Big Data Volume 90% of data in the world was created in the last 2 years 2.5EB are created every day Gigabyte (GB) - 1,024 Terabyte (TB) - 1,024GB Petabyte (PB) - 1,024TB Exabyte (EB) - 1,024PB

4 What is Big Data Velocity Customer Satisfaction/Churn Social Media Fraud

5 What is Big Data Variety Structured Semi-structured Unstructured

6 Big Data Technologies Hadoop/MapReduce

7 Big Data Technologies Hadoop/MapReduce

8 Big Data Technologies R - free software environment for statistical computing and graphics

9 Big Data Technologies MongoDB (from "humongous") - a scalable, highperformance, open source, NoSQL database. Craigslist Archiving Disney Gaming Foursquare Social Analytics MTV Networks Content Management

10 Big Data Technologies Cassandra - highly scalable, open-source, distributed, structured key-value database (developed by Facebook) ebay Netflix Twitter Reddit Digg 300TB/400

11 Big Data Architecture

12 Big Data Architecture

13 Big Data Examples fighting pirates (on the high seas) $7,000,000,000 (Source: Oceans Beyond Piracy)

14 Big Data Examples fighting pirates (on the high seas) ArcGIS

15 Big Data Examples fighting pirates (on the high seas) ArcGIS 54% (International Maritime Bureau)

16 Big Data Examples and graffiti (in the city) Status Protest High value marks Patterns Low mobility

17 Big Data Examples in Audit Payroll Recalculation Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Map Name: Salary: $200 Name: Overtime: $100 Name: JS Salary: $300 Name: JS Overtime: $25 Salary: $250 Overtime: $50

18 Big Data Examples in Audit Payroll Recalculation Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $50 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Map Name: Salary: $200 Name: Overtime: $100 Name: JS Salary: $300 Name: JS Overtime: $25 Salary: $250 Overtime: $50 Reduce Name: Total: $2,500 Name: JS Total: $3,200 Total: $2,850

19 Big Data Examples in Audit Payroll Recalculation P1 $2500 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500

20 Big Data Examples in Audit Payroll Recalculation P1 $2600 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500 P2 $2300 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2500 Mrs. Z $8500

21 Big Data Examples in Audit Payroll Recalculation P1 $2600 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500 P2 $2300 Mr. X $5500 JS $3400 Ms. Y $1500 PW $2500 Mrs. Z $8500 P26 $3500 Mr. X $6500 JS $4000 Ms. Y $2000 PW $3000 Mrs. Z $9500

22 Big Data Examples in Audit Fraud Detection

23 Big Data Examples in Audit Fraud Detection Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $0 Deduction: Leave: Line Item $Y $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Map Name: Line Item 1-1: $200 Name: Line Item : $100 Name: JS Line Item 2-1: $300 Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $500 Deduction: Leave: Line $Y Item $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Name: JS Line Item : $25 Line Item 3-1: $250 Line Item : $50

24 Big Data Examples in Audit Fraud Detection Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $0 Deduction: Leave: Line Item $Y $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $500 Deduction: Leave: Line $Y Item $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Map Name: Line Item 1-1: $200 Name: Line Item : $100 Name: JS Line Item 2-1: $300 Name: JS Line Item : $25 Line Item 3-1: $250 Line Item : $50 Reduce Name: -1 Benford 1: 0.31 Name: -9 Benford 9: 0.05 Name: JS-1 Benford 1: 0.32 Name: JS-4 Benford 4: 0.15 Name: JS-9 Benford 9: Benford : Benford 9: 0.05

25 And, Dr. Seuss. If you read with your eyes shut you re likely to find that the place where you re going is far, far behind.

26 And, Dr. Seuss. If you read with your eyes shut you re likely to find that the place where you re going is far, far behind. SO that s why I tell you to keep you eyes wide. Keep them wide open at least on one side.

27 Thank big-data-for-organisational-leaders.blogspot.com.au/