Mario Bojilov Meta Business Systems 20 February 2013
What is Big Data Volume 90% of data in the world was created in the last 2 years
What is Big Data Volume 90% of data in the world was created in the last 2 years 2.5EB are created every day Gigabyte (GB) - 1,024 Terabyte (TB) - 1,024GB Petabyte (PB) - 1,024TB Exabyte (EB) - 1,024PB
What is Big Data Velocity Customer Satisfaction/Churn Social Media Fraud
What is Big Data Variety Structured Semi-structured Unstructured
Big Data Technologies Hadoop/MapReduce
Big Data Technologies Hadoop/MapReduce
Big Data Technologies R - free software environment for statistical computing and graphics http://www.r-project.org/
Big Data Technologies MongoDB (from "humongous") - a scalable, highperformance, open source, NoSQL database. Craigslist Archiving Disney Gaming Foursquare Social Analytics MTV Networks Content Management
Big Data Technologies Cassandra - highly scalable, open-source, distributed, structured key-value database (developed by Facebook) ebay Netflix Twitter Reddit Digg 300TB/400
Big Data Architecture
Big Data Architecture
Big Data Examples fighting pirates (on the high seas) $7,000,000,000 (Source: Oceans Beyond Piracy)
Big Data Examples fighting pirates (on the high seas) ArcGIS http://www.businessinsider.com/how-to-fight-pirates-with-big-data-2012-12?0=sai
Big Data Examples fighting pirates (on the high seas) ArcGIS 54% (International Maritime Bureau)
Big Data Examples and graffiti (in the city) Status Protest High value marks Patterns Low mobility
Big Data Examples in Audit Payroll Recalculation Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Map Name: Salary: $200 Name: Overtime: $100 Name: JS Salary: $300 Name: JS Overtime: $25 Salary: $250 Overtime: $50
Big Data Examples in Audit Payroll Recalculation Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $0 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Salary: $X $200 $0 Leave: Allowance: Overtime: $Y $X $50 Deduction: Leave: Allowance: $Y $Z $X Deduction: Leave: $Y $Z Deduction: $Z Map Name: Salary: $200 Name: Overtime: $100 Name: JS Salary: $300 Name: JS Overtime: $25 Salary: $250 Overtime: $50 Reduce Name: Total: $2,500 Name: JS Total: $3,200 Total: $2,850
Big Data Examples in Audit Payroll Recalculation P1 $2500 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500
Big Data Examples in Audit Payroll Recalculation P1 $2600 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500 P2 $2300 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2500 Mrs. Z $8500
Big Data Examples in Audit Payroll Recalculation P1 $2600 Mr. X $5500 JS $3200 Ms. Y $1500 PW $2850 Mrs. Z $8500 P2 $2300 Mr. X $5500 JS $3400 Ms. Y $1500 PW $2500 Mrs. Z $8500 P26 $3500 Mr. X $6500 JS $4000 Ms. Y $2000 PW $3000 Mrs. Z $9500
Big Data Examples in Audit Fraud Detection
Big Data Examples in Audit Fraud Detection Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $0 Deduction: Leave: Line Item $Y $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Map Name: Line Item 1-1: $200 Name: Line Item 15000-8: $100 Name: JS Line Item 2-1: $300 Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $500 Deduction: Leave: Line $Y Item $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Name: JS Line Item 14000-3: $25 Line Item 3-1: $250 Line Item 2200-1: $50
Big Data Examples in Audit Fraud Detection Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $0 Deduction: Leave: Line Item $Y $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Salary: Name: $200 JS Overtime: Salary: Name: $200 $0 Allowance: Overtime: Line Item $X $0 1: $200 Leave: Allowance: Line $Y Item $X 2 : $500 Deduction: Leave: Line $Y Item $Z 3 : $X Deduction: Line Item $Z 4 : $Y Line Item 5 : $Z Map Name: Line Item 1-1: $200 Name: Line Item 15000-8: $100 Name: JS Line Item 2-1: $300 Name: JS Line Item 14000-3: $25 Line Item 3-1: $250 Line Item 2200-1: $50 Reduce Name: -1 Benford 1: 0.31 Name: -9 Benford 9: 0.05 Name: JS-1 Benford 1: 0.32 Name: JS-4 Benford 4: 0.15 Name: JS-9 Benford 9: 0.051-1 Benford : 0.295-9 Benford 9: 0.05
And, Dr. Seuss. If you read with your eyes shut you re likely to find that the place where you re going is far, far behind.
And, Dr. Seuss. If you read with your eyes shut you re likely to find that the place where you re going is far, far behind. SO that s why I tell you to keep you eyes wide. Keep them wide open at least on one side.
Thank You! Mario.Bojilov@mbsys.com.au @mariogb www.linkedin.com/in/mariobojilov big-data-for-organisational-leaders.blogspot.com.au/ www.scoop.it/t/big-data-for-organisational-leaders