How To Understand The City Of Hong Kong

Transcription

1 OGCIO Seminar on PSI/Data.One PSI and Big Data Jiannong Cao Department of Computing Hong Kong Polytechnic University

2 Big Data TB (10 12 bytes) PB (10 15 bytes) EB (10 18 bytes) ZB (10 21 bytes)... The World creates about 2.5EB data every day The total amount of global data reached 2.8ZB report by International Data Corporation(IDC) in Dec Where does the data come from Internet & Web Sensing & IoT (M2M) Enterprises Government Slide 2

3 Opportunities of Big Data Answer formerly unanswerable questions Traditional applications but with real-time processing volume of data, faster and more accurate Formulate new questions New applications where solutions exist only when data becomes big enough Discover invisible knowledge New knowledge is discovered from different sources of data of big volume of separate Make evidence based predictions / decisions In particular, shift from causality (why) to correlations (what happens) Slide 3

4 Big Data Difficulties in big data research Cannot get the data Lack of effective means for analyzing the data Limited use of the data Decide Analyze Acquire Organize PSI provides open data sets for big data research Slide 4

5 PSI Initiatives Hong Kong Beijing Shanghai Slide 5

6 15 Categories Hong Kong PSI Dataset Air pollution indices Buildings Charitable fund-raising activities Food and environmental hygiene Geo-referenced public facility data Image resources Law and order Marine News and information Population Census statistics Property market statistics Public transport Real-time traffic data Water quality Weather data Slide 6

7 14 categories Beijing PSI Dataset Tourism Dining Transportation Healthcare Entertainment Shopping Religion Education Social Welfare Living Services Housing Environment Enterprise Rural Residents Slide 7

8 7 categories Shanghai PSI Dataset Law and Order Enterprise Healthcare Transportation Environment Statistics Property Slide 8

9 PSI Datasets PSI Data Format Data Access Development Support Beijing files (e.g. csv, XML) Direct download API for map, transport, search Shanghai files (e.g. csv, XML) Direct download N/A Hong Kong files (e.g. csv, XML, mdb) Direct download RSS subscription N/A Slide 9

10 Opportunities for Big Data Research Tourism Business Strategy Education Green City Healthcare Easy Life Slide 10

11 Tourism Public Toilet Free Wi-Fi Quality Dining Shopping Cheapest Route Geo-referenced Public Facility Data Food and Environmental Hygiene Shopping Malls Public Transport Slide 11

12 Green City Anti-Pollution Action Traffic Scheduling Navigation Air Pollution Indices Real-time Traffic Data Slide 12

13 Business Strategy Investment Retail Store Planning Market Research Buildings Property Market Statistics Food and Environmental Hygiene Population Census Statistics Slide 13

14 Easy Life Route Plan Parking Leisure Air Pollution Indices Weather Data Real-time Traffic Data Geo-Referenced Public Facility Data Slide 14

15 PSI-enabled Big Data Research Big data analytics for urban transportation Joint analysis on urban air quality & traffic Real-time Traffic Data Air Pollution Indices Data Slide 15

16 PSI-enabled Big Data Research Big data analytics for urban transportation Urban transportation planing & design With PSI on real-time traffic data, we can mine the correlation between two roads detect the congestion points evaluate the effectiveness of urban traffic planning Intelligent transportation system With PSI on real-time traffic data, we can analyze congestion state of traffic flows provide a user with the practically fastest route to a destination at a given time Slide 16

17 Traffic State in Hong Kong Slide 17

18 PSI-enabled Big Data Research Urban air quality estimation With the PSI on real-time traffic and air pollution data, we can learn the historical and real-time air quality data estimate the fine-grained air quality information based on limited number of monitoring stations predict air quality information throughout the city in future Joint analysis on urban air quality & traffic With the PSI on real-time traffic and air pollution data, we can find out the relationship between urban air quality & traffic estimate the fine-grained air quality with traffic information calculate maximal traffic volume with air quality constraints Slide 18

19 Air quality monitoring stations in HK from Environmental Protection Department of the Government of the HKSAR Slide 19

20 Air quality statistics of areas in HK Roadside API of Mong Kok in HK Roadside API of Central in HK Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months General API of Sha Tin in HK General API of Yuen Long in HK Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months Slide 20

21 Example of joint analysis on air quality & traffic Roadside API of Mong Kok in HK Roadside API of Central in HK Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec Months 70 General API of Sha Tin in HK 80 General API of Yuen Long in HK Jan Mar May Jul Sep Nov Months Jan Mar May Jul Sep Nov Months Slide 21

22 PSI sheds new light on big data research Various data sources Valuable data PSI offers a lot of opportunities Operational efficiency and productivity Public utilities to reduce consumption Produce safety from farm to fork Value for money for citizens Customize actions based on population segments Fraud detection and prevention Prevent crime waves Conclusion Slide 22

23 Slide 23