Observation that involves

Transcription

1 1

2 Observation that involves People Data Analytic tools 2

3 The Web Observatory aims to bring those together into a global distributed resource 3

4 understanding web evolu1on: - observa1on - experimenta1on

5 The Web Observatory

6 Web evolution The Web of documents The Web of people The Web of data and online social networks Hall, W., & Tiropanis, T. (2012). Web evolution and Web Science. Computer Networks, 56(18), doi: /j.comnet What is the role of literacy in this axis of evolution?

7 Digital Literacy Evolution Engaging with the Web of Documents E-Commerce Web 2.0: Contributing content and data Engaging with Data (Crowdsourcing, Mashups) Contributing Applications Contributing Analytics?

8 The Web as: A mirror A catalyst A lens Thanassis Tiropanis University of Southampton

9 The promise of Big Data Insights inform policy Competitive advantage Innovation Issues: Do we have enough analytic talent? Do we have enough datasets?

10 Big Data 10

11 The promise of the Web of Data Publication of data Combining data Engagement with the crowd Issues: What about non-open data? Queries performance? Analytics performance?

12 Levels of Sharing Open Datasets Shareable Datasets Private & Organisational Datasets Thanassis Tiropanis University of Southampton

13 The Web Observatory is about sharing datasets and analytic applications on a global, distributed scale

14 Sharing on the Web Observatory Sharing Datasets Sharing Ways of Interacting with Datasets Sharing Analytics and Visualisations EXPOSING BOTH DATASETS AND ANALYTICS LINKING EXPLICITLY ANALYTIC TOOLS TO DATASETS USED

15 The case for analytics on distributed datasets Up-to-date datasets Reducing redundancy Exposing part of a dataset when needed Using Personal DataStores 15

16 The case for research on the WO - R dimensions Dave De Roure University of Oxford 16

17 Web Observatory Value Big Data analytics on the Web of Data Sharing and discovering datasets Discovery of analytic applications and visualisations Distributed analytics on up-to-date datasets reducing redundancy Addressing the R-dimensions Engaging communities with analytic resources 17

18 Web of Observatories Harmonisation with Other Observatories! Social Innovation! Interdisciplinary! e-science! Catalogues of Analytic and Visualisation Tools! Open Standards! Novel Analysis and Visualisation Methods! Semantic Catalogues! Harvesting and Archival! Harmonised Access! Open Data Cloud! e-science Infrastructures! Internet Archive! Open Web Analytics! Social Media! Repositories! with Authorised Access! Tiropanis, T., Hall, W., Shadbolt, N., de Roure, D., Contractor, N., & Hendler, J. (2013). The Web Science Observatory. Intelligent Systems, IEEE, 28(2), doi: /mis

19 Web of Observatories Web Observatory Public Engagement WO Datastores WO Tools WO Datastores Web Observatory WO Tools Resource Description WO Datastores Resource Web Observatory Sharing WO Tools Distributed Queries Web Observatory WO Datastores WO Tools Performance Searching WO Datastores Web Observatory WO Tools Thanassis Tiropanis University of Southampton

20 Web Observatory Actors Web Science Trust Web Science Trust network Web Foundation Open Data Institute Web Science DTC W3C Community Group The Internet Archive Industrial partners Research projects (SOCIAM, EINS) SoFWIReD

21 The Southampton Web Observatory

22

23 Southampton Web Observatory (SUWO) Datasets Datasets Datasets Analytic Analytic Visualisation Analytic & Visualisation Visualisation Tools Tools Tools Sharing Distribution Optimisation Interoperability Thanassis Tiropanis University of Southampton

24 SUWO Infrastructure SU Analytic and Visualisation Apps Sharing and Querying across platforms Dataset Description Schema & Catalogue 4Store MongoDB Hadoop HBase SQL Datasource-centric Harvesting Topic-centric Harvesting Wikipedia access Microblogging Clickstream data Web content Thanassis Tiropanis University of Southampton

25 Thanassis Tiropanis University of Southampton Web Observatory Concept People Engaging communities with analytics Publication of catalogues (schema.org) Access with/without credentials Searching and Indexing Distributed Queries Plugged in Datastores and App Servers Links to resources in other Web Observatories Data WO Datastores WO Apps Analytic tools WO Datastores WO Apps WO Datastores WO Apps Harvesting Dataset enrichment/curation Dataset management Dataset profiling and preview Provenance Optimisation Explicit links between apps & datasets used Hosting of analytic apps Hosting of visualisation apps Monitoring dependency on datasets Monitoring dependency on tools

26 Describing WO resources Schema.org People Data Analytic tools 26

27 Harvesting Architecture Ramine Tinati University of Southampton 27

28 API access to shared datasets User Client Authorise Login to Authenticate SUWO web interface Access OAuth server RESTful API SUWO server Xin Wang University of Southampton 28

29 SUWO Architecture & the Web of Observatories WO Datastores WO Tools WO Datastores WO Tools WO Datastores WO Tools WO Datastores WO Tools WO Datastores WO Tools Thanassis Tiropanis University of Southampton

30 IIIT Bangalore Web Observatory IIITB, INFOSYS, COGNIZANT 30

31 RPI Web Observatory 31

32 Discovering Web Observatories 32

33 EINS Evidence base 33

34 Web of Observatories Web Observatory Web Observatory Public Engagement Resource Description Web Observatory Resource Sharing Distributed Queries Performance Web Observatory Web Observatory Searching WO Datastores WO Tools WO Datastores WO Datastores WO Datastores WO Tools WO Tools WO Datastores WO Tools WO Tools

35 Thanassis Tiropanis THANK YOU