DBpedia German: Extensions and Applications

Transcription

1 DBpedia German: Extensions and Applications Alexandru-Aurelian Todor FU-Berlin, Innovationsforum Semantic Media Web, 7. Oktober 2014

2 Overview Why DBpedia? New Developments in DBpedia German Problems in DBpedia 2

3 Why DBpedia? Knowledge Bases are the core of Intelligent Web Applications Gazetteerless NER Question Answering Engines Document Enrichment Relation Extraction Event Detection Large web companies are developing their own alternatives Google Knowledge Graph/Freebase Microsoft Satori KB Wikidata Yahoo Knowledge Graph IBM Watson API, Wolfram Alpha etc. 3

4 DBpedia-LOD Cloud 4

5 International DBpedia Chapters Goal: provide additional resources for extraction, access, services, language specific endpoints and services language specific extension German Chapter addresses German Language URL: 5

6 DBpedia German: What We Offer DBpedia German Data Dumps: DBpedia German SPARQL Endpoint: DBpedia German Spotlight: DBpedia German Live: DBpedia German Live Changesets: Improved interlinking data, e.g. Linked Hypernyms Dataset (hypernyms from the first sentences) 6

7 DBpedia German Statistics Property Value Triples 146 Million Classes 206 Entities 4.3 Million Distinct Subjects 7.6 Million Properties Distinct Objects 36.7 Million Category Improvement Mappings >30% Missing Labels >300% 7

8 DBpedia German Infrastructure Main Sever 1: CPU: 2x Hexacore Xeon Ivy Bridge => 24 vcores Memory: 256 GB Ram SDD ~ 1TB Raid 5 Array HDD ~ 10 TB Raid 5 Array Secondary Servers 2: CPU: Quadcore Xeon Sandy Bridge: =>16 vcores Memory: 32 GB x2 HDD: 1TB RPM x2 8

9 Problems In DBpedia Ontology & Missing Data Missing Labels Missing Types Editing Capabilities Administration 9

10 Missing Labels Why Missing Labels are a problem? People don t understand the ontology New classes and properties are created needlessly Not a true multilingual ontology Language Missing Class Labels Missing Property Labels German French Spanish Italian Polish

11 Missing Labels How Do We Address the Problem Automatically Translate Labels using Translation services Present translation suggestions to editors in a batch mode Allow editors to edit and commit multiple translations at the same time 11

12 Missing Labels: Missingbot Bot-framework for editing the MappingsWiki Rest service for communicating with the mappings wiki and other applications Plugins for the Mappings Wiki in order to review added information 12

13 MissingBot Label Translations 14

14 Missing Types Why are Missing Types a Problem? rdf:type statements are the main way we query a KB Without precise type information there is no easy way to say Which CDU politicians born in berlin List all capitals in Europe List all actors (schauschpieler) in Berlin Without precise type information NER annotations are imprecise You can t filter out or select specific entities Ex: annotate only politicians, or software companies in a text document 15

15 Missing Types Solution: Linked Hypernyms Dataset Cooperation with the Prague University of Economics Extract type information from Hypernyms Significant improvement over instance-types dataset DBpedia Instance Types LHD 1.0 LHD 2.0 Nr. of resources New resources N/A Improvement N/A 52.5 % 44.3% 16

16 LHD Examples from the German DBpedia Dbpedia Resource Dbpedia Types LHD 1.0 Type LHD 2.0 Types esource/brad_pitt esource/tom_hanks wikidata:q5 owl:thing schemaorg:person wikidata:q dul:agent dul:naturalperson dbo:agent dbo:person dbo:actor dbo:actor same dbo:actor dbo:actor esource/wladimir_wladi mirowitsch_putin same dbo:politician dbo:politician esource/barack_obama esource/berlin esource/leipzig same dbo:politician dbo:politician schemaorg:place odp:location dbo:place wikidata:q532 opengis:_feature Same + dbo:populatedplace dbo:settlement urce/capital_city age/großstadt dbo:place dbo:place 17

17 Missing Ontology Editing Capabilities Why are Missing Ontology Editing Capabilities a problem? No good overview of the Ontology No efficient Way to rename or reorganize classes No efficient way to align the ontology with other ontologies 18

18 Missing Ontology Editing Capabilities Web Protégé Integration How to solve the Ontology Editing Problem? Use an advanced Collaborative Ontology Editor Solve the compatibility problem by integrating the editor into the existing framework Solve authentication and synchronization problems Architecture: 19

19 Missing Editing Capabilities 20

20 Why Administration is a Problem Configuring the different DBpedia services is a very complex task DBpedia Static: configuring the abstract extraction, generating datasets and importing them into virtuoso DBpedia Live: creating a Syncwiki, configuring the live extraction and an endpoint for the streaming updates DBpedia Spotlight: configuring a Hadoop cluster for dataset generation and then configuring a rest service DBpedia Lookup: generating the index for the lookup service Debugging: Problems are very specific to a configuration, there is no way to inspect specific issues without replicating the envirtonment 21

21 Addressing the Administration Problem Container Virtualisation Package the different dbpedia services in docker containers Share Conainers together with the configuration Docker Build once run everywhere Filesystem-level versioning Small containers Easy deployment Docker HUB Share Containers Push and Pull ndru/ 22

22 Addressing the Administration Problem: DBpedia+Docker DBpedia Spotlight Static Endpoint Live Endpoint Static Extraction Dockerized DBpedia Live Extraction DBpedia SyncWiki 23

23 Thank You!