CLARIN (in the) UK Tools and Services

Transcription

1 CLARIN (in the) UK Tools and Services Johann Petrak substituting for Wim Peters Martin Wynne 1

2 Clarin-UK consortium: partners/centres See British Library Centre for Research in Linguistics and Language Sciences, University of Newcastle (CriLLS) Centre for Corpus Research, University of Birmingham Centre for Translation Studies, University of Leeds Endangered Languages Archive, SOAS, University of London Lancaster University: ESRC Centre for Corpus Approaches to the Social Sciences University Centre for Computer Corpus Research on Language 2

3 Clarin-UK consortium: partners/centres The National Centre for Text Mining (NaCTeM), University of Manchester Natural Language Processing Group, University of Sheffield Oxford e-research Centre, University of Oxford The Research Group in Computational Linguistics (RGCL), University of Wolverhampton School of Critical Studies, University of Glasgow School of Humanities, Coventry University 3

4 Situation in the UK: repositories/tools/services Repositories - ELAR (Endangered Languages Archive), Univ. London - NECTE (Newcastle Electronic Corpus of Tyneside English) - OTA (Oxford Text Archive) - SCOTS (Scottish Corpus of Texts and Speech) Online interfaces to corpora - CQPWeb (Corpus Query Processor) - Intellitext - CliC (Corpus Linguistics in Cheshire) Stand-alone tools - GraphColl (tool for collocation building, exploration) - VARD (spelling variation in historical English) - NaCTeM text mining tools 4

5 Situation in the UK: repositories/tools/services Other online tools - Mapping Metaphor (interactive metaphor map) - Wordtree (online interactive corpus concordance) - GATE Mimir / Prospector Processing environments, frameworks - GATE - Wmatrix (online corpus analysis and comparison) Processing services: - GateCloud - CLAWS (POS tagging) See for more information 5

6 Relevant Projects: OpenMinted Main focus: work-flows for text/data mining interoperability Service-oriented infrastructure for text/data mining of scholary content Develop platform, interoperability standards for Registry, Workflow, Annotation Collaboratively create, discover, share Knowledge from scholary text / articles Example domains: Life Sciences, Agriculture, Social Sciences Since June 2015, 3 years 6

7 Relevant Projects: SoBigData Social Mining & Big Data Ecosystem Data Ecosystem, integrate key nation infrastructures Distributed Platform: interoperable methods, services for analysing and visualizing massive and complex datasets Tackle legal issues, ethically safe deployment of big data for social mining Involves data scientists, innovators, public bodies, citizen organizations, SMEs, enterprises Enables cutting-edge, multi-disciplinary social mining experiments => Social sciences aspect Started Sept 2015, 4 years 7

8 GATE NLP toolkit / framework, developed over 20 years Out-of-the box components for language processing (parsers, machine learning, information extraction, named entities,...) GUI (editing documents, annotations, processing pipelines, ontologies,...) Evaluation, benchmarking Ready made processing pipelines (ANNIE, TwitIE, ) New functionality through plugin architecture Third party plugins, pipelines,... Java API for extending through new plugins, applications 8

9 GateCloud / Mimir / Prospector GateCloud: use GATE-based processing services in the cloud - pay-as-you-go access to GATE tools and applications - rent dedicated server to run Mimir - process large batches of documents using own or our pipelines - use HTTP annotation service Mimir: semantic search - web interface (e.g. demo: - search over text, annotations, concept classes, instance URIs - use SPARQL queries to connect instance URIs to ontologies Prospector - web interface (see - aggregate, tabulate, summarize Mimir search results - interactive exploration - show information according to ontology 9

10 Integration of tools and services? Repositories for discussion at a later workshop? Online interfaces to corpora Federated content search, Federated access managment Stand-alone tools Virtual Language Observatory and Language Resources Inventory for discovery, and conversion to web services and Applications for integration in workflows Interoperability? Processing environments integration with CLARIN datasets, and integration of individual tool components Online processing services (GateCloud) Standardization of formats and other conventions? Developers and site managers in the UK willing to take steps to integrate resources. 10

11 THE END 11

12 OpenMinted Architecture Draft 12