Veterinary epidemiology in the era of big data: Value, Volume and Velocity of information extraction

Size: px

Start display at page:

Download "Veterinary epidemiology in the era of big data: Value, Volume and Velocity of information extraction"

Posy Francis
8 years ago
Views:

VETERINARY EPIDEMIOLOGY IN THE ERA OF BIG DATA: VALUE, VOLUME AND VELOCITY OF INFORMATION EXTRACTION Fernanda Dórea Swedish Zoonoses Centre National Veterinary

1 VETERINARY EPIDEMIOLOGY IN THE ERA OF BIG DATA: VALUE, VOLUME AND VELOCITY OF INFORMATION EXTRACTION Fernanda Dórea Swedish Zoonoses Centre National Veterinary Institute 1 Data Mining and Knowledge Discovery Volume Variety Velocity Crawford Revie Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Institute 1 Data Mining and Knowledge Discovery Volume Variety Velocity Crawford

2 Data Mining and Knowledge Discovery The Data Flood part of everyday life Not novel in principle, just different in terms of scale / scope Crawford Revie Core Methods The fundamental tools of AI shifted from logic to probability in the late 1980s, and fundamental progress in the theory of uncertain reasoning underlies many of the recent practical advances. (Peter Norvig, 2011) Crawford Revie Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

1980s, and fundamental progress in the theory of uncertain reasoning underlies many of the recent practical advances.

3 Big data is not anymore a curse!... Crawford Revie 6 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Volume Variety Velocity http://iph.sdsu.

4 Volume Variety Velocity 7 We want MORE results. Volume Who? Where? When? Why? How? Related to whom? 8 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

5 We want them FASTER Velocity A PhD student at SVA tries to solve the following problem: Simulating disease spread using real movement data of all cattle population in Sweden over 8 years was taking a whole day! 9 And we want them for ALL Value 10 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

in Sweden over 8 years was taking a whole day!

6 11 Syndromic surveillance 12 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

7 Velocity Volume 13 Velocity CLINICAL data Wildlife observ. Laboratory submissions Movement data Volume Variety Monitor SPATIAL distribution Monitoring daily counts Explore CONTENTS Value Information ALERTS Herd managem. 14 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

distribution Monitoring daily counts Explore CONTENTS Value Information ALERTS

Knowledge-rich system, but not a KNOWLEDGE-BASE (base of Artificial Intelligence systems) 15 SyS input:

8 SyS input: Variety Value Data Expert Input Classified Data Machine Learning Classification rules Expert Input Updates in the future? Knowledge-rich system, but not a KNOWLEDGE-BASE (base of Artificial Intelligence systems) 15 SyS input: Variety Value Machine Learning Expert Input Value to others? Classification rules 16 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

9 Data is not the bottleneck anymore.....but ACCESS to it may still be... Big data (still) has strong owners... AND lack of comparability Data ownership means that epidemiology respects borders, but diseases do not 17 SyS input: Variety Value Value to others? Taxonomies: Machine Learning Classification rules Human medicine: ICD-10 Expert Input Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

SyS input: Variety Value Value to others?

10 19 20 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Input Standardized Syndromic Classification of Animal Health Data 21 Velocity,

11 SyS input: Variety Value Value to others? Ontologies: Machine Learning Classification rules Human medicine: ICD-10 Expert Input Standardized Syndromic Classification of Animal Health Data 21 Velocity, Volume and Value in the methods {syndromic} 22 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

12 Value in the outputs 23 Value in the outputs {syndromic} Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Velocity CLINICAL data Wildlife observ. Laboratory submissions Volume Variety Monitor SPATIAL distribution Monitoring daily counts Value Information ALERTS Movement data Herd managem.

13 Velocity CLINICAL data Wildlife observ. Laboratory submissions Volume Variety Monitor SPATIAL distribution Monitoring daily counts Value Information ALERTS Movement data Herd managem. Explore CONTENTS {syndromic} 25 Let the data speak for themselves Data-driven Research 26 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Value Information ALERTS Movement data Herd managem.

is not understanding Understanding is not wisdom Clifford Stoll

14 Acknowledgments 27 Data is not information Information is not knowledge Knowledge is not understanding Understanding is not wisdom Clifford Stoll 28 Fernanda C. Dórea National Veterinary Institute, Sweden VPHI Annual Conference:

Information Visualization WS 2013/14 11 Visual Analytics

Information Visualization WS 2013/14 11 Visual Analytics 1 11.1 Definitions and Motivation Lot of research and papers in this emerging field: Visual Analytics: Scope and Challenges of Keim et al. Illuminating the path of Thomas and Cook 2 11.1 Definitions and