Advances in Health Care Predictive Analytics

Transcription

1 Advances in Health Care Predictive Analytics Graphical Models Part I: Intelligent Reasoning with Bayesian Networks Jarrod E. Dalton

2 COLD OR FLU? How do we tell?

3 A Simple Bayesian Network

4 P() Prob. No 70% Yes 30% P() Prob. No 90% Yes 10% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40% A Simple Bayesian Network

5 P() Prob. No 70% Yes 30% =Yes P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40% Causal Reasoning Step 1: Eliminate states inconsistent with observed evidence

6 P() Prob. No 70% Yes 30% =Yes P(Snz., =Yes) Prob. No No 80% No Yes 20% Yes No 50% Yes Yes 50% P( =Yes) Prob. No 60% Yes 40% Causal Reasoning Step 2: Update beliefs of other nodes

7 P() Prob. No 70% Yes 30% =Yes P(Snz., =Yes) Prob. No No 80% No Yes 20% Yes No 50% Yes Yes 50% P( =Yes) Prob. No 60% Yes 40% Factor Marginalization What is the marginal probability of sneezing?

8 P() Prob. No 70% Yes 30% 70% of population does not have a cold among these, 20% sneeze. Among the other 30%, 50% sneeze. P(Snz., =Yes) Prob. No No 80% No Yes 20% Yes No 50% Yes Yes 50% The marginal probability of sneezing is obtained by combining these incidences: P sneezing = Yes = = 0.29 Factor Marginalization What is the marginal probability of sneezing?

9 P() Prob. No 70% Yes 30% P() Prob. No 90% Yes 10% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% A similar calculation of the marginal probability of sneezing before observing that the person had the flu indicated P(sneezing)=17%. P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40%

10 P() Prob. No 70% Yes 30% P() Prob. No 90% Yes 10% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% Evidential Reasoning P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40%

11 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40% Evidential Reasoning

12 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P = No = Yes) = P()??? P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40% Evidential Reasoning

13 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P = No = Yes) = P()??? P( ) P() Prob. No = Yes = %{ 10%{ Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40% Evidential Reasoning

14 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P = No = Yes) = = P( ) Prob. P() Prob. No 95.1% Yes 4.9% No No 99% No Yes 1% Yes No 60% Yes Yes 40% Evidential Reasoning

15 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P = No = Yes) = = P = Yes = No) = = P( ) Prob. P() Prob. No 95.1% Yes 4.9% No No 99% No Yes 1% Yes No 60% Yes Yes 40% Evidential Reasoning

16 Bayes Rule P() Prob. No 90% P ) = P P( ) P() Yes 10% P = No = Yes) = = P = Yes = No) = = P( ) Prob. P( ) Prob. No No 93.7% No Yes 6.3% Yes No 18.4% Yes Yes 81.6% P() Prob. No 95.1% Yes 4.9% Evidential Reasoning No No 99% No Yes 1% Yes No 60% Yes Yes 40%

17 P() Prob. No 70% Yes 30% P() Prob. No 90% Yes 10% P( ) Prob. No No 93.7% No Yes 6.3% Yes No 18.4% Yes Yes 81.6% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% Evidential Reasoning P( ) Prob. No No 99% No Yes 1% Yes No 60% Yes Yes 40%

18 P() Prob. No 70% Yes 30% P( =Yes) Prob. No No 93.7% No Yes 6.3% Yes No 18.4% Yes Yes 81.6% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% =Yes Evidential Reasoning

19 P() Prob. No 70% Yes 30% P( =Yes) Prob. No 18.4% Yes 81.6% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% =Yes Marginal P( =Yes) Prob. No.7(.184)(.95)+.7(.816)(.8)+.3(.184)(.6)+.3(.816)(.5) Yes.7(.184)(.05)+.7(.816)(.2)+.3(.184)(.4)+.3(.816)(.5) Belief Propagation

20 P() Prob. No 70% Yes 30% P( =Yes) Prob. No 18.4% Yes 81.6% P(, ) Prob. No No No 95% No No Yes 5% No Yes No 80% No Yes Yes 20% Yes No No 60% Yes No Yes 40% Yes Yes No 50% Yes Yes Yes 50% =Yes Marginal P( =Yes) Prob. No 73.5% Yes 26.5% Belief Propagation

21 Intercostal When does information flow? When does it not flow?

22 A B C (B unobserved) Intercostal When does information flow? When does it not flow?

23 A B C (B unobserved) Intercostal When does information flow? When does it not flow?

24 A B C (B unobserved) Intercostal When does information flow? When does it not flow?

25 A B C (B unobserved) Intercostal When does information flow? When does it not flow?

26 A B C (B unobserved) NO Intercostal When does information flow? When does it not flow?

27 A B C (B observed) Intercostal When does information flow? When does it not flow?

28 A B C (B observed) NO Intercostal When does information flow? When does it not flow?

29 A B C (B observed) Intercostal When does information flow? When does it not flow?

30 A B C (B observed) NO NO Intercostal When does information flow? When does it not flow?

31 A B C (B observed) Intercostal When does information flow? When does it not flow?

32 A B C (B observed) NO Intercostal When does information flow? When does it not flow?

33 A B C (B observed) Intercostal When does information flow? When does it not flow?

34 A B C (descendent of B observed) Intercostal When does information flow? When does it not flow?

35 EXAMPLE BIRTH OUTCOMES

36

37

38

39

40

41

42

43 OTHER APPLICATIONS OF BAYESIAN NETWORKS

44 Dynamic Bayes Nets Vaccinated Susceptibile t Susceptibile t+1 Susceptible 0 Direct Contact t Gene Infected t Infected t+1 Recovered t Recovered t+1 Dead t Dead t+1

45 Decision Nets T Chemotherapy Remission 100 N Radiotherapy Recurrence 20 M Surgery Cancer Death 0 Staging Decisions Outcomes Utilities

46 Daphne Koller Co-founder of coursera.org Stanford Artificial Intelligence Laboratory (SAIL) Sebastian Thrun (Google X lab, Udacity) Andrew Ng (director of SAIL, co-founder of coursera) Gill Bejerano (Bejerano Lab) Genotype-phenotype linkage in humans Genotype-phenotype linkage between mammals Genome evolution Probabilistic Graphical Models