Two Tools for the Analysis of Longitudinal Data: Motivations, Applications and Issues
|
|
|
- Lesley Bailey
- 10 years ago
- Views:
Transcription
1 Two Tools for the Analysis of Longitudinal Data: Motivations, Applications and Issues Vern Farewell Medical Research Council Biostatistics Unit, UK Flexible Models for Longitudinal and Survival Data Warwick, UK July 27, 2015
2 Introduction Healthy Disabled Dead Subjects/patients observed repeatedly over a period of time. Disease Free Death Disease When seen, can be classified into different states.
3 Estimation Transition rates typically modelled as relative risk regression models. λ (a,b)i (t x i (t)) = λ (a,b)0 (t) exp(β x i (t)) Transition rate from state a to b for subject i Maximum Likelihood Estimation Continuous time: Individual contribution is the probability of an observed transition between two time points which is a sum of the possible pathways if there are unobservable states. Intermittent Observation: Contribution is probability of the observed state change between two time points of observation. May involve standard calculation of transition probabilities for stochastic processes or more specialised computer code (R).
4 Psoriatic Arthritis (PsA) Inflammatory arthritis associated with psoriasis Joint involvement is similar to rheumatoid arthritis but general patterns differ Disease activity is reflected in joints being swollen (effused) and/or painful (tender) Activity is reversible Disease progression is taken to be reflected in damaged joints Damage is generally held to be irreversible Quality of Life - functional disability [HAQ] Six monthly data on 600 patients entering a clinic since 1978 (HAQ collected annually since 1993)
5 Three-state Model for HAQ States Y=1 No or Low Disability Y=2 Moderate Disability Y=3 Severe Disability
6 Findings from three-state model for HAQ Y=1 No or Low Disability Y=2 Moderate Disability Y=3 Severe Disability Patients spend twice as long, on average, in the no disability state than the others. 46% did not change states. 27% changed in only one direction. 27% both improved and worsened.
7 Regression modelling Important to adjust for disease activity which is rapidly fluctuating time-dependent ordinal variable. Three States: 0, (1-5), 5+ joints swollen or painful [W (t): Will generate 2 binary indicator variables in three-state model.] two other variables of direct interest: Number of damaged joints (less changeable time-dependent variable) [X(t)] Sex (time-independent) [Z] Use relative risk regression modelling of transition rates between states. Only observe patients intermittently at the times of patient visits.
8 Assumptions To fit this model we need to make assumptions Panel data generates intermittent observation of states and explanatory variables Typically assume transition rates are piecewise constant: Baseline rates piecewise constant Time-dependent explanatory variables assumed constant between clinic visits To assess second assumption, we jointly modelled activity and disability Nine-state model created for activity and disability Constraints on baseline intensities and regression parameters required to ensure equivalence with three-state disability model of interest
9 Nine-state Model Y=1, W=1 (1) Y=2, W=1 (2) Y=3, W=1 (3) Y=1, W=2 (4) Y=2, W=2 (5) Y=3, W=2 (6) Y=1, W=3 (7) Y=2, W=3 (8) Y=3, W=3 (9)
10 Time-dependent explanatory variables assumed constant between clinic visits Essentially a situation of measurement error Large literature on measurement error in explanatory variables Errors often have mean zero Attenuation is usually seen Some work in survival analysis on infrequently updated time-dependent explanatory variables Here interest in mismeasured variable is for adjustment purposes Assume interest is in relationships not prediction when use of observed variables may be more sensible
11 Nine-state Model Y=1, W=1 (1) Y=2, W=1 (2) Y=3, W=1 (3) Y=1, W=2 (4) Y=2, W=2 (5) Y=3, W=2 (6) Y=1, W=3 (7) Y=2, W=3 (8) Y=3, W=3 (9)
12 Constrain the regression coefficients in the rates for all upward transitions between the same two Y (HAQ) states to be same and, similarly, for downward transitions. Transition rates, specified by the baseline transitions rates and the regression coefficients, between the same two W (Activity) states are constrained to be identical. Need to model the marginal distribution of (W (t ) X(t ), Z) to get at the joint distribution, (Y (t) W (t ), X(t ), Z). The baseline transition rates between states of the Y (t) sub-process are unconstrained to model the dependence of Y (t) process on W (t ). Explanatory variables permitted to modify baseline transition rates for the W (t) sub-process. Handles confounding and mimics the usual regression formulation where no assumption of independence between explanatory variables is made.
13 Multi-state Representations Misspecified Model Expanded Model Disability Variable Transition Estimate (95% CI) Estimate (95% CI) Sex Male v Female ( , ) ( , ) Male v Female ( , ) ( , ) Male v Female ( , ) ( , ) Male v Female ( , ) ( , ) Number of Damaged Joints ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) ( , ) Number of Active Joints [1, 5] v (0.1774, ) (0.4972, ) [1, 5] v ( , ) ( , ) [1, 5] v ( , ) ( , ) [1, 5] v ( , ) ( , ) > 5 v (0.4269, ) (1.1409, ) > 5 v (0.1158, ) (0.6943, ) > 5 v ( , ) ( , ) > 5 v ( , ) ( , )
14 Findings Both attenuation and strengthening of effects seen Substantial attenuation found for the effects of activity on disability Consequences may be substantial with regard to inference and conclusions drawn Treatment ignored Adjust for marginal distribution of activity as influenced by standard treatment decisions
15 Hand Joints Distal Interphalangeal Joints (DIP) Proximal Interphalangeal Joints (PIP) Metacarpophalangeal Joints (MCP) MCP1 PIP1
16 Individual Joint Location Models Model damage in the 14 hand joints Use Multi-state Models Four states for each of the 14 joint locations State 1: Damage in neither hand, ( D L, D R ) State 2: Damage in the right hand only, ( D L, D R ) State 3: Damage in the left hand only, (D L, D R ) State 4: Damage in both hands, (D L, D R ) Patient-specific random effects, U s
17 Model for Specific Joint Location in Both Hands λ 12 U k Right Joint Only Damaged 2 DLDR λ 24 U k Neither Joint Damaged 1 4 DLDR DL D R Both Joints Damaged λ 13 U k 3 D L D R Left Joint Only Damaged λ 34 U k U k Γ(1/θ, 1/θ)
18 Damage and Activity at Joint Level What is the relationship between damage and (dynamic course of) activity at the individual joint level? Define four models (for the lth joint location)
19 Damage and Activity at Joint Level Transition between no damage (State 1) and damage in right hand (State 2) λ (l) 12k (t) = u kλ 012 exp(α L12 A (l) L (t) + τ R12T (l) R (t) + ɛ R12E (l) R (t)) T R : Indicator for right joint tender E R : Indicator for right joint effused (swollen) A L : Indicator for left joint active (tender or swollen) λ 12 U k Right Joint Only Damaged 2 DLDR λ 24 U k Neither Joint Damaged 1 4 DLDR DL DR Both Joints Damaged λ 13 U k 3 DLD R Left Joint Only Damaged λ 34 U k
20 Damage and Activity at Joint Level Transition between no damage (State 1) and damage in left hand (State 3) λ (l) 13k (t) = u kλ 013 exp(α R13 A (l) R (t) + τ L13T (l) L (t) + ɛ L13E (l) L (t)) T L : Indicator for left joint tender E L : Indicator for left joint effused (swollen) A R : Indicator for right joint active (tender or swollen) λ 12 U k Right Joint Only Damaged 2 DLDR λ 24 U k Neither Joint Damaged 1 4 DLDR DL DR Both Joints Damaged λ 13 U k 3 DLD R Left Joint Only Damaged λ 34 U k
21 Damage and Activity at Joint Level Transition between only right damage (State 2) and damage in both hands (State 4) λ (l) 24k (t) = u kλ 024 exp(τ L24 T (l) L (t) + ɛ L24E (l) L (t)) T L : Indicator for left joint tender E L : Indicator for left joint effused (swollen) λ 12 U k Right Joint Only Damaged 2 DLDR λ 24 U k Neither Joint Damaged 1 4 DLDR DL DR Both Joints Damaged λ 13 U k 3 DLD R Left Joint Only Damaged λ 34 U k
22 Damage and Activity at Joint Level Transition between only left damage (State 3) and damage in both hands (State 4) λ (l) 24k (t) = u kλ 024 exp(τ L24 T (l) L (t) + ɛ L24E (l) L (t)) T L : Indicator for right joint tender E L : Indicator for right joint effused (swollen) λ 12 U k Right Joint Only Damaged 2 DLDR λ 24 U k Neither Joint Damaged 1 4 DLDR DL DR Both Joints Damaged λ 13 U k 3 DLD R Left Joint Only Damaged λ 34 U k
23 Damage and Activity at Joint Level Baseline intensities and parameter effects are constrained to be the same across the 14 hand joint locations Because of the panel nature of the data, activity (represented by joint pain and swelling) is assumed to remain constant between clinic visits Assume activity variables do not change state at the same time damage occurs
24 Joint Level Activity/Damage Results Table: Estimated baseline intensities, intensity ratios and random effects variance Parameter Estimate 95% confidence interval Baseline Intensities λ (0.0021, ) λ (0.0021, ) λ (0.0149, ) λ (0.0158, ) No previous damage in either joint Tenderness in transitive joint 2.76 (2.06, 3.70) Effusion in transitive joint 4.47 (3.38, 5.90) Activity in opposite joint 1.18 (0.90, 1.55) Transitive joint active in past 2.14 (1.68, 2.71) Opposite joint active in past 1.10 (0.86, 1.41) Opposite joint damaged Tenderness in transitive joint 2.24 (1.51, 3.32) Effusion in transitive joint 2.19 (1.40, 3.41) Transitive joint active in past 1.37 (1.00, 1.86) Random effect variance 3.81 (2.98, 4.88)
25 Causality Granger causality is linked to time ordering, and generally specified in discrete time Processes X(t), Y (t) and U(t) represents all the information in the universe up to time t. X(t) Granger causal for Y (t) if Y better predicted at time t + 1 given U(t) than given U(t)withoutX(t) Otherwise, X(t) Granger non-causal for Y (t). Local independence (Schweder(1970)) is often taken to infer Granger non-causality in continuous time (Aalen, 1987; Didelez, 2007) Represents a dynamic statistical approach which incorporates time naturally. Natural way to model potential causal relationships. In multi-state models, local dependence/independence is reflected in transition intensities
26 A. Bradford Hill s Criteria to Infer Causation (1965) Non-experimental data show an association. Other aspects to be considered. 1 Strength of the association. 2 Consistency of the association. 3 Specificity of the association. 4 Temporal relationship of the association. 5 Biological gradient (dose response relationship) 6 Plausibility 7 Coherence 8 Experimental or semi-experimental evidence. 9 Analogy. (e.g. drugs in pregnancy given thalidomide experience)
27 US Surgeon s General s Advisory Committee s Report on Smoking and Health (1964) CHAPTER 3: Criteria for Judgment Criteria of the Epidemiologic Method Statistical methods cannot establish proof of a causal relationship in an association. The causal significance of an association is a matter of judgment... Consistency of the association. Strength of the association. Specificity of the association. Temporal relationship of the association. Coherence of the association.
28 Interpretation and Causal Implications The link between activity and damage appears local/specific to the joint on the particular hand local dependence Activity or not in the corresponding joint on the left (right) hand appears overall not to influence the damage process on the right (left) hand local independence Large effect sizes for these significant associations and probable differential effects of tender only and effused Further strengthens argument for a putative causal relationship between activity and damage [specificity, strength of association and dose response]
29 Further Extensions Define random effect distributions to be a mixture of zeros and non-zeros to define mover-stayer models. Use hidden or partially hidden multi-state models to account for uncertainty in classification.
30 Motivating Data Health Assessment Questionnaire (HAQ): self-report functional disability measure Treat HAQ as a continous variable (not categorised as previously) HAQ lies in range 0 (no disability) to 3 (completely disabled) Data on 382 patients with more than one HAQ measurement. (2107 HAQ observations)
31 Distribution of HAQ values Frequency HAQ
32 Basic Model Let Y ij be a semi-continuous variable for the ith (i = 1,..., N) subject at time t ij (j = 1,..., n i ). Represented by two variables. The occurrence variable Z ij = { 0 if Yij = 0 1 if Y ij > 0 The intensity variable g(y ij ) given that Y ij > 0. g( ) represents a transformation (e.g., log) that makes Y ij Y ij > 0 approximately normally distributed with a subject-time-specific mean.
33 Regression models logit{pr(z ij = 1)} = X ij θ + U i, X ij is an explanatory variable vector θ is a regression coefficient vector U i is the subject-level random intercept. g(y ij ) given Y ij > 0 follows a linear mixed model g(y ij ) Y ij > 0 = X ijβ + V i + ɛ ij, X ij is an explanatory variable vector, β is a regression coefficient vector, V i is a subject-level random intercept. ɛ ij N(0, σe). 2 Restrict attention to random intercepts.
34 Random Effects [ Ui V i ] ([ 0 N 0 ] [, σ 2 u ρσ u σ v ρσ u σ v σ 2 v ]) Interpretation of correlation: the presence or absence of disability at one occasion is related to the level of disability, if any, at that and other occasions. Variance components, including ρ, usually regarded as nuisance parameters. [θ and β are usual targets of inference.]
35 Random Effects [ Ui V i ] ([ 0 N 0 ] [, σ 2 u ρσ u σ v ρσ u σ v σ 2 v ]) ρ = 0 implies separability of the likelihood. Estimation is much easier. Incorrect assumption of ρ = 0 can lead to bias in estimating the continuous part of the model. Problem of informative cluster size: More observations from people more likely to have a non-zero observation, and (usually) more likely to have larger values of Y.
36 Parallels with nonignorable missingness in a class of shared parameter models Binary part of two part model logistic random effects model for missing indicators Continuous part partially unobserved outcome data However, Two part models focus on θ and β. Shared parameter model focusses only on β.
37 Likelihood Observed Y ij = 0 Likelihood contribution: l ij = {1 Pr(Z ij = 1 θ, u i )} Observed Y ij > 0 Likelihood contribution: l ij = {Pr(Z ij = 1 θ, u i )} [ f{g(y ij ) y ij > 0, β, v i, σ 2 e} ] Likelihood L = N i=1 u i v i ni j=1 l ij f(u i, v i σ 2 u, σ 2 v, ρ)dv i du i
38 Back to Motivating PsA Example Disease activity is reflected in joints being swollen (effused) and/or painful (tender) Activity is reversible Disease progression is taken to be reflected in damaged joints Damage is generally held to be irreversible Interest in whether effects of disease activity and damage on HAQ varies with disease duration. PASI (Psoriasis Area and Severity Index) is a disease severity measure for psoriasis.
39 Parameters Misspecified model Full model (Binary) Estimate (SE) p Estimate (SE) p Intercept (0.4079) (0.3746) Female (0.3603) < (0.3276) <.0001 Disease duration (0.0259) (0.0232) Active joints (0.0513) (0.0495) Deformed joints (0.0321) (0.0260) PASI score (0.1257) (0.1086) AJ X Duration (0.0034) (0.0033) DJ X Duration (0.0016) (0.0013) σu (0.8546) < (0.8924) <.0001 ρ (ρ = 0) (0.0373) <.0001
40 Parameters Misspecified model Full model (Continuous) Estimate (SE) p Estimate (SE) p Intercept (0.0567) < (0.0556) Female (0.0505) (0.0512) <.0001 Disease duration (0.0033) (0.0032) Active joints (0.0028) < (0.0027) <.0001 Deformed joints (0.0031) (0.0031) PASI score (0.0140) (0.0134) AJ X Duration (0.0002) (0.0002) DJ X Duration (0.0001) (0.0001) σv (0.0154) < (0.0166) <.0001 σe (0.0040) < (0.0039) <.0001 ρ (ρ = 0) (0.0373) < log likelihood AIC
41 Parameters Misspecified model Full model (Continuous) Estimate (SE) p Estimate (SE) p Intercept (0.0567) < (0.0556) Female (0.0505) (0.0512) <.0001 Disease duration (0.0033) (0.0032) Active joints (0.0028) < (0.0027) <.0001 Deformed joints (0.0031) (0.0031) PASI score (0.0140) (0.0134) AJ X Duration (0.0002) (0.0002) DJ X Duration (0.0001) (0.0001) σv (0.0154) < (0.0166) <.0001 σe (0.0040) < (0.0039) <.0001 ρ (ρ = 0) (0.0373) < log likelihood AIC
42 A Marginal Two-part Model Model that has been considered: logit{pr(z ij = 1)} = X ij θ + U i, g(y ij ) Y ij > 0 = X ijβ + V i + ɛ ij, [ Ui V i ] ([ 0 N 0 ] [, σ 2 u ρσ u σ v ]) ρσ u σ v σ 2 v
43 A Marginal Two-part Model Model that will now be considered: logit{pr(z ij = 1)} = X ij θ + B i, g(y ij ) Y ij > 0 = X ijβ + V i + ɛ ij, where B i follows the bridge distribution (Wang and Louis, Biometrika, 2003): f B (b i φ) = 1 sin(φπ) 2π cosh(φb i ) + cos(φπ) ( < b i < ) with unknown parameter φ (0 < φ < 1).
44 Random effects correlation structure Define the pair of random variables (U i, V i ) where [ ] ([ ] [ ]) Ui 0 1 ρσv N, V i 0 ρσ v σv 2 And then define B i by B i = F 1 B {Φ(U i)} where B (x) = 1 [ ] φ log sin(φπx) sin{φπ(1 x)} F 1
45 Advantages of this marginal model Can be conveniently implemented in standard software, e.g. SAS NLMIXED. Likelihood based so can deal with unbalanced longitudinal data. Offers some degree of robustness in estimation of regression parameters when there is departure from the assumed random effects structure. As shown by Haegerty and Kurland (Biometrika, 2001) for GLMMs. Estimation of marginal parameters more robust than subject specific parameters
46 Particular advantage of bridge distribution After integration over (B i, V i ), the marginal probability Pr(Z ij = 1) relates to linear predictors through the same logit link function as for the corresponding conditional probability. If specify marginal structure for binary part as logit{pr(z ij = 1)} = X ij θ, then logit{pr(z ij = 1 B i )} = X ij θ/φ + B i.
47 Marginal model for HAQ with genetic predictors If we look at (time invariant) genetic predictors for HAQ, it is natural to consider marginal effects.
48 Binary part Continuous part marginal conditional conditional est. (SE) p est. (SE*) p est. (SE) p Intercept 0.62(0.18) (0.37) (0.06) <.0001 B (0.22) (0.45) (0.08) DQw3 0.22(0.22) (0.45) (0.08) 0.16 DR7 0.48(0.29) (0.59) (0.10) DQw3:DR7 0.81(0.38) (0.79) (0.13) 0.85 Age at onset 0.40(0.09) < (0.18) < (0.03) Disease duration 0.19(0.07) (0.14) (0.02) Sex (Female) 1.22(0.19) < (0.41) < (0.06) <.0001 σb (1.76) <.0001 φ 0.49(0.03) <.0001 σv (0.03) <.0001 σe (0.01) <.0001 ρ 0.98(0.02) <.0001
49 The marginal mean It would be convenient if but, the correct expression is E{g(Y ij ) X ij, Y ij > 0} = X ijβ E{g(Y ij ) X ij, Y ij > 0} = X ijβ + E(V i X ij, Y ij > 0). Two are equivalent only if B i and V i are uncorrelated and there are no common explanatory variables in the binary and continuous parts of the model. No closed form for E(V i X ij, Y ij > 0) but can be evaluated numerically..
50 The marginal mean Assume g(.) is the identity function for simplicity and suppress dependencies on the explanatory variables. Overall marginal mean of the response, E(Y ij ) E(Y ij X ij ), is given by E(Y ij Y ij = 0)Pr(Y ij = 0) + E(Y ij Y ij > 0)Pr(Y ij > 0) = E(Y ij Y ij > 0)Pr(Y ij > 0).
51 Female, B27 effects Male, B27 effects Difference in average HAQ A DQw3=0,DR7=0 B DQw3=0,DR7=1 C DQw3=1,DR7=0 D DQw3=1,DR7=1 A B C D Difference in average HAQ A DQw3=0,DR7=0 B DQw3=0,DR7=1 C DQw3=1,DR7=0 D DQw3=1,DR7=1 A B C D ce in average HAQ Calculate contrasts comparing overall expected HAQ with and Female, DQW3 effects Male, DQW3 effects without specific alleles, stratified by other HLA covariates and holding age at diagnosis fixed at 35 years and disease duration at 15 years. A B27=0,DR7=0 B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 ce in average HAQ A B27=0,DR7=0 B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 Confidence intervals by sampling from the asymptotic distribution of the MLEs of the two-part model.
52 Female, B27 effects Male, B27 effects Difference in average HAQ A DQw3=0,DR7=0 B DQw3=0,DR7=1 C DQw3=1,DR7=0 D DQw3=1,DR7=1 A B C D Difference in average HAQ A DQw3=0,DR7=0 B DQw3=0,DR7=1 C DQw3=1,DR7=0 D DQw3=1,DR7=1 A B C D erage HAQ B27 marginal effects approximately the same across Female, DQW3 effects combinations of other variables. A B27=0,DR7=0 Confidence intervals exclude zero. B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 erage HAQ A B27=0,DR7=0 B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 Male, DQW3 effects
53 0.0 Two Tools for the Analysis of Longitudinal Data: Motivations, Applications and Issues Dif Dif 0.0 Female, DQW3 effects Male, DQW3 effects Difference in average HAQ A B27=0,DR7=0 B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 A B C D Difference in average HAQ A B27=0,DR7=0 B B27=1,DR7=0 C B27=0,DR7=1 D B27=1,DR7=1 A B C D in average HAQ DQW3 X DR7 Interaction (Females) A B C D B27=0,DQw3=0 B27=1,DQw3=0 B27=0,DQw3=1 B27=1,DQw3=1 Female, DR7 effects in average HAQ Male, DR7 effects D-B: ( , ) DQW3XDR7 effect if B27 A B27=0,DQw3=0 present B B27=1,DQw3=0 C B27=0,DQw3=1 C-A: ( , ) DQW3XDR7 D B27=1,DQw3=1 effect if B27 absent
54 A B A Two Tools for the Analysis of Longitudinal Data: Motivations, Applications and Issues Diff 0.0 Diff 0.0 B Female, DR7 effects Male, DR7 effects Difference in average HAQ A B27=0,DQw3=0 B B27=1,DQw3=0 C B27=0,DQw3=1 D B27=1,DQw3=1 A B C D Difference in average HAQ A B27=0,DQw3=0 B B27=1,DQw3=0 C B27=0,DQw3=1 D B27=1,DQw3=1 A B C D DQW3 X DR7 Interaction (Females) D-B: ( , ) DQW3XDR7 effect if B27 present C-A: ( , ) DQW3XDR7 effect if B27 absent
Overview. Longitudinal Data Variation and Correlation Different Approaches. Linear Mixed Models Generalized Linear Mixed Models
Overview 1 Introduction Longitudinal Data Variation and Correlation Different Approaches 2 Mixed Models Linear Mixed Models Generalized Linear Mixed Models 3 Marginal Models Linear Models Generalized Linear
I L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN
Beckman HLM Reading Group: Questions, Answers and Examples Carolyn J. Anderson Department of Educational Psychology I L L I N O I S UNIVERSITY OF ILLINOIS AT URBANA-CHAMPAIGN Linear Algebra Slide 1 of
Auxiliary Variables in Mixture Modeling: 3-Step Approaches Using Mplus
Auxiliary Variables in Mixture Modeling: 3-Step Approaches Using Mplus Tihomir Asparouhov and Bengt Muthén Mplus Web Notes: No. 15 Version 8, August 5, 2014 1 Abstract This paper discusses alternatives
SAS Software to Fit the Generalized Linear Model
SAS Software to Fit the Generalized Linear Model Gordon Johnston, SAS Institute Inc., Cary, NC Abstract In recent years, the class of generalized linear models has gained popularity as a statistical modeling
Statistics in Retail Finance. Chapter 2: Statistical models of default
Statistics in Retail Finance 1 Overview > We consider how to build statistical models of default, or delinquency, and how such models are traditionally used for credit application scoring and decision
Introduction to mixed model and missing data issues in longitudinal studies
Introduction to mixed model and missing data issues in longitudinal studies Hélène Jacqmin-Gadda INSERM, U897, Bordeaux, France Inserm workshop, St Raphael Outline of the talk I Introduction Mixed models
Adequacy of Biomath. Models. Empirical Modeling Tools. Bayesian Modeling. Model Uncertainty / Selection
Directions in Statistical Methodology for Multivariable Predictive Modeling Frank E Harrell Jr University of Virginia Seattle WA 19May98 Overview of Modeling Process Model selection Regression shape Diagnostics
MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS
MULTIPLE REGRESSION AND ISSUES IN REGRESSION ANALYSIS MSR = Mean Regression Sum of Squares MSE = Mean Squared Error RSS = Regression Sum of Squares SSE = Sum of Squared Errors/Residuals α = Level of Significance
Multivariate Logistic Regression
1 Multivariate Logistic Regression As in univariate logistic regression, let π(x) represent the probability of an event that depends on p covariates or independent variables. Then, using an inv.logit formulation
Nominal and ordinal logistic regression
Nominal and ordinal logistic regression April 26 Nominal and ordinal logistic regression Our goal for today is to briefly go over ways to extend the logistic regression model to the case where the outcome
Psoriasis, Incidence, Quality of Life, Psoriatic Arthritis, Prevalence
1.0 Abstract Title Prevalence and Incidence of Articular Symptoms and Signs Related to Psoriatic Arthritis in Patients with Psoriasis Severe or Moderate with Adalimumab Treatment (TOGETHER). Keywords Psoriasis,
Statistics Graduate Courses
Statistics Graduate Courses STAT 7002--Topics in Statistics-Biological/Physical/Mathematics (cr.arr.).organized study of selected topics. Subjects and earnable credit may vary from semester to semester.
Introduction to Longitudinal Data Analysis
Introduction to Longitudinal Data Analysis Longitudinal Data Analysis Workshop Section 1 University of Georgia: Institute for Interdisciplinary Research in Education and Human Development Section 1: Introduction
Missing data and net survival analysis Bernard Rachet
Workshop on Flexible Models for Longitudinal and Survival Data with Applications in Biostatistics Warwick, 27-29 July 2015 Missing data and net survival analysis Bernard Rachet General context Population-based,
Randomized trials versus observational studies
Randomized trials versus observational studies The case of postmenopausal hormone therapy and heart disease Miguel Hernán Harvard School of Public Health www.hsph.harvard.edu/causal Joint work with James
Delme John Pritchard
THE GENETICS OF ALZHEIMER S DISEASE, MODELLING DISABILITY AND ADVERSE SELECTION IN THE LONGTERM CARE INSURANCE MARKET By Delme John Pritchard Submitted for the Degree of Doctor of Philosophy at HeriotWatt
Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13
Missing Data: Part 1 What to Do? Carol B. Thompson Johns Hopkins Biostatistics Center SON Brown Bag 3/20/13 Overview Missingness and impact on statistical analysis Missing data assumptions/mechanisms Conventional
Challenges in Longitudinal Data Analysis: Baseline Adjustment, Missing Data, and Drop-out
Challenges in Longitudinal Data Analysis: Baseline Adjustment, Missing Data, and Drop-out Sandra Taylor, Ph.D. IDDRC BBRD Core 23 April 2014 Objectives Baseline Adjustment Introduce approaches Guidance
Models for Longitudinal and Clustered Data
Models for Longitudinal and Clustered Data Germán Rodríguez December 9, 2008, revised December 6, 2012 1 Introduction The most important assumption we have made in this course is that the observations
Statistics in Retail Finance. Chapter 6: Behavioural models
Statistics in Retail Finance 1 Overview > So far we have focussed mainly on application scorecards. In this chapter we shall look at behavioural models. We shall cover the following topics:- Behavioural
11. Analysis of Case-control Studies Logistic Regression
Research methods II 113 11. Analysis of Case-control Studies Logistic Regression This chapter builds upon and further develops the concepts and strategies described in Ch.6 of Mother and Child Health:
Logistic Regression (1/24/13)
STA63/CBB540: Statistical methods in computational biology Logistic Regression (/24/3) Lecturer: Barbara Engelhardt Scribe: Dinesh Manandhar Introduction Logistic regression is model for regression used
II. DISTRIBUTIONS distribution normal distribution. standard scores
Appendix D Basic Measurement And Statistics The following information was developed by Steven Rothke, PhD, Department of Psychology, Rehabilitation Institute of Chicago (RIC) and expanded by Mary F. Schmidt,
Overview Classes. 12-3 Logistic regression (5) 19-3 Building and applying logistic regression (6) 26-3 Generalizations of logistic regression (7)
Overview Classes 12-3 Logistic regression (5) 19-3 Building and applying logistic regression (6) 26-3 Generalizations of logistic regression (7) 2-4 Loglinear models (8) 5-4 15-17 hrs; 5B02 Building and
10. Analysis of Longitudinal Studies Repeat-measures analysis
Research Methods II 99 10. Analysis of Longitudinal Studies Repeat-measures analysis This chapter builds on the concepts and methods described in Chapters 7 and 8 of Mother and Child Health: Research methods.
Development and Validation of a Screening Questionnaire for Psoriatic Arthritis
Development and Validation of a Screening Questionnaire for Psoriatic Arthritis Dafna D. Gladman 1, Catherine T. Schentag 1, Brian D. Tom 2, Vinod Chandran 1, Cheryl F. Rosen 1 Vernon T. Farewell 2 1 University
What s New in Econometrics? Lecture 8 Cluster and Stratified Sampling
What s New in Econometrics? Lecture 8 Cluster and Stratified Sampling Jeff Wooldridge NBER Summer Institute, 2007 1. The Linear Model with Cluster Effects 2. Estimation with a Small Number of Groups and
CHAPTER 12 EXAMPLES: MONTE CARLO SIMULATION STUDIES
Examples: Monte Carlo Simulation Studies CHAPTER 12 EXAMPLES: MONTE CARLO SIMULATION STUDIES Monte Carlo simulation studies are often used for methodological investigations of the performance of statistical
MISSING DATA TECHNIQUES WITH SAS. IDRE Statistical Consulting Group
MISSING DATA TECHNIQUES WITH SAS IDRE Statistical Consulting Group ROAD MAP FOR TODAY To discuss: 1. Commonly used techniques for handling missing data, focusing on multiple imputation 2. Issues that could
Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics
Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2015 Examinations Aim The aim of the Probability and Mathematical Statistics subject is to provide a grounding in
A Basic Introduction to Missing Data
John Fox Sociology 740 Winter 2014 Outline Why Missing Data Arise Why Missing Data Arise Global or unit non-response. In a survey, certain respondents may be unreachable or may refuse to participate. Item
Simple linear regression
Simple linear regression Introduction Simple linear regression is a statistical method for obtaining a formula to predict values of one variable from another where there is a causal relationship between
STATISTICA Formula Guide: Logistic Regression. Table of Contents
: Table of Contents... 1 Overview of Model... 1 Dispersion... 2 Parameterization... 3 Sigma-Restricted Model... 3 Overparameterized Model... 4 Reference Coding... 4 Model Summary (Summary Tab)... 5 Summary
Using Repeated Measures Techniques To Analyze Cluster-correlated Survey Responses
Using Repeated Measures Techniques To Analyze Cluster-correlated Survey Responses G. Gordon Brown, Celia R. Eicheldinger, and James R. Chromy RTI International, Research Triangle Park, NC 27709 Abstract
Basic Statistics and Data Analysis for Health Researchers from Foreign Countries
Basic Statistics and Data Analysis for Health Researchers from Foreign Countries Volkert Siersma [email protected] The Research Unit for General Practice in Copenhagen Dias 1 Content Quantifying association
CHAPTER 8 EXAMPLES: MIXTURE MODELING WITH LONGITUDINAL DATA
Examples: Mixture Modeling With Longitudinal Data CHAPTER 8 EXAMPLES: MIXTURE MODELING WITH LONGITUDINAL DATA Mixture modeling refers to modeling with categorical latent variables that represent subpopulations
LOGIT AND PROBIT ANALYSIS
LOGIT AND PROBIT ANALYSIS A.K. Vasisht I.A.S.R.I., Library Avenue, New Delhi 110 012 [email protected] In dummy regression variable models, it is assumed implicitly that the dependent variable Y
BayesX - Software for Bayesian Inference in Structured Additive Regression
BayesX - Software for Bayesian Inference in Structured Additive Regression Thomas Kneib Faculty of Mathematics and Economics, University of Ulm Department of Statistics, Ludwig-Maximilians-University Munich
Penalized regression: Introduction
Penalized regression: Introduction Patrick Breheny August 30 Patrick Breheny BST 764: Applied Statistical Modeling 1/19 Maximum likelihood Much of 20th-century statistics dealt with maximum likelihood
How to choose an analysis to handle missing data in longitudinal observational studies
How to choose an analysis to handle missing data in longitudinal observational studies ICH, 25 th February 2015 Ian White MRC Biostatistics Unit, Cambridge, UK Plan Why are missing data a problem? Methods:
A Bayesian hierarchical surrogate outcome model for multiple sclerosis
A Bayesian hierarchical surrogate outcome model for multiple sclerosis 3 rd Annual ASA New Jersey Chapter / Bayer Statistics Workshop David Ohlssen (Novartis), Luca Pozzi and Heinz Schmidli (Novartis)
1.0 Abstract. Title: Real Life Evaluation of Rheumatoid Arthritis in Canadians taking HUMIRA. Keywords. Rationale and Background:
1.0 Abstract Title: Real Life Evaluation of Rheumatoid Arthritis in Canadians taking HUMIRA Keywords Rationale and Background: This abbreviated clinical study report is based on a clinical surveillance
Poisson Models for Count Data
Chapter 4 Poisson Models for Count Data In this chapter we study log-linear models for count data under the assumption of a Poisson error structure. These models have many applications, not only to the
Building risk prediction models - with a focus on Genome-Wide Association Studies. Charles Kooperberg
Building risk prediction models - with a focus on Genome-Wide Association Studies Risk prediction models Based on data: (D i, X i1,..., X ip ) i = 1,..., n we like to fit a model P(D = 1 X 1,..., X p )
An Article Critique - Helmet Use and Associated Spinal Fractures in Motorcycle Crash Victims. Ashley Roberts. University of Cincinnati
Epidemiology Article Critique 1 Running head: Epidemiology Article Critique An Article Critique - Helmet Use and Associated Spinal Fractures in Motorcycle Crash Victims Ashley Roberts University of Cincinnati
Multinomial and Ordinal Logistic Regression
Multinomial and Ordinal Logistic Regression ME104: Linear Regression Analysis Kenneth Benoit August 22, 2012 Regression with categorical dependent variables When the dependent variable is categorical,
13. Poisson Regression Analysis
136 Poisson Regression Analysis 13. Poisson Regression Analysis We have so far considered situations where the outcome variable is numeric and Normally distributed, or binary. In clinical work one often
Generalized Linear Models
Generalized Linear Models We have previously worked with regression models where the response variable is quantitative and normally distributed. Now we turn our attention to two types of models where the
GLM I An Introduction to Generalized Linear Models
GLM I An Introduction to Generalized Linear Models CAS Ratemaking and Product Management Seminar March 2009 Presented by: Tanya D. Havlicek, Actuarial Assistant 0 ANTITRUST Notice The Casualty Actuarial
LOGISTIC REGRESSION. Nitin R Patel. where the dependent variable, y, is binary (for convenience we often code these values as
LOGISTIC REGRESSION Nitin R Patel Logistic regression extends the ideas of multiple linear regression to the situation where the dependent variable, y, is binary (for convenience we often code these values
Biostatistics: Types of Data Analysis
Biostatistics: Types of Data Analysis Theresa A Scott, MS Vanderbilt University Department of Biostatistics [email protected] http://biostat.mc.vanderbilt.edu/theresascott Theresa A Scott, MS
Simple Linear Regression Inference
Simple Linear Regression Inference 1 Inference requirements The Normality assumption of the stochastic term e is needed for inference even if it is not a OLS requirement. Therefore we have: Interpretation
Introduction to Multilevel Modeling Using HLM 6. By ATS Statistical Consulting Group
Introduction to Multilevel Modeling Using HLM 6 By ATS Statistical Consulting Group Multilevel data structure Students nested within schools Children nested within families Respondents nested within interviewers
Prediction for Multilevel Models
Prediction for Multilevel Models Sophia Rabe-Hesketh Graduate School of Education & Graduate Group in Biostatistics University of California, Berkeley Institute of Education, University of London Joint
Organizing Your Approach to a Data Analysis
Biost/Stat 578 B: Data Analysis Emerson, September 29, 2003 Handout #1 Organizing Your Approach to a Data Analysis The general theme should be to maximize thinking about the data analysis and to minimize
Dealing with Missing Data
Dealing with Missing Data Roch Giorgi email: [email protected] UMR 912 SESSTIM, Aix Marseille Université / INSERM / IRD, Marseille, France BioSTIC, APHM, Hôpital Timone, Marseille, France January
Linear Classification. Volker Tresp Summer 2015
Linear Classification Volker Tresp Summer 2015 1 Classification Classification is the central task of pattern recognition Sensors supply information about an object: to which class do the object belong
Overview of Factor Analysis
Overview of Factor Analysis Jamie DeCoster Department of Psychology University of Alabama 348 Gordon Palmer Hall Box 870348 Tuscaloosa, AL 35487-0348 Phone: (205) 348-4431 Fax: (205) 348-8648 August 1,
An Application of the G-formula to Asbestos and Lung Cancer. Stephen R. Cole. Epidemiology, UNC Chapel Hill. Slides: www.unc.
An Application of the G-formula to Asbestos and Lung Cancer Stephen R. Cole Epidemiology, UNC Chapel Hill Slides: www.unc.edu/~colesr/ 1 Acknowledgements Collaboration with David B. Richardson, Haitao
Service courses for graduate students in degree programs other than the MS or PhD programs in Biostatistics.
Course Catalog In order to be assured that all prerequisites are met, students must acquire a permission number from the education coordinator prior to enrolling in any Biostatistics course. Courses are
Financial Risk Management Exam Sample Questions/Answers
Financial Risk Management Exam Sample Questions/Answers Prepared by Daniel HERLEMONT 1 2 3 4 5 6 Chapter 3 Fundamentals of Statistics FRM-99, Question 4 Random walk assumes that returns from one time period
Elements of statistics (MATH0487-1)
Elements of statistics (MATH0487-1) Prof. Dr. Dr. K. Van Steen University of Liège, Belgium December 10, 2012 Introduction to Statistics Basic Probability Revisited Sampling Exploratory Data Analysis -
Handling attrition and non-response in longitudinal data
Longitudinal and Life Course Studies 2009 Volume 1 Issue 1 Pp 63-72 Handling attrition and non-response in longitudinal data Harvey Goldstein University of Bristol Correspondence. Professor H. Goldstein
Glossary of Terms Ability Accommodation Adjusted validity/reliability coefficient Alternate forms Analysis of work Assessment Battery Bias
Glossary of Terms Ability A defined domain of cognitive, perceptual, psychomotor, or physical functioning. Accommodation A change in the content, format, and/or administration of a selection procedure
It is important to bear in mind that one of the first three subscripts is redundant since k = i -j +3.
IDENTIFICATION AND ESTIMATION OF AGE, PERIOD AND COHORT EFFECTS IN THE ANALYSIS OF DISCRETE ARCHIVAL DATA Stephen E. Fienberg, University of Minnesota William M. Mason, University of Michigan 1. INTRODUCTION
Relating the ACT Indicator Understanding Complex Texts to College Course Grades
ACT Research & Policy Technical Brief 2016 Relating the ACT Indicator Understanding Complex Texts to College Course Grades Jeff Allen, PhD; Brad Bolender; Yu Fang, PhD; Dongmei Li, PhD; and Tony Thompson,
COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES.
277 CHAPTER VI COMPARISONS OF CUSTOMER LOYALTY: PUBLIC & PRIVATE INSURANCE COMPANIES. This chapter contains a full discussion of customer loyalty comparisons between private and public insurance companies
Example: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.
Statistical Learning: Chapter 4 Classification 4.1 Introduction Supervised learning with a categorical (Qualitative) response Notation: - Feature vector X, - qualitative response Y, taking values in C
VI. Introduction to Logistic Regression
VI. Introduction to Logistic Regression We turn our attention now to the topic of modeling a categorical outcome as a function of (possibly) several factors. The framework of generalized linear models
Why High-Order Polynomials Should Not be Used in Regression Discontinuity Designs
Why High-Order Polynomials Should Not be Used in Regression Discontinuity Designs Andrew Gelman Guido Imbens 2 Aug 2014 Abstract It is common in regression discontinuity analysis to control for high order
The Landmark Approach: An Introduction and Application to Dynamic Prediction in Competing Risks
Landmarking and landmarking Landmarking and competing risks Discussion The Landmark Approach: An Introduction and Application to Dynamic Prediction in Competing Risks Department of Medical Statistics and
SUMAN DUVVURU STAT 567 PROJECT REPORT
SUMAN DUVVURU STAT 567 PROJECT REPORT SURVIVAL ANALYSIS OF HEROIN ADDICTS Background and introduction: Current illicit drug use among teens is continuing to increase in many countries around the world.
Chapter 7: Simple linear regression Learning Objectives
Chapter 7: Simple linear regression Learning Objectives Reading: Section 7.1 of OpenIntro Statistics Video: Correlation vs. causation, YouTube (2:19) Video: Intro to Linear Regression, YouTube (5:18) -
FDI as a source of finance in imperfect capital markets Firm-Level Evidence from Argentina
FDI as a source of finance in imperfect capital markets Firm-Level Evidence from Argentina Paula Bustos CREI and Universitat Pompeu Fabra September 2007 Abstract In this paper I analyze the financing and
Chapter 5: Analysis of The National Education Longitudinal Study (NELS:88)
Chapter 5: Analysis of The National Education Longitudinal Study (NELS:88) Introduction The National Educational Longitudinal Survey (NELS:88) followed students from 8 th grade in 1988 to 10 th grade in
An analysis method for a quantitative outcome and two categorical explanatory variables.
Chapter 11 Two-Way ANOVA An analysis method for a quantitative outcome and two categorical explanatory variables. If an experiment has a quantitative outcome and two categorical explanatory variables that
Ordinal Regression. Chapter
Ordinal Regression Chapter 4 Many variables of interest are ordinal. That is, you can rank the values, but the real distance between categories is unknown. Diseases are graded on scales from least severe
Problem of Missing Data
VASA Mission of VA Statisticians Association (VASA) Promote & disseminate statistical methodological research relevant to VA studies; Facilitate communication & collaboration among VA-affiliated statisticians;
Efficient and Practical Econometric Methods for the SLID, NLSCY, NPHS
Efficient and Practical Econometric Methods for the SLID, NLSCY, NPHS Philip Merrigan ESG-UQAM, CIRPÉE Using Big Data to Study Development and Social Change, Concordia University, November 2103 Intro Longitudinal
Joseph Twagilimana, University of Louisville, Louisville, KY
ST14 Comparing Time series, Generalized Linear Models and Artificial Neural Network Models for Transactional Data analysis Joseph Twagilimana, University of Louisville, Louisville, KY ABSTRACT The aim
Statistics 305: Introduction to Biostatistical Methods for Health Sciences
Statistics 305: Introduction to Biostatistical Methods for Health Sciences Modelling the Log Odds Logistic Regression (Chap 20) Instructor: Liangliang Wang Statistics and Actuarial Science, Simon Fraser
Statistical Models in R
Statistical Models in R Some Examples Steven Buechler Department of Mathematics 276B Hurley Hall; 1-6233 Fall, 2007 Outline Statistical Models Structure of models in R Model Assessment (Part IA) Anova
Statistical Machine Learning
Statistical Machine Learning UoC Stats 37700, Winter quarter Lecture 4: classical linear and quadratic discriminants. 1 / 25 Linear separation For two classes in R d : simple idea: separate the classes
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
Handling missing data in large data sets. Agostino Di Ciaccio Dept. of Statistics University of Rome La Sapienza
Handling missing data in large data sets Agostino Di Ciaccio Dept. of Statistics University of Rome La Sapienza The problem Often in official statistics we have large data sets with many variables and
Statistical Models in Data Mining
Statistical Models in Data Mining Sargur N. Srihari University at Buffalo The State University of New York Department of Computer Science and Engineering Department of Biostatistics 1 Srihari Flood of
Machine Learning Logistic Regression
Machine Learning Logistic Regression Jeff Howbert Introduction to Machine Learning Winter 2012 1 Logistic regression Name is somewhat misleading. Really a technique for classification, not regression.
Linear Threshold Units
Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear
[This document contains corrections to a few typos that were found on the version available through the journal s web page]
Online supplement to Hayes, A. F., & Preacher, K. J. (2014). Statistical mediation analysis with a multicategorical independent variable. British Journal of Mathematical and Statistical Psychology, 67,
Glossary of Methodologic Terms
Glossary of Methodologic Terms Before-After Trial: Investigation of therapeutic alternatives in which individuals of 1 period and under a single treatment are compared with individuals at a subsequent
Competency 1 Describe the role of epidemiology in public health
The Northwest Center for Public Health Practice (NWCPHP) has developed competency-based epidemiology training materials for public health professionals in practice. Epidemiology is broadly accepted as
Modeling the Claim Duration of Income Protection Insurance Policyholders Using Parametric Mixture Models
Modeling the Claim Duration of Income Protection Insurance Policyholders Using Parametric Mixture Models Abstract This paper considers the modeling of claim durations for existing claimants under income
HLM software has been one of the leading statistical packages for hierarchical
Introductory Guide to HLM With HLM 7 Software 3 G. David Garson HLM software has been one of the leading statistical packages for hierarchical linear modeling due to the pioneering work of Stephen Raudenbush
Lecture 3: Linear methods for classification
Lecture 3: Linear methods for classification Rafael A. Irizarry and Hector Corrada Bravo February, 2010 Today we describe four specific algorithms useful for classification problems: linear regression,
