Standard errors of marginal effects in the heteroskedastic probit model

Save this PDF as:

Size: px
Start display at page:

Transcription

1 Standard errors of marginal effects in the heteroskedastic probit model Thomas Cornelißen Discussion Paper No. 320 August 2005 ISSN: Abstract In non-linear regression models, such as the heteroskedastic probit model, coefficients cannot be interpreted as marginal effects. Marginal effects can be computed as a non-linear combination of the regression coefficients. Standard errors of the marginal effects needed for inference and hypothesis testing have to be derived by approximation using methods such as the delta method. This paper applies the delta method to derive analytically the standard errors of marginal effects in a heteroskedastic probit model. The computation is implemented as a Stata ado-file called mehetprob which can be downloaded from the internet. This allows to compute marginal effects at means and their standard errors in a heteroskedastic probit model faster than by numerical calculation which is implemented in the mfx routine currently available in Stata for that purposes. Keywords: heteroskedastic probit model, marginal effects, Stata JEL-Classification: C25, C87 Institute of Quantitative Economic Research, University of Hannover, Germany,

2 1 Introduction Regression analysis usually aims at estimating the marginal effect of a regressor on the outcome variable controlling for the influence of other regressors. In the linear regression model the regression coefficients can be interpreted as marginal effects. In non-linear regression models, such as the probit model, coefficients cannot be interpreted as marginal effects. The marginal effect of a regressor is obtained by calculating the derivative of the outcome probability with respect to the regressor. The derivative can be calculated analytically or numerically. Standard errors of marginal effects also need to be derived to allow inference and hypothesis testing. If the marginal effect is a non-linear transformation of the regression coefficients, the standard error of the marginal effect can only be calculated approximately by methods such as the delta method (see section 3). This involves calculating the derivatives of the marginal effect with respect to all coefficients. Again, the derivatives can be computed analytically or numerically. For the heteroskedastic probit model, the analytical form of the marginal effect is commonly stated (see for example Greene 2003, p. 680), but the derivatives of the marginal effect needed for calculating its standard errors are not. In the statistical software package Stata, the hetprob command computes coefficients and standard errors of coefficients of the heteroskedastic probit model. When marginal effects are needed, Stata offers the mfx command which numerically computes marginal effects and their standard errors after regression commands. In the case of the heteroskedastic probit model and when many regressors are involved, this procedure is somewhat time consuming. 1 The aim of this paper is to derive analytically the standard errors for the marginal effects of a heteroskedastic probit regression. The analytical calculation of the marginal effect and the standard error is implemented as a Stata ado-file that is downloadable for public use. The paper proceeds as follows. Section 2 describes the marginal effect of a regressor in the heteroskedastic probit model. Section 3 covers the delta method and section 4 applies the method in order to derive the standard errors of the heteroskedastic probit model. Section 5 provides information on how to access the Stata ado-file and presents an application which compares the analytical calculation with the numerical one. Section 6 concludes. 1 This depends very much on the size of the model and the data set and on which release of Stata is used. In Stata 8, the computation of marginal effects with mfx after hetprob can take hours, while in Stata 9 it has been speeded up to the range of minutes. See section 5 for running times of a practical application. 2

3 2 The marginal effect of the heteroskedastic probit model The heteroskedastic probit model extends the simple probit model by introducing heteroskedasticity of the error term of the latent variable. Let the latent variable be y i = x iβ + ɛ i, (1) where i indexes observations, x is an s 1 vector of covariates including the regressor 1, β a corresponding coefficient vector and ɛ a normally distributed error term satisfying and E[ɛ i ] = 0, (2) V [ɛ i ] = σ 2 i = [ iγ)] 2, (3) Cov[ɛ i, ɛ j ] = 0, i j, (4) where z is a t 1 vector of regressors determining the variance of the error term, and γ is the corresponding coefficient vector. Let the observed binary variable y depend on the latent variable y such that { 1 if yi y i = > 0 0 if yi 0, (5) then the probability of a success is given by x P (Y i = 1) = P (ɛ i > x iβ) = 1 Φ i β i γ) x = Φ i β i γ) (6) where Φ is the c.d.f of the standard normal distribution. Unite the x and z regressors in vector w = (x, z ) of length l = s + t. For each regressor w k, k = 1,..., l, a marginal effect has to be derived. Corresponding to the l 1 vector w define coefficient vectors b and g of the same length l such that b k = { β j if w k is the jth element of x 0 otherwise, (7) 3

4 and g k = { γ j if w k is the jth element of z 0 otherwise. (8) The kth element of b contains the β coefficient associated with w k if w k is part of the x vector, otherwise it is 0. Similarly, the kth element of g contains the γ coefficient associated with w k if w k is part of the z vector, otherwise it is 0. Suppose a regressor that is part of x and z, then it will appear two times in w, say w i = w j. Consequently, b i = b j and g i = g j. The marginal effects and standard errors of the marginal effects derived for w i and w j will then be the same. The marginal effect of one regressor w k is function of all β and γ parameters that may be assembled in a vector θ = (β, γ ) of same length (l = s + t) as w. If w k is to be treated as a continuous variable, the marginal effect of the outcome probability with respect to this regressor, g(w k ), is found by deriving (6) with respect to w k, which yields g C (w k ) = P (Y = 1) w k ( x ) β bk x β g k = φ γ), (9) γ) (see Greene 2003, p.680). If w k is element of both, the x and the z vector, then b k and g k are the coefficients associated with the regressor w k in the mean equation (1) and the variance equation (3) respectively. If w k is only element of x but not of z, then g k is zero by definition, i.e. only the first part of (9) applies, and if w k is only element of z but not of x, then b k is zero by definition, i.e. only the last part of (9) applies. If w k is a dummy variable, the marginal effect of the outcome probability with respect to this regressor, g(w k ), can alternatively, i.e. if the dummy variable is not to be treated as a continuous variable, be calculated as x g D (w k ) = Φ 1 β x 1 γ) Φ 0 β 0 γ), (10) where w k is set to 1 in x 1 and z 1 and set to 0 in x 0 and z 0 (provided that the regressor is part of the respective vectors). 4

5 The marginal effect can be evaluated at different values of the regressors, i.e. a marginal effect for each individual can be calculated. Usually a summary statistic is warranted and thus the marginal effect is evaluated at a specific point, e.g. at means or at the median. Alternatively, a (weighted) average of the individual specific marginal effects can be calculated. There is an important distinction between the normal probit model and the heteroskedastic probit model. In the normal probit model the marginal effect of a regressor x k for individual i is given by φ(x i β) β k. As φ( ) is always positive, the marginal effect has the same sign as the regression coefficient for all individuals in the sample. In the heteroskedastic probit model, the sign of the marginal effect depends on b k x β g k (see equation (9)), which can switch sign in the sample for regressors that are part of both x and z and for regressors that are only part of z. Therefore it can be of interest to calculate the individual marginal effects and check for which fraction of the sample the effect is positive or negative. For the following application of the delta method suppose that one marginal effect for each regressor w k, k = 1,..., l is calculated at specific values of the regressors (e.g. at means). This leads to a l 1 vector of estimated marginal effects ˆλ. 3 The delta method The delta method is a popular way to estimate standard errors of non-linear functions of model parameters. While it is straightforward to calculate the variance of a linear function of a random variable, it is not for a nonlinear function. The delta method therefore relies on finding a linear approximation of the function by using a first-order Taylor expansion (e.g. Davidson/MacKinnon 2004, p.202). In the multivariate case, let ˆλ = g(ˆθ) be a l 1 vector of monotonic continuously differentiable functions of the n 1 coefficient estimator ˆθ. Then, for a given estimated covariance matrix of the model parameters, ˆV (ˆθ), the covariance matrix of ˆλ, can be estimated according to the delta method by ˆV (ˆλ) = Ĝ ˆV (ˆθ)Ĝ, (11) where Ĝ G(ˆθ) is the l n matrix g(θ)/ θ. The ith row of G(ˆθ) is the vector of partial derivatives of the ith function with respect to ˆθ or, in other words, the typical element in row i and column j of G(ˆθ) is g i (θ)/ θ j (Davidson/MacKinnon 2004, p. 208). 5

6 4 Applying the delta method to standard errors of marginal effects of the heteroskedastic probit model In the heteroskedastic probit model as defined above there is a (l = s+t) 1 vector w of regressors entering the model. For each regressor w k a marginal effect is derived, which is function of all β and γ parameters that may be assembled in a 1 (l = s + t) vector θ = (β, γ ). 2 The l 1 vector of marginal effects is ˆλ = g(ˆθ) with its kth element being the marginal effect g(w k ) as defined in (9) and (10). The element (k, j) of the l l matrix G(ˆθ) contains the derivative of g(w k ) with respect to the coefficient θ j, whereby θ j may be (i) a β coefficient not associated with w k, (ii) a β coefficient associated with w k, (iii) a γ coefficient not associated with w k, or (iv) a γ coefficient associated with w k. 3 For these four cases, and if the regressors are treated as continuous, the derivatives are: (i) If θ j is a β coefficient not associated with w k : φ x β g C (w k )/ θ j = b k w j (x β) γ) g k w j φ [ γ)] ) 3 (1 (x β) 2 ( x β γ) γ) [ γ)] 2 ) (12) (ii) If θ j is a β coefficient associated with w k : φ x β g C (w k )/ θ j = γ) φ x β b k w j (x β) γ) γ) [ γ)] 3 φ x β g k w γ) j (1 (x β) 2 ) γ) [ γ)] 2 (13) (iii) If θ j is a γ coefficient not associated with w k : g C (w k )/ θ j = ( b k x ) w j φ x β β g γ) k γ) ( (x β) 2 ) [ γ)] 2 1 (14) 2 Recall that s is the length of x and β, t is the length of z and γ. 3 The distinction whether w k is part of x, z or both enters through the components of b and g being zero if w k is not in x or z, respectively. 6

7 (iv) If θ j is a γ coefficient associated with w k : ( x β γ) g C (w k )/ θ j = ( b k x ) w j φ β g k γ) φ x β γ) x β γ) ) ( (x β) 2 ) [ γ)] 2 1 (15) Hereby, all regressors are evaluated at the same values that have been chosen to evaluate the marginal effect, e.g. at means. Recall that b k (g k ) is zero by definition if w k is only element of x (z). In that case, the derivatives simplify accordingly. If regressor w k is a dummy variable that is not to be treated as a continuous variables, the derivative of g D (w k ) in (10) is used, which is (i) If θ j is a β coefficient: g D (w k )/ θ j = w 1j x φ 1 β x 1 γ) φ 0 β 0 1 γ) w 0j γ) 0 γ) (16) (ii) If θ j is a γ coefficient: g D (w k )/ θ j = w 1j (x 1 β)φ ( ) x 1 β 1 γ) 1 ( γ) ) w 0j (x 0 β)φ x 0 β 0 + γ) 0 γ), (17) where w 0j and w 1j are the jth element of the vectors w 0 = (x 0, z 0 ) and w 1 = (x 1, z 1 ), respectively. The vectors x 0, z 0, x 1 and z 1 have been defined in the discussion of equation (10). Once Ĝ G(ˆθ) = g(ˆθ)/ ˆθ is derived, the standard errors of the marginal effects can be calculated by (11). 5 Stata ado-file and application The computation of marginal effects and their standard errors that has been derived analytically in the preceding section has been programmed as a Stata 7

8 ado-file called mehetprob. This file and the associated help file are available for download at the Statistical Software Components (SSC) archive, often also called the Boston College Archive. The recommended way to download it is by typing ssc install mehetprob in the Stata command line. Alternatively, to view a description type ssc describe mehetprob. 4 In the following, an application is presented. A heteroskedastic probit regression is run with data from the German Socio-Economic Panel. An overview of the data set is provided by Haisken-DeNew/Frick (2003). West German private sector workers are sampled. The dependent variable quit1 takes on the value 1 if a worker quits his job in the next period and 0 otherwise. Explanatory variables are the hourly wage (w h4), the actual working hours (hoursact), sex (male), dummies for increasing firm size categories (fsize2, fsize3, fsize4), a dummy that indicates foreign nationality (foreign), age, age squared (agesq), tenure and the regional unemployment rate (regunemp). All variables enter the main equation (the x vector in terms of the notation used earlier), tenure and the hourly wage also enter the equation for modelling the variance of the error term (the z vector). The output from the regression is: Heteroskedastic probit model Number of obs = Zero outcomes = Nonzero outcomes = 3017 Wald chi2(11) = Log likelihood = Prob > chi2 = quit1 Coef. Std. Err. z P> z [95% Conf. Interval] quit1 w_h hoursact male fsize fsize fsize foreign age agesq tenure regunemp _cons lnsigma2 tenure w_h Likelihood-ratio test of lnsigma2=0: chi2(2) = Prob > chi2 = Type help ssc to get information on the ssc command that allows to manage the user written software components from the SSC archive. 8

9 All coefficients are highly significant and have the expected sign, at least for those variables that are only in the main equation, as the sign of their marginal effect on the propensity to quit must equal the sign of the regression coefficients. For tenure and the hourly wage the sign of the marginal effect is not clear, because they enter the mean and the variance equation and thus the sign can switch depending on the regressor values at which the marginal effect is evaluated. The likelihood-ratio test reported at the bottom of the regression output rejects a model without heteroskedasticity. Below the output from mfx and mehetprob for the computation of marginal effects and their standard errors is presented.. mfx compute; Marginal effects after hetprob y = Pr(quit1) (predict) = variable dy/dx Std. Err. z P> z [ 95% C.I. ] X w_h hoursact e male* fsize2* fsize3* fsize4* foreign* age agesq tenure regunemp (*) dy/dx is for discrete change of dummy variable from 0 to 1. mehetprob; (obs=57294) (obs=57294) P(Y=1) in sample: P(Y=1) mean of model prediction: P(Y=1) predicted at means: dp/dx - Marginal effect at means after heteroskedastic probit estimation: Variable dp/dx s.e. z P w_h hoursact male* fsize2* fsize3* fsize4* foreign* age agesq e tenure regunemp (*) dp/dx is for discrete change of dummy variable from 0 to 1 9

10 The results are exactly the same. All marginal effects at means are highly significant. Wage and tenure have negative marginal effect at means. As would be expected, the propensity to quit decreases with rising hourly wages and with longer tenure. Calculating the marginal effects at means with the mfx command takes a running time of 3 hours and 25 minutes in Stata 8. In Stata 9, where the mfx command has been speeded up, it takes 1 minute and 24 seconds. The calculation with the mehetprob routine takes 3 seconds. Table 1 compares the running time of the calculation of the marginal effects at means between the numerical computation by mfx in Stata 8 and Stata 9 and the analytical computation by the mehetprob routine for two different models. Table1: Comparison of computing time in different models Small model Large model Size No. Regressors No. Observations Running Time (hh:mm:ss) a) mfx Stata 8 03:25:00 > 39:00:00 mfx Stata 9 00:01:24 00:10:45 mehetprob 00:00:03 00:00:08 a) Hardware specification: CPU 1,92 Ghz, 200 MB RAM allocated to Stata Model 1 is the one presented above with 11 regressors and 57, 294 observations. In model 2 more regressors, e.g. time and sector dummies, are added and the sample is extended to East German and public sector workers. This leads to 44 regressors and 87, 487 observations (regression results not reported here). While mehetprob took 8 seconds, mfx in Stata 9 took about 10 minutes and mfx in Stata 8 more than 39 hours. Although the mfx command is considerably faster in Stata 9 as compared to Stata 8, the mehetprob routine still saves running time. It seems that the larger the model and the number of observations, the greater is the factor by which mehetprob is faster. For example, comparing mfx of Stata 9 with mehetprob shows that mehetprob is faster by a factor of 28 (3 seconds versus 1 minute 24 seconds) in model 1 and by a factor of 81 in model 2 (8 seconds versus 10 minutes 45 seconds). 10

11 6 Conclusion This paper has derived an analytical form of the standard errors of marginal effects in a heteroskedastic probit model. The computation has been implemented as a Stata ado-file which can be downloaded from the internet. This allows to compute marginal effects at means and their standard errors in a heteroskedastic probit model faster than by numerical calculation which is implemented in the mfx routine currently available in Stata for that purposes. For users of Stata 8 the routine can save hours of computation time, for users of Stata 9 it saves minutes, as the mfx command has been speeded up considerably in the Stata 9 release. References [1] Greene, W. (2003): Econometric Analysis, Prentice Hall, New Jersey. [2] Davidson, R. and J. MacKinnon (2004): Econometric Theory and Methods, Oxford University Press, New York. [3] Haisken-DeNew, J.P. and J.R. Frick (Eds.) (2003): Desktop Companion to the German Socio-Economic Panel Study, Version 7.0, DIW Berlin. 11

MULTIPLE REGRESSION EXAMPLE

MULTIPLE REGRESSION EXAMPLE For a sample of n = 166 college students, the following variables were measured: Y = height X 1 = mother s height ( momheight ) X 2 = father s height ( dadheight ) X 3 = 1 if

IAPRI Quantitative Analysis Capacity Building Series. Multiple regression analysis & interpreting results

IAPRI Quantitative Analysis Capacity Building Series Multiple regression analysis & interpreting results How important is R-squared? R-squared Published in Agricultural Economics 0.45 Best article of the

HURDLE AND SELECTION MODELS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009

HURDLE AND SELECTION MODELS Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 1. Introduction 2. A General Formulation 3. Truncated Normal Hurdle Model 4. Lognormal

Econ 371 Problem Set #3 Answer Sheet

Econ 371 Problem Set #3 Answer Sheet 4.1 In this question, you are told that a OLS regression analysis of third grade test scores as a function of class size yields the following estimated model. T estscore

ECON 142 SKETCH OF SOLUTIONS FOR APPLIED EXERCISE #2

University of California, Berkeley Prof. Ken Chay Department of Economics Fall Semester, 005 ECON 14 SKETCH OF SOLUTIONS FOR APPLIED EXERCISE # Question 1: a. Below are the scatter plots of hourly wages

Multinomial and Ordinal Logistic Regression

Multinomial and Ordinal Logistic Regression ME104: Linear Regression Analysis Kenneth Benoit August 22, 2012 Regression with categorical dependent variables When the dependent variable is categorical,

Discussion Section 4 ECON 139/239 2010 Summer Term II

Discussion Section 4 ECON 139/239 2010 Summer Term II 1. Let s use the CollegeDistance.csv data again. (a) An education advocacy group argues that, on average, a person s educational attainment would increase

ECON Introductory Econometrics. Lecture 15: Binary dependent variables

ECON4150 - Introductory Econometrics Lecture 15: Binary dependent variables Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 11 Lecture Outline 2 The linear probability model Nonlinear probability

Sample Size Calculation for Longitudinal Studies

Sample Size Calculation for Longitudinal Studies Phil Schumm Department of Health Studies University of Chicago August 23, 2004 (Supported by National Institute on Aging grant P01 AG18911-01A1) Introduction

From the help desk: Swamy s random-coefficients model

The Stata Journal (2003) 3, Number 3, pp. 302 308 From the help desk: Swamy s random-coefficients model Brian P. Poi Stata Corporation Abstract. This article discusses the Swamy (1970) random-coefficients

Using the Delta Method to Construct Confidence Intervals for Predicted Probabilities, Rates, and Discrete Changes

Using the Delta Method to Construct Confidence Intervals for Predicted Probabilities, Rates, Discrete Changes JunXuJ.ScottLong Indiana University August 22, 2005 The paper provides technical details on

SAS Software to Fit the Generalized Linear Model

SAS Software to Fit the Generalized Linear Model Gordon Johnston, SAS Institute Inc., Cary, NC Abstract In recent years, the class of generalized linear models has gained popularity as a statistical modeling

1 Logit & Probit Models for Binary Response

ECON 370: Limited Dependent Variable 1 Limited Dependent Variable Econometric Methods, ECON 370 We had previously discussed the possibility of running regressions even when the dependent variable is dichotomous

Marginal Effects for Continuous Variables Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 21, 2015

Marginal Effects for Continuous Variables Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised February 21, 2015 References: Long 1997, Long and Freese 2003 & 2006 & 2014,

Quantitative Methods for Economics Tutorial 9. Katherine Eyal

Quantitative Methods for Economics Tutorial 9 Katherine Eyal TUTORIAL 9 4 October 2010 ECO3021S Part A: Problems 1. In Problem 2 of Tutorial 7, we estimated the equation ŝleep = 3, 638.25 0.148 totwrk

ESTIMATING AVERAGE TREATMENT EFFECTS: IV AND CONTROL FUNCTIONS, II Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics

ESTIMATING AVERAGE TREATMENT EFFECTS: IV AND CONTROL FUNCTIONS, II Jeff Wooldridge Michigan State University BGSE/IZA Course in Microeconometrics July 2009 1. Quantile Treatment Effects 2. Control Functions

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written

From the help desk: hurdle models

The Stata Journal (2003) 3, Number 2, pp. 178 184 From the help desk: hurdle models Allen McDowell Stata Corporation Abstract. This article demonstrates that, although there is no command in Stata for

Department of Economics Session 2012/2013. EC352 Econometric Methods. Solutions to Exercises from Week 10 + 0.0077 (0.052)

Department of Economics Session 2012/2013 University of Essex Spring Term Dr Gordon Kemp EC352 Econometric Methods Solutions to Exercises from Week 10 1 Problem 13.7 This exercise refers back to Equation

From the help desk: Bootstrapped standard errors

The Stata Journal (2003) 3, Number 1, pp. 71 80 From the help desk: Bootstrapped standard errors Weihua Guan Stata Corporation Abstract. Bootstrapping is a nonparametric approach for evaluating the distribution

Nonlinear Regression Functions. SW Ch 8 1/54/

Nonlinear Regression Functions SW Ch 8 1/54/ The TestScore STR relation looks linear (maybe) SW Ch 8 2/54/ But the TestScore Income relation looks nonlinear... SW Ch 8 3/54/ Nonlinear Regression General

Regression with a Binary Dependent Variable

Regression with a Binary Dependent Variable Chapter 9 Michael Ash CPPA Lecture 22 Course Notes Endgame Take-home final Distributed Friday 19 May Due Tuesday 23 May (Paper or emailed PDF ok; no Word, Excel,

LOGIT AND PROBIT ANALYSIS

LOGIT AND PROBIT ANALYSIS A.K. Vasisht I.A.S.R.I., Library Avenue, New Delhi 110 012 amitvasisht@iasri.res.in In dummy regression variable models, it is assumed implicitly that the dependent variable Y

From the help desk: Demand system estimation

The Stata Journal (2002) 2, Number 4, pp. 403 410 From the help desk: Demand system estimation Brian P. Poi Stata Corporation Abstract. This article provides an example illustrating how to use Stata to

Regression Analysis. Data Calculations Output

Regression Analysis In an attempt to find answers to questions such as those posed above, empirical labour economists use a useful tool called regression analysis. Regression analysis is essentially a

Interaction Terms Vs. Interaction Effects in Logistic and Probit Regression

--------------------------------------- Background: In probit or logistic regressions, one can not base statistical inferences based on simply looking at the co-efficient and statistical significance of

In Chapter 2, we used linear regression to describe linear relationships. The setting for this is a

Math 143 Inference on Regression 1 Review of Linear Regression In Chapter 2, we used linear regression to describe linear relationships. The setting for this is a bivariate data set (i.e., a list of cases/subjects

Proportions as dependent variable

Proportions as dependent variable Maarten L. Buis Vrije Universiteit Amsterdam Department of Social Research Methodology http://home.fsw.vu.nl/m.buis Proportions as dependent variable p. 1/42 Outline Problems

Ordinal Regression. Chapter

Ordinal Regression Chapter 4 Many variables of interest are ordinal. That is, you can rank the values, but the real distance between categories is unknown. Diseases are graded on scales from least severe

LOGISTIC REGRESSION. Nitin R Patel. where the dependent variable, y, is binary (for convenience we often code these values as

LOGISTIC REGRESSION Nitin R Patel Logistic regression extends the ideas of multiple linear regression to the situation where the dependent variable, y, is binary (for convenience we often code these values

REGRESSION LINES IN STATA

REGRESSION LINES IN STATA THOMAS ELLIOTT 1. Introduction to Regression Regression analysis is about eploring linear relationships between a dependent variable and one or more independent variables. Regression

Generalized Linear Models. Today: definition of GLM, maximum likelihood estimation. Involves choice of a link function (systematic component)

Generalized Linear Models Last time: definition of exponential family, derivation of mean and variance (memorize) Today: definition of GLM, maximum likelihood estimation Include predictors x i through

Introduction to Stata

Introduction to Stata September 23, 2014 Stata is one of a few statistical analysis programs that social scientists use. Stata is in the mid-range of how easy it is to use. Other options include SPSS,

Lab 5 Linear Regression with Within-subject Correlation. Goals: Data: Use the pig data which is in wide format:

Lab 5 Linear Regression with Within-subject Correlation Goals: Data: Fit linear regression models that account for within-subject correlation using Stata. Compare weighted least square, GEE, and random

Poisson Models for Count Data

Chapter 4 Poisson Models for Count Data In this chapter we study log-linear models for count data under the assumption of a Poisson error structure. These models have many applications, not only to the

Handling missing data in Stata a whirlwind tour

Handling missing data in Stata a whirlwind tour 2012 Italian Stata Users Group Meeting Jonathan Bartlett www.missingdata.org.uk 20th September 2012 1/55 Outline The problem of missing data and a principled

Testing for serial correlation in linear panel-data models

The Stata Journal (2003) 3, Number 2, pp. 168 177 Testing for serial correlation in linear panel-data models David M. Drukker Stata Corporation Abstract. Because serial correlation in linear panel-data

Models for Count Data With Overdispersion

Models for Count Data With Overdispersion Germán Rodríguez November 6, 2013 Abstract This addendum to the WWS 509 notes covers extra-poisson variation and the negative binomial model, with brief appearances

How Do We Test Multiple Regression Coefficients?

How Do We Test Multiple Regression Coefficients? Suppose you have constructed a multiple linear regression model and you have a specific hypothesis to test which involves more than one regression coefficient.

Econometric Analysis of Cross Section and Panel Data Second Edition. Jeffrey M. Wooldridge. The MIT Press Cambridge, Massachusetts London, England

Econometric Analysis of Cross Section and Panel Data Second Edition Jeffrey M. Wooldridge The MIT Press Cambridge, Massachusetts London, England Preface Acknowledgments xxi xxix I INTRODUCTION AND BACKGROUND

12-1 Multiple Linear Regression Models

12-1.1 Introduction Many applications of regression analysis involve situations in which there are more than one regressor variable. A regression model that contains more than one regressor variable is

Multiple Regression Analysis in Minitab 1

Multiple Regression Analysis in Minitab 1 Suppose we are interested in how the exercise and body mass index affect the blood pressure. A random sample of 10 males 50 years of age is selected and their

Online Appendix The Earnings Returns to Graduating with Honors - Evidence from Law Graduates

Online Appendix The Earnings Returns to Graduating with Honors - Evidence from Law Graduates Ronny Freier Mathias Schumann Thomas Siedler February 13, 2015 DIW Berlin and Free University Berlin. Universität

Correlated Random Effects Panel Data Models

INTRODUCTION AND LINEAR MODELS Correlated Random Effects Panel Data Models IZA Summer School in Labor Economics May 13-19, 2013 Jeffrey M. Wooldridge Michigan State University 1. Introduction 2. The Linear

STATA Tutorial Professor Erdinç Please follow the directions once you locate the Stata software in your computer. Room 114 (Business Lab) has computers with Stata software 1.Wald Test Wald Test is used

Department of Economics, Session 2012/2013. EC352 Econometric Methods. Exercises from Week 03

Department of Economics, Session 01/013 University of Essex, Autumn Term Dr Gordon Kemp EC35 Econometric Methods Exercises from Week 03 1 Problem P3.11 The following equation describes the median housing

Econ 371 Problem Set #3 Answer Sheet

Econ 371 Problem Set #3 Answer Sheet 4.3 In this question, you are told that a OLS regression analysis of average weekly earnings yields the following estimated model. AW E = 696.7 + 9.6 Age, R 2 = 0.023,

Lecture 15. Endogeneity & Instrumental Variable Estimation

Lecture 15. Endogeneity & Instrumental Variable Estimation Saw that measurement error (on right hand side) means that OLS will be biased (biased toward zero) Potential solution to endogeneity instrumental

Web-based Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni

1 Web-based Supplementary Materials for Bayesian Effect Estimation Accounting for Adjustment Uncertainty by Chi Wang, Giovanni Parmigiani, and Francesca Dominici In Web Appendix A, we provide detailed

Econometrics II. Lecture 9: Sample Selection Bias

Econometrics II Lecture 9: Sample Selection Bias Måns Söderbom 5 May 2011 Department of Economics, University of Gothenburg. Email: mans.soderbom@economics.gu.se. Web: www.economics.gu.se/soderbom, www.soderbom.net.

Exam and Solution. Please discuss each problem on a separate sheet of paper, not just on a separate page!

Econometrics - Exam 1 Exam and Solution Please discuss each problem on a separate sheet of paper, not just on a separate page! Problem 1: (20 points A health economist plans to evaluate whether screening

GETTING STARTED: STATA & R BASIC COMMANDS ECONOMETRICS II. Stata Output Regression of wages on education

GETTING STARTED: STATA & R BASIC COMMANDS ECONOMETRICS II Stata Output Regression of wages on education. sum wage educ Variable Obs Mean Std. Dev. Min Max -------------+--------------------------------------------------------

Least Squares Estimation

Least Squares Estimation SARA A VAN DE GEER Volume 2, pp 1041 1045 in Encyclopedia of Statistics in Behavioral Science ISBN-13: 978-0-470-86080-9 ISBN-10: 0-470-86080-4 Editors Brian S Everitt & David

Binary Response Models

Short Guides to Microeconometrics Fall 2016 Kurt Schmidheiny Unversität Basel Binary Response Models 2 2 The Econometric Model: Probit and Logit 1 Introduction Binary Response Models Many dependent variables

On Marginal Effects in Semiparametric Censored Regression Models

On Marginal Effects in Semiparametric Censored Regression Models Bo E. Honoré September 3, 2008 Introduction It is often argued that estimation of semiparametric censored regression models such as the

The Chi-Square Diagnostic Test for Count Data Models

The Chi-Square Diagnostic Test for Count Data Models M. Manjón-Antoĺın and O. Martínez-Ibañez QURE-CREIP Department of Economics, Rovira i Virgili University. 2012 Spanish Stata Users Group Meeting (Universitat

Econometrics I: Econometric Methods

Econometrics I: Econometric Methods Jürgen Meinecke Research School of Economics, Australian National University 24 May, 2016 Housekeeping Assignment 2 is now history The ps tute this week will go through

Linear Regression with One Regressor

Linear Regression with One Regressor Michael Ash Lecture 10 Analogy to the Mean True parameter µ Y β 0 and β 1 Meaning Central tendency Intercept and slope E(Y ) E(Y X ) = β 0 + β 1 X Data Y i (X i, Y

Tests for Two Survival Curves Using Cox s Proportional Hazards Model

Chapter 730 Tests for Two Survival Curves Using Cox s Proportional Hazards Model Introduction A clinical trial is often employed to test the equality of survival distributions of two treatment groups.

Statistical Modelling in Stata 5: Linear Models

Statistical Modelling in Stata 5: Linear Models Mark Lunt Arthritis Research UK Centre for Excellence in Epidemiology University of Manchester 08/11/2016 Structure This Week What is a linear model? How

Chapter 13 Introduction to Nonlinear Regression( 非 線 性 迴 歸 )

Chapter 13 Introduction to Nonlinear Regression( 非 線 性 迴 歸 ) and Neural Networks( 類 神 經 網 路 ) 許 湘 伶 Applied Linear Regression Models (Kutner, Nachtsheim, Neter, Li) hsuhl (NUK) LR Chap 10 1 / 35 13 Examples

Wooldridge, Introductory Econometrics, 4th ed. Chapter 7: Multiple regression analysis with qualitative information: Binary (or dummy) variables

Wooldridge, Introductory Econometrics, 4th ed. Chapter 7: Multiple regression analysis with qualitative information: Binary (or dummy) variables We often consider relationships between observed outcomes

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Lecture - 7 Multiple Linear Regression (Contd.) This is my second lecture on Multiple Linear Regression

Lectures 8, 9 & 10. Multiple Regression Analysis

Lectures 8, 9 & 0. Multiple Regression Analysis In which you learn how to apply the principles and tests outlined in earlier lectures to more realistic models involving more than explanatory variable and

The following postestimation commands for time series are available for regress:

Title stata.com regress postestimation time series Postestimation tools for regress with time series Description Syntax for estat archlm Options for estat archlm Syntax for estat bgodfrey Options for estat

Logit Models for Binary Data

Chapter 3 Logit Models for Binary Data We now turn our attention to regression models for dichotomous data, including logistic regression and probit analysis. These models are appropriate when the response

Econ 371 Problem Set #4 Answer Sheet. P rice = (0.485)BDR + (23.4)Bath + (0.156)Hsize + (0.002)LSize + (0.090)Age (48.

Econ 371 Problem Set #4 Answer Sheet 6.5 This question focuses on what s called a hedonic regression model; i.e., where the sales price of the home is regressed on the various attributes of the home. The

Using Stata 11 & higher for Logistic Regression Richard Williams, University of Notre Dame, Last revised March 28, 2015

Using Stata 11 & higher for Logistic Regression Richard Williams, University of Notre Dame, http://www3.nd.edu/~rwilliam/ Last revised March 28, 2015 NOTE: The routines spost13, lrdrop1, and extremes are

A Simple Feasible Alternative Procedure to Estimate Models with High-Dimensional Fixed Effects

DISCUSSION PAPER SERIES IZA DP No. 3935 A Simple Feasible Alternative Procedure to Estimate Models with High-Dimensional Fixed Effects Paulo Guimarães Pedro Portugal January 2009 Forschungsinstitut zur

The Loss in Efficiency from Using Grouped Data to Estimate Coefficients of Group Level Variables. Kathleen M. Lang* Boston College.

The Loss in Efficiency from Using Grouped Data to Estimate Coefficients of Group Level Variables Kathleen M. Lang* Boston College and Peter Gottschalk Boston College Abstract We derive the efficiency loss

Instrumental Variables (IV) Instrumental Variables (IV) is a method of estimation that is widely used

Instrumental Variables (IV) Instrumental Variables (IV) is a method of estimation that is widely used in many economic applications when correlation between the explanatory variables and the error term

Analysis of Microdata

Rainer Winkelmann Stefan Boes Analysis of Microdata With 38 Figures and 41 Tables 4y Springer Contents 1 Introduction 1 1.1 What Are Microdata? 1 1.2 Types of Microdata 4 1.2.1 Qualitative Data 4 1.2.2

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur. Lecture - 2 Simple Linear Regression

Regression Analysis Prof. Soumen Maity Department of Mathematics Indian Institute of Technology, Kharagpur Lecture - 2 Simple Linear Regression Hi, this is my second lecture in module one and on simple

Microeconometrics Blundell Lecture 1 Overview and Binary Response Models

Microeconometrics Blundell Lecture 1 Overview and Binary Response Models Richard Blundell http://www.ucl.ac.uk/~uctp39a/ University College London February-March 2016 Blundell (University College London)

SUMAN DUVVURU STAT 567 PROJECT REPORT

SUMAN DUVVURU STAT 567 PROJECT REPORT SURVIVAL ANALYSIS OF HEROIN ADDICTS Background and introduction: Current illicit drug use among teens is continuing to increase in many countries around the world.

Nonlinear Regression:

Zurich University of Applied Sciences School of Engineering IDP Institute of Data Analysis and Process Design Nonlinear Regression: A Powerful Tool With Considerable Complexity Half-Day : Improved Inference

problem arises when only a non-random sample is available differs from censored regression model in that x i is also unobserved

4 Data Issues 4.1 Truncated Regression population model y i = x i β + ε i, ε i N(0, σ 2 ) given a random sample, {y i, x i } N i=1, then OLS is consistent and efficient problem arises when only a non-random

Questions and Answers on Hypothesis Testing and Confidence Intervals

Questions and Answers on Hypothesis Testing and Confidence Intervals L. Magee Fall, 2008 1. Using 25 observations and 5 regressors, including the constant term, a researcher estimates a linear regression

is paramount in advancing any economy. For developed countries such as

Introduction The provision of appropriate incentives to attract workers to the health industry is paramount in advancing any economy. For developed countries such as Australia, the increasing demand for

C: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)}

C: LEVEL 800 {MASTERS OF ECONOMICS( ECONOMETRICS)} 1. EES 800: Econometrics I Simple linear regression and correlation analysis. Specification and estimation of a regression model. Interpretation of regression

11. Analysis of Case-control Studies Logistic Regression

Research methods II 113 11. Analysis of Case-control Studies Logistic Regression This chapter builds upon and further develops the concepts and strategies described in Ch.6 of Mother and Child Health:

Lecture 5: Linear least-squares Regression III: Advanced Methods William G. Jacoby Department of Political Science Michigan State University http://polisci.msu.edu/jacoby/icpsr/regress3 Simple Linear Regression

Clustering in the Linear Model

Short Guides to Microeconometrics Fall 2014 Kurt Schmidheiny Universität Basel Clustering in the Linear Model 2 1 Introduction Clustering in the Linear Model This handout extends the handout on The Multiple

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition)

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) Abstract Indirect inference is a simulation-based method for estimating the parameters of economic models. Its

The Probit Link Function in Generalized Linear Models for Data Mining Applications

Journal of Modern Applied Statistical Methods Copyright 2013 JMASM, Inc. May 2013, Vol. 12, No. 1, 164-169 1538 9472/13/\$95.00 The Probit Link Function in Generalized Linear Models for Data Mining Applications

Markov Chain Monte Carlo Simulation Made Simple

Markov Chain Monte Carlo Simulation Made Simple Alastair Smith Department of Politics New York University April2,2003 1 Markov Chain Monte Carlo (MCMC) simualtion is a powerful technique to perform numerical

Introduction to General and Generalized Linear Models

Introduction to General and Generalized Linear Models General Linear Models - part I Henrik Madsen Poul Thyregod Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby

Chapter 10: Basic Linear Unobserved Effects Panel Data. Models:

Chapter 10: Basic Linear Unobserved Effects Panel Data Models: Microeconomic Econometrics I Spring 2010 10.1 Motivation: The Omitted Variables Problem We are interested in the partial effects of the observable

7. Autocorrelation (Violation of Assumption #B3)

7. Autocorrelation (Violation of Assumption #B3) Assumption #B3: The error term u i is not autocorrelated, i.e. Cov(u i, u j ) = 0 for all i = 1,..., N and j = 1,..., N where i j Where do we typically

Generalized Linear Models

Generalized Linear Models We have previously worked with regression models where the response variable is quantitative and normally distributed. Now we turn our attention to two types of models where the

Example: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.

Statistical Learning: Chapter 4 Classification 4.1 Introduction Supervised learning with a categorical (Qualitative) response Notation: - Feature vector X, - qualitative response Y, taking values in C

Nontechnical Summary

Nontechnical Summary Do financial market analysts use structural economic models when forecasting exchange rates? This is the leading question analysed in this paper. In contrast to other studies we use

Lecture - 32 Regression Modelling Using SPSS

Applied Multivariate Statistical Modelling Prof. J. Maiti Department of Industrial Engineering and Management Indian Institute of Technology, Kharagpur Lecture - 32 Regression Modelling Using SPSS (Refer

, then the form of the model is given by: which comprises a deterministic component involving the three regression coefficients (

Multiple regression Introduction Multiple regression is a logical extension of the principles of simple linear regression to situations in which there are several predictor variables. For instance if we

VI. Introduction to Logistic Regression

VI. Introduction to Logistic Regression We turn our attention now to the topic of modeling a categorical outcome as a function of (possibly) several factors. The framework of generalized linear models

The Delta Method and Applications

Chapter 5 The Delta Method and Applications 5.1 Linear approximations of functions In the simplest form of the central limit theorem, Theorem 4.18, we consider a sequence X 1, X,... of independent and

Logit and Probit. Brad Jones 1. April 21, 2009. University of California, Davis. Bradford S. Jones, UC-Davis, Dept. of Political Science

Logit and Probit Brad 1 1 Department of Political Science University of California, Davis April 21, 2009 Logit, redux Logit resolves the functional form problem (in terms of the response function in the

TESTING THE ONE-PART FRACTIONAL RESPONSE MODEL AGAINST AN ALTERNATIVE TWO-PART MODEL

TESTING THE ONE-PART FRACTIONAL RESPONSE MODEL AGAINST AN ALTERNATIVE TWO-PART MODEL HARALD OBERHOFER AND MICHAEL PFAFFERMAYR WORKING PAPER NO. 2011-01 Testing the One-Part Fractional Response Model against