1. Measuring association using correlation and regression


 Roberta Bennett
 2 years ago
 Views:
Transcription
1 How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a baby's brthweght. We mght be nterested n the relatonshp between a patent's blood pressure and the amount of drug the patent takes per day. Suppose that we have data on blood pressure and drug dose such as n Table <BPdrug dose>. Table <BPdrug dose>. Drug dose (mg per day) Blood pressure Drug dose versus blood pressure. R= Blood pressure Drug dose (mg per day) Two questons we may ask are: 1. If I know how much drug the patent was gven, how well can I predct ther blood pressure? Put another way, we can ask how much of the varablty n blood pressure can be explaned by dfferences n the amount of drug the patent takes. To answer ths queston, we use correlaton, whch we dscuss n ths chapter.
2 2. For a unt change n the amount of drug gven, how much change n blood pressure do we expect? To answer ths queston, we use regresson, whch we dscuss n the next chapter. As another example of where we use correlaton or regresson, suppose that we are nterested n babes who are born wth low brthweghts, and want to examne factors that affect brthweght. We mght have data on mother's weght and baby's brthweght as n Table <Brthweghts>. Table <Brthweghts>. Mother's weght Chld's brthweght Chld's weght Chld's weght vs mother's weght. R= Mother's weght Agan, two questons we may ask are: 1. If I know the mother's weght, how well can I predct the baby's weght? Put another way, we can ask how much of the varablty n baby's weght can be explaned by dfferences n the mother's weght. To answer ths queston, we use correlaton. 2. For a unt change n the mother's weght (one pound ncrease), how much change n baby's weght do we expect? To answer ths queston, we use regresson.
3 You may notce that all the varables we are consderng (blood pressure, weght, dose) are measured on a contnuous scale, and these are sutable for correlaton and regresson. If we want to measure assocaton between categorcal varables (such as male/female, Republcan/Democrat, pass/fal, yes/no, and so on) we use statstcs such as the chsquare test whch we'll look at n a later chapter. We are gong to focus manly on the most wdely used correlaton measure, whch s R, the Pearson lnear correlaton coeffcent. Later on, we'll look at another correlaton measure, the Spearman rank correlaton coeffcent, whch s sometmes better to use than the Pearson measure.
4 2. Correlaton can be postve, zero, or negatve (rangng from 1.0 to 1.0) Correlaton can be postve as n the brthweght example or negatve as n the drug/blood pressure example. By defnton, usng the formula we'll see n the next secton, the maxmum (postve) correlaton s 1.0. In the brthweght example, correlaton was nearly perfect at R = The mnmum possble (negatve) correlaton s In the drug versus blood pressure example, correlaton was strongly negatve wth R = Correlaton can also be near zero, as shown n Table <Scrambled brthweghts>, where we have scrambled the chldren's brthweghts, and see R = Table <Scrambled brthweghts> Mother's weght Chld's weght Chld's weght (scrambled) vs. mother's weght. R=0.03 Chld's weght Mother's weght
5 3. How to calculate the Pearson lnear correlaton coeffcent We'll frst defne the Pearson lnear correlaton coeffcent, and then look at how to nterpret t. Recall the formula for varance from the chapter on descrptve statstcs. Varance descrbes varablty around the mean value. Varance = 2 ( x x) N Covarance has a formula smlar to that for the varance. Covar ancex (, y) = ( x x N )( y y ) Correlaton uses the covarance of two varables. The correlaton of two varables, x and y, s equal to the covarance of x and y dvded by a number that makes correlaton be between 1.0 and 1.0. Correlato n( x, y) = R = Covarancex (, y) Var( x)* Var( y) The term n the denomnator, the square root of Var(x) * Var(y), just forces the correlaton coeffcent to be between 1.0 and 1.0; t doesn't affect how we nterpret the correlaton coeffcent, so we won't look at t any further.
6 4. How to nterpret the correlaton coeffcent Let's look at what the correlaton coeffcent tells us. We'll start wth just four ponts, one from each quadrant, as shown n Table <Ponts n 4 quadrants>. Quadrant 1 s labeled here as (1,1), quadrant 2 s labeled (1,1), quadrant 2 s labeled (1, 1), and quadrant 4 s labeled (1, 1). For any data set, we can force the mean to be at (0,0) by subtractng the mean of all the x values from the x value for each pont and the mean of all the y values from the y value for each pont. For these "Mean corrected" values, the mean s now at (0,0), and every pont must fall nto one of the four quadrants relatve to the mean. Table <Ponts n 4 quadrants>. x value y value Fgure <Ponts n 4 quadrants> , , , , 1 Now, let's look agan at the formula for covarance. Covar ancex (, y) = ( x x N )( y y ) We've specfed that we subtract the means, so the new mean value of x s zero and the new mean value of y s 0, and the formula for covarance then smplfes as follows.
7 Covar ancex (, y) = ( )( x y N ) Consder a pont n quadrant 1 n Fgure <Ponts n 4 quadrants>, such as the pont (1,1). In the formula for covarance, we put the pont (1,1), nto the term (x )(y ), and we get 1*1 = 1, whch s a postve number. For the term (x )(y ), every pont n quadrant 1 wll gve a postve value, because we are multplyng two postve numbers. Next, consder a pont n quadrant 3, such as (1,1). In the formula for covarance, we put the pont (1,1) nto the term (x )(y ), whch gves us 1*1 = 1, whch s agan a postve number. For the term (x )(y ), every pont n quadrant 3, where we are multplyng two negatve numbers, whch wll gve a postve value. Ponts n quadrants 2 and 4 wll gve us negatve values for the term (x )(y ). In quadrant 2, we see that 1* 1 = 1, and n quadrant 4, we see that 1* 1 = 1. If all the ponts n our data set fall nto quadrant 1 or quadrant 3 wth respect to the mean, then every pont wll contrbute a postve value to the covarance, whch wll n turn gve us a large postve correlaton. In contrast, f all the ponts n our data set fall nto quadrant 2 or quadrant 4 wth respect to the mean, then every pont wll contrbute a negatve value to the covarance, whch wll n turn gve us a large negatve correlaton. If ponts are scattered across all four quadrants, we wll get a mxture of postve and negatve terms that tend to cancel each other out, gvng a correlaton near zero.
8 5. Potental problems wth Pearson lnear correlaton The Pearson lnear correlaton coeffcent can be greatly affected by a sngle observaton. In partcular, a sngle pont (an outler) that falls a long way from other ponts n the xy plane can greatly ncrease or decrease the Pearson R. For example, let's look agan at the data on drug dose versus blood pressure, but suppose that the last patent, nstead of havng a blood pressure measurement of 98, has a value of 150 as n Table <Outler n BPdrug dose>. For these data, the Pearson correlaton coeffcent s R = 0.47, whch s a large change from the R = we had before changng ths sngle pont. When we see an ndvdual pont that s so nfluental n determnng the value of our statstc, we should consder the possblty that there was an error n the measurement, and make sure that we are not beng mslead. Table <Outler n BPdrug dose>. Drug dose (mg per day) Blood pressure An outler n blood pressure measurement at (20,150) Blood pressure Drug dose
9 A sngle outler can also make a weak correlaton appear much stronger. For the data n <Table nooutler>, the correlaton coeffcent s qute small, R = <Table nooutler> x value y value No outler. R = Y X
10 However, f we add a sngle observaton at (10, 10), as shown n Table <Table Sngleoutler> and Fgure <Fgure Sngleoutler>, we change the correlaton coeffcent from R = 0.05 to R = <Table Sngleoutler> x value y value <Fgure Sngleoutler> Sngle outler at (10,10). R = Y X So we see that the Pearson lnear correlaton coeffcent may be very senstve to a sngle pont. In such stuatons, we may choose to use an alternatve assocaton measure, the Spearman rank correlaton coeffcent, whch we'll look at shortly.
11 The Pearson lnear correlaton coeffcent s not good at detectng genune but nonlnear assocatons between varable. Suppose that we have values such as those n Table <Table nonlnear relaton> and Fgure < Fgure nonlnear relaton>. Although there s clearly a relatonshp between x and y, the correlaton coeffcent s R = 0.0. Ths example shows that t s always a good dea to graph your data, and not to rely completely on a statstc. <Table nonlnear relaton>. x value y value Nonlnear assocaton wth R = 0 Y X
12 6. Spearman rank correlaton: an alternatve to Pearson correlaton We saw that the Pearson correlaton coeffcent may be greatly affected by sngle nfluental ponts (outlers). Sometmes we would lke to have a measure of assocaton that s not so senstve to sngle ponts, and at those tmes we can use Spearman rank correlaton. Recall that, when we calculate the mean of a set of numbers, a sngle extreme value can greatly ncrease the mean. But when we calculate the medan, whch s based on ranks, extreme values have very lttle nfluence. The same dea apples to Pearson and Spearman correlaton. Pearson uses the actual values of the observatons, whle Spearman uses only the ranks of the observatons, and thus, lke the medan, s not much affected by outlers. Most statstcs packages wll calculate ether Pearson or Spearman, but Excel wll only do Pearson. The easest way to get Spearman s to replace each observaton by the rank value of each observaton, and then calculate the Pearson coeffcent usng the ranks. For the outler examples, recall that the Pearson correlaton s R = excludng the outler and R = 0.81 ncludng the outler. For these data, the Spearman rank correlaton s R s = excludng the outler and R s = 0.24 ncludng the outler. Let's do the calculatons. Here's the data excludng the sngle outler. I've assgned the rank to each value, wth tes gven the average rank. x value x rank y value y rank
13 We can extract the ranks, and calculate the Pearson coeffcent for the ranks, gettng R s = excludng the outler. x rank y rank Here's the data wth the sngle outler ncluded. Agan, I've assgned the rank to each value, wth tes gven the average rank. x value x rank y value y rank We can extract the ranks, and calculate the Pearson coeffcent for the ranks, gettng R s = 0.24 wth the outler ncluded. x rank y rank The Spearman coeffcent s much less affected by the sngle nfluental pont than s the Pearson correlaton coeffcent.
Causal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting
Causal, Explanatory Forecastng Assumes causeandeffect relatonshp between system nputs and ts output Forecastng wth Regresson Analyss Rchard S. Barr Inputs System Cause + Effect Relatonshp The job of
More informationCHAPTER 14 MORE ABOUT REGRESSION
CHAPTER 14 MORE ABOUT REGRESSION We learned n Chapter 5 that often a straght lne descrbes the pattern of a relatonshp between two quanttatve varables. For nstance, n Example 5.1 we explored the relatonshp
More informationAn Alternative Way to Measure Private Equity Performance
An Alternatve Way to Measure Prvate Equty Performance Peter Todd Parlux Investment Technology LLC Summary Internal Rate of Return (IRR) s probably the most common way to measure the performance of prvate
More informationCHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES
CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES In ths chapter, we wll learn how to descrbe the relatonshp between two quanttatve varables. Remember (from Chapter 2) that the terms quanttatve varable
More informationTHE METHOD OF LEAST SQUARES THE METHOD OF LEAST SQUARES
The goal: to measure (determne) an unknown quantty x (the value of a RV X) Realsaton: n results: y 1, y 2,..., y j,..., y n, (the measured values of Y 1, Y 2,..., Y j,..., Y n ) every result s encumbered
More informationErrorPropagation.nb 1. Error Propagation
ErrorPropagaton.nb Error Propagaton Suppose that we make observatons of a quantty x that s subject to random fluctuatons or measurement errors. Our best estmate of the true value for ths quantty s then
More informationSIMPLE LINEAR CORRELATION
SIMPLE LINEAR CORRELATION Smple lnear correlaton s a measure of the degree to whch two varables vary together, or a measure of the ntensty of the assocaton between two varables. Correlaton often s abused.
More informationCapital asset pricing model, arbitrage pricing theory and portfolio management
Captal asset prcng model, arbtrage prcng theory and portfolo management Vnod Kothar The captal asset prcng model (CAPM) s great n terms of ts understandng of rsk decomposton of rsk nto securtyspecfc rsk
More informationIntroduction to Regression
Introducton to Regresson Regresson a means of predctng a dependent varable based one or more ndependent varables. Ths s done by fttng a lne or surface to the data ponts that mnmzes the total error. 
More informationLecture 10: Linear Regression Approach, Assumptions and Diagnostics
Approach to Modelng I Lecture 1: Lnear Regresson Approach, Assumptons and Dagnostcs Sandy Eckel seckel@jhsph.edu 8 May 8 General approach for most statstcal modelng: Defne the populaton of nterest State
More informationDescriptive Statistics (60 points)
Economcs 30330: Statstcs for Economcs Problem Set 2 Unversty of otre Dame Instructor: Julo Garín Sprng 2012 Descrptve Statstcs (60 ponts) 1. Followng a recent government shutdown, Mnnesota Governor Mark
More information9.1 The Cumulative Sum Control Chart
Learnng Objectves 9.1 The Cumulatve Sum Control Chart 9.1.1 Basc Prncples: Cusum Control Chart for Montorng the Process Mean If s the target for the process mean, then the cumulatve sum control chart s
More informationInequality and The Accounting Period. Quentin Wodon and Shlomo Yitzhaki. World Bank and Hebrew University. September 2001.
Inequalty and The Accountng Perod Quentn Wodon and Shlomo Ytzha World Ban and Hebrew Unversty September Abstract Income nequalty typcally declnes wth the length of tme taen nto account for measurement.
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationMultivariate EWMA Control Chart
Multvarate EWMA Control Chart Summary The Multvarate EWMA Control Chart procedure creates control charts for two or more numerc varables. Examnng the varables n a multvarate sense s extremely mportant
More informationThe covariance is the two variable analog to the variance. The formula for the covariance between two variables is
Regresson Lectures So far we have talked only about statstcs that descrbe one varable. What we are gong to be dscussng for much of the remander of the course s relatonshps between two or more varables.
More informationThe Analysis of Covariance. ERSH 8310 Keppel and Wickens Chapter 15
The Analyss of Covarance ERSH 830 Keppel and Wckens Chapter 5 Today s Class Intal Consderatons Covarance and Lnear Regresson The Lnear Regresson Equaton TheAnalyss of Covarance Assumptons Underlyng the
More informationQuestions that we may have about the variables
Antono Olmos, 01 Multple Regresson Problem: we want to determne the effect of Desre for control, Famly support, Number of frends, and Score on the BDI test on Perceved Support of Latno women. Dependent
More informationNPAR TESTS. OneSample ChiSquare Test. Cell Specification. Observed Frequencies 1O i 6. Expected Frequencies 1EXP i 6
PAR TESTS If a WEIGHT varable s specfed, t s used to replcate a case as many tmes as ndcated by the weght value rounded to the nearest nteger. If the workspace requrements are exceeded and samplng has
More informationThe Analysis of Outliers in Statistical Data
THALES Project No. xxxx The Analyss of Outlers n Statstcal Data Research Team Chrysses Caron, Assocate Professor (P.I.) Vaslk Karot, Doctoral canddate Polychrons Economou, Chrstna Perrakou, Postgraduate
More informationTime Series Analysis in Studies of AGN Variability. Bradley M. Peterson The Ohio State University
Tme Seres Analyss n Studes of AGN Varablty Bradley M. Peterson The Oho State Unversty 1 Lnear Correlaton Degree to whch two parameters are lnearly correlated can be expressed n terms of the lnear correlaton
More informationx f(x) 1 0.25 1 0.75 x 1 0 1 1 0.04 0.01 0.20 1 0.12 0.03 0.60
BIVARIATE DISTRIBUTIONS Let be a varable that assumes the values { 1,,..., n }. Then, a functon that epresses the relatve frequenc of these values s called a unvarate frequenc functon. It must be true
More informationStaff Paper. Farm Savings Accounts: Examining Income Variability, Eligibility, and Benefits. Brent Gloy, Eddy LaDue, and Charles Cuykendall
SP 200502 August 2005 Staff Paper Department of Appled Economcs and Management Cornell Unversty, Ithaca, New York 148537801 USA Farm Savngs Accounts: Examnng Income Varablty, Elgblty, and Benefts Brent
More informationAnalysis of Covariance
Chapter 551 Analyss of Covarance Introducton A common tas n research s to compare the averages of two or more populatons (groups). We mght want to compare the ncome level of two regons, the ntrogen content
More informationDescribing Communities. Species Diversity Concepts. Species Richness. Species Richness. SpeciesArea Curve. SpeciesArea Curve
peces versty Concepts peces Rchness pecesarea Curves versty Indces  mpson's Index  hannonwener Index  rlloun Index peces Abundance Models escrbng Communtes There are two mportant descrptors of a communty:
More informationGraph Theory and Cayley s Formula
Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll
More informationCommunication Networks II Contents
8 / 1  Communcaton Networs II (Görg)  www.comnets.unbremen.de Communcaton Networs II Contents 1 Fundamentals of probablty theory 2 Traffc n communcaton networs 3 Stochastc & Marovan Processes (SP
More informationNasdaq Iceland Bond Indices 01 April 2015
Nasdaq Iceland Bond Indces 01 Aprl 2015 Fxed duraton Indces Introducton Nasdaq Iceland (the Exchange) began calculatng ts current bond ndces n the begnnng of 2005. They were a response to recent changes
More informationForecasting the Direction and Strength of Stock Market Movement
Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract  Stock market s one of the most complcated systems
More informationOnline Learning from Experts: Minimax Regret
E0 370 tatstcal Learnng Theory Lecture 2 Nov 24, 20) Onlne Learnng from Experts: Mn Regret Lecturer: hvan garwal crbe: Nkhl Vdhan Introducton In the last three lectures we have been dscussng the onlne
More informationCHAPTER 7 THE TWOVARIABLE REGRESSION MODEL: HYPOTHESIS TESTING
CHAPTER 7 THE TWOVARIABLE REGRESSION MODEL: HYPOTHESIS TESTING QUESTIONS 7.1. (a) In the regresson contet, the method of least squares estmates the regresson parameters n such a way that the sum of the
More informationWhat is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More informationProblem Set 3. a) We are asked how people will react, if the interest rate i on bonds is negative.
Queston roblem Set 3 a) We are asked how people wll react, f the nterest rate on bonds s negatve. When
More information1 Example 1: Axisaligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationIntroduction: Analysis of Electronic Circuits
/30/008 ntroducton / ntroducton: Analyss of Electronc Crcuts Readng Assgnment: KVL and KCL text from EECS Just lke EECS, the majorty of problems (hw and exam) n EECS 3 wll be crcut analyss problems. Thus,
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationPortfolio Risk Decomposition (and Risk Budgeting)
ortfolo Rsk Decomposton (and Rsk Budgetng) Jason MacQueen RSquared Rsk Management Introducton to Rsk Decomposton Actve managers take rsk n the expectaton of achevng outperformance of ther benchmark Mandates
More informationMean Molecular Weight
Mean Molecular Weght The thermodynamc relatons between P, ρ, and T, as well as the calculaton of stellar opacty requres knowledge of the system s mean molecular weght defned as the mass per unt mole of
More informationCalibration and Linear Regression Analysis: A SelfGuided Tutorial
Calbraton and Lnear Regresson Analyss: A SelfGuded Tutoral Part The Calbraton Curve, Correlaton Coeffcent and Confdence Lmts CHM314 Instrumental Analyss Department of Chemstry, Unversty of Toronto Dr.
More informationCan Auto Liability Insurance Purchases Signal Risk Attitude?
Internatonal Journal of Busness and Economcs, 2011, Vol. 10, No. 2, 159164 Can Auto Lablty Insurance Purchases Sgnal Rsk Atttude? ChuShu L Department of Internatonal Busness, Asa Unversty, Tawan ShengChang
More informationHYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION
HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION Abdul Ghapor Hussn Centre for Foundaton Studes n Scence Unversty of Malaya 563 KUALA LUMPUR Emal: ghapor@umedumy Abstract Ths paper
More information14.74 Lecture 5: Health (2)
14.74 Lecture 5: Health (2) Esther Duflo February 17, 2004 1 Possble Interventons Last tme we dscussed possble nterventons. Let s take one: provdng ron supplements to people, for example. From the data,
More informationIn our example i = r/12 =.0825/12 At the end of the first month after your payment is received your amount owed is. P (1 + i) A
Amortzed loans: Suppose you borrow P dollars, e.g., P = 100, 000 for a house wth a 30 year mortgage wth an nterest rate of 8.25% (compounded monthly). In ths type of loan you make equal payments of A dollars
More informationThe OC Curve of Attribute Acceptance Plans
The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4
More informationThe impact of hard discount control mechanism on the discount volatility of UK closedend funds
Investment Management and Fnancal Innovatons, Volume 10, Issue 3, 2013 Ahmed F. Salhn (Egypt) The mpact of hard dscount control mechansm on the dscount volatlty of UK closedend funds Abstract The mpact
More informationThe Greedy Method. Introduction. 0/1 Knapsack Problem
The Greedy Method Introducton We have completed data structures. We now are gong to look at algorthm desgn methods. Often we are lookng at optmzaton problems whose performance s exponental. For an optmzaton
More informationState function: eigenfunctions of hermitian operators> normalization, orthogonality completeness
Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators> normalzaton, orthogonalty completeness egenvalues and
More informationRecurrence. 1 Definitions and main statements
Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.
More informationQuality Adjustment of Secondhand Motor Vehicle Application of Hedonic Approach in Hong Kong s Consumer Price Index
Qualty Adustment of Secondhand Motor Vehcle Applcaton of Hedonc Approach n Hong Kong s Consumer Prce Index Prepared for the 14 th Meetng of the Ottawa Group on Prce Indces 20 22 May 2015, Tokyo, Japan
More informationCHOLESTEROL REFERENCE METHOD LABORATORY NETWORK. Sample Stability Protocol
CHOLESTEROL REFERENCE METHOD LABORATORY NETWORK Sample Stablty Protocol Background The Cholesterol Reference Method Laboratory Network (CRMLN) developed certfcaton protocols for total cholesterol, HDL
More informationTexas Instruments 30X IIS Calculator
Texas Instruments 30X IIS Calculator Keystrokes for the TI30X IIS are shown for a few topcs n whch keystrokes are unque. Start by readng the Quk Start secton. Then, before begnnng a specfc unt of the
More informationExhaustive Regression. An Exploration of RegressionBased Data Mining Techniques Using Super Computation
Exhaustve Regresson An Exploraton of RegressonBased Data Mnng Technques Usng Super Computaton Antony Daves, Ph.D. Assocate Professor of Economcs Duquesne Unversty Pttsburgh, PA 58 Research Fellow The
More informationMacro Factors and Volatility of Treasury Bond Returns
Macro Factors and Volatlty of Treasury Bond Returns Jngzh Huang Department of Fnance Smeal Colleage of Busness Pennsylvana State Unversty Unversty Park, PA 16802, U.S.A. Le Lu School of Fnance Shangha
More informationNonlinear data mapping by neural networks
Nonlnear data mappng by neural networks R.P.W. Dun Delft Unversty of Technology, Netherlands Abstract A revew s gven of the use of neural networks for nonlnear mappng of hgh dmensonal data on lower dmensonal
More informationLinear Regression Analysis for STARDEX
Lnear Regresson Analss for STARDEX Malcolm Halock, Clmatc Research Unt The followng document s an overvew of lnear regresson methods for reference b members of STARDEX. Whle t ams to cover the most common
More informationCalculation of Sampling Weights
Perre Foy Statstcs Canada 4 Calculaton of Samplng Weghts 4.1 OVERVIEW The basc sample desgn used n TIMSS Populatons 1 and 2 was a twostage stratfed cluster desgn. 1 The frst stage conssted of a sample
More informationAn Analysis of the relationship between WTI term structure and oil market fundamentals in 20022009
MPRA Munch Personal RePEc Archve An Analyss of the relatonshp between WTI term structure and ol market fundamentals n 00009 Mleno Cavalcante Petrobras S.A., Unversdade de Fortaleza. August 00 Onlne at
More informationSIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA
SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA E. LAGENDIJK Department of Appled Physcs, Delft Unversty of Technology Lorentzweg 1, 68 CJ, The Netherlands Emal: e.lagendjk@tnw.tudelft.nl
More informationOUTLIERS IN REGRESSION
OUTLIERS IN REGRESSION Dagmar Blatná Introducton A observaton that s substantally dfferent from all other ones can make a large dfference n the results of regresson analyss. Outlers occur very frequently
More informationGibbs Free Energy and Chemical Equilibrium (or how to predict chemical reactions without doing experiments)
Gbbs Free Energy and Chemcal Equlbrum (or how to predct chemcal reactons wthout dong experments) OCN 623 Chemcal Oceanography Readng: Frst half of Chapter 3, Snoeynk and Jenkns (1980) Introducton We want
More informationSection 5.4 Annuities, Present Value, and Amortization
Secton 5.4 Annutes, Present Value, and Amortzaton Present Value In Secton 5.2, we saw that the present value of A dollars at nterest rate per perod for n perods s the amount that must be deposted today
More informationThe Classical Model. GaussMarkov Theorem, Specification, Endogeneity
The Classcal Model GaussMarkov Theorem, Specfcaton, Endogenety Propertes of Least Squares Estmators Here s the model: Y = β + β + β + β + L+ β + ε 0 For the case wth regressor and constant, I showed some
More informationSPEE Recommended Evaluation Practice #6 Definition of Decline Curve Parameters Background:
SPEE Recommended Evaluaton Practce #6 efnton of eclne Curve Parameters Background: The producton hstores of ol and gas wells can be analyzed to estmate reserves and future ol and gas producton rates and
More informationThe Mathematical Derivation of Least Squares
Pscholog 885 Prof. Federco The Mathematcal Dervaton of Least Squares Back when the powers that e forced ou to learn matr algera and calculus, I et ou all asked ourself the ageold queston: When the hell
More informationDEFINING %COMPLETE IN MICROSOFT PROJECT
CelersSystems DEFINING %COMPLETE IN MICROSOFT PROJECT PREPARED BY James E Aksel, PMP, PMISP, MVP For Addtonal Informaton about Earned Value Management Systems and reportng, please contact: CelersSystems,
More informationChapter XX More advanced approaches to the analysis of survey data. Gad Nathan Hebrew University Jerusalem, Israel. Abstract
Household Sample Surveys n Developng and Transton Countres Chapter More advanced approaches to the analyss of survey data Gad Nathan Hebrew Unversty Jerusalem, Israel Abstract In the present chapter, we
More informationPassive Filters. References: Barbow (pp 265275), Hayes & Horowitz (pp 3260), Rizzoni (Chap. 6)
Passve Flters eferences: Barbow (pp 6575), Hayes & Horowtz (pp 360), zzon (Chap. 6) Frequencyselectve or flter crcuts pass to the output only those nput sgnals that are n a desred range of frequences (called
More informationExtending Probabilistic Dynamic Epistemic Logic
Extendng Probablstc Dynamc Epstemc Logc Joshua Sack May 29, 2008 Probablty Space Defnton A probablty space s a tuple (S, A, µ), where 1 S s a set called the sample space. 2 A P(S) s a σalgebra: a set
More informationELE427  Testing Linear Sensors. Linear Regression, Accuracy, and Resolution.
ELE47  Testng Lnear Sensors Lnear Regresson, Accurac, and Resoluton. Introducton: In the frst three la eperents we wll e concerned wth the characterstcs of lnear sensors. The asc functon of these sensors
More informationComplex Number Representation in RCBNS Form for Arithmetic Operations and Conversion of the Result into Standard Binary Form
Complex Number epresentaton n CBNS Form for Arthmetc Operatons and Converson of the esult nto Standard Bnary Form Hatm Zan and. G. Deshmukh Florda Insttute of Technology rgd@ee.ft.edu ABSTACT Ths paper
More informationTesting GOF & Estimating Overdispersion
Testng GOF & Estmatng Overdsperson Your Most General Model Needs to Ft the Dataset It s mportant that the most general (complcated) model n your canddate model lst fts the data well. Ths model s a benchmark
More information2.4 Bivariate distributions
page 28 2.4 Bvarate dstrbutons 2.4.1 Defntons Let X and Y be dscrete r.v.s defned on the same probablty space (S, F, P). Instead of treatng them separately, t s often necessary to thnk of them actng together
More informationThe Magnetic Field. Concepts and Principles. Moving Charges. Permanent Magnets
. The Magnetc Feld Concepts and Prncples Movng Charges All charged partcles create electrc felds, and these felds can be detected by other charged partcles resultng n electrc force. However, a completely
More informationVLSI Technology Dr. Nandita Dasgupta Department of Electrical Engineering Indian Institute of Technology, Madras
VLI Technology Dr. Nandta Dasgupta Department of Electrcal Engneerng Indan Insttute of Technology, Madras Lecture  11 Oxdaton I netcs of Oxdaton o, the unt process step that we are gong to dscuss today
More informationQuestion 2: What is the variance and standard deviation of a dataset?
Queston 2: What s the varance and standard devaton of a dataset? The varance of the data uses all of the data to compute a measure of the spread n the data. The varance may be computed for a sample of
More informationChapter 7. RandomVariate Generation 7.1. Prof. Dr. Mesut Güneş Ch. 7 RandomVariate Generation
Chapter 7 RandomVarate Generaton 7. Contents Inversetransform Technque AcceptanceRejecton Technque Specal Propertes 7. Purpose & Overvew Develop understandng of generatng samples from a specfed dstrbuton
More informationA random variable is a variable whose value depends on the outcome of a random event/experiment.
Random varables and Probablty dstrbutons A random varable s a varable whose value depends on the outcome of a random event/experment. For example, the score on the roll of a de, the heght of a randomly
More informationPortfolio Loss Distribution
Portfolo Loss Dstrbuton Rsky assets n loan ortfolo hghly llqud assets holdtomaturty n the bank s balance sheet Outstandngs The orton of the bank asset that has already been extended to borrowers. Commtment
More informationDescriptive Models. Cluster Analysis. Example. General Applications of Clustering. Examples of Clustering Applications
CMSC828G Prncples of Data Mnng Lecture #9 Today s Readng: HMS, chapter 9 Today s Lecture: Descrptve Modelng Clusterng Algorthms Descrptve Models model presents the man features of the data, a global summary
More informationClustering Gene Expression Data. (Slides thanks to Dr. Mark Craven)
Clusterng Gene Epresson Data Sldes thanks to Dr. Mark Craven Gene Epresson Proles we ll assume we have a D matr o gene epresson measurements rows represent genes columns represent derent eperments tme
More informationLatent Class Regression. Statistics for Psychosocial Research II: Structural Models December 4 and 6, 2006
Latent Class Regresson Statstcs for Psychosocal Research II: Structural Models December 4 and 6, 2006 Latent Class Regresson (LCR) What s t and when do we use t? Recall the standard latent class model
More informationFinancial Mathemetics
Fnancal Mathemetcs 15 Mathematcs Grade 12 Teacher Gude Fnancal Maths Seres Overvew In ths seres we am to show how Mathematcs can be used to support personal fnancal decsons. In ths seres we jon Tebogo,
More information1 Approximation Algorithms
CME 305: Dscrete Mathematcs and Algorthms 1 Approxmaton Algorthms In lght of the apparent ntractablty of the problems we beleve not to le n P, t makes sense to pursue deas other than complete solutons
More informationStatistical Methods to Develop Rating Models
Statstcal Methods to Develop Ratng Models [Evelyn Hayden and Danel Porath, Österrechsche Natonalbank and Unversty of Appled Scences at Manz] Source: The Basel II Rsk Parameters Estmaton, Valdaton, and
More informationThe Use of Analytics for Claim Fraud Detection Roosevelt C. Mosley, Jr., FCAS, MAAA Nick Kucera Pinnacle Actuarial Resources Inc.
Paper 18372014 The Use of Analytcs for Clam Fraud Detecton Roosevelt C. Mosley, Jr., FCAS, MAAA Nck Kucera Pnnacle Actuaral Resources Inc., Bloomngton, IL ABSTRACT As t has been wdely reported n the nsurance
More informationSensitivity Analysis in a Generic MultiAttribute Decision Support System
Senstvty Analyss n a Generc MultAttrbute Decson Support System Sxto RíosInsua, Antono Jménez and Alfonso Mateos Department of Artfcal Intellgence, Madrd Techncal Unversty Campus de Montegancedo s/n,
More informationAnswer: A). There is a flatter IS curve in the high MPC economy. Original LM LM after increase in M. IS curve for low MPC economy
4.02 Quz Solutons Fall 2004 MultpleChoce Questons (30/00 ponts) Please, crcle the correct answer for each of the followng 0 multplechoce questons. For each queston, only one of the answers s correct.
More informationChapter 4 Financial Markets
Chapter 4 Fnancal Markets ECON2123 (Sprng 2012) 14 & 15.3.2012 (Tutoral 5) The demand for money Assumptons: There are only two assets n the fnancal market: money and bonds Prce s fxed and s gven, that
More informationFormula of Total Probability, Bayes Rule, and Applications
1 Formula of Total Probablty, Bayes Rule, and Applcatons Recall that for any event A, the par of events A and A has an ntersecton that s empty, whereas the unon A A represents the total populaton of nterest.
More informationn + d + q = 24 and.05n +.1d +.25q = 2 { n + d + q = 24 (3) n + 2d + 5q = 40 (2)
MATH 16T Exam 1 : Part I (InClass) Solutons 1. (0 pts) A pggy bank contans 4 cons, all of whch are nckels (5 ), dmes (10 ) or quarters (5 ). The pggy bank also contans a con of each denomnaton. The total
More informationLecture 3: Annuity. Study annuities whose payments form a geometric progression or a arithmetic progression.
Lecture 3: Annuty Goals: Learn contnuous annuty and perpetuty. Study annutes whose payments form a geometrc progresson or a arthmetc progresson. Dscuss yeld rates. Introduce Amortzaton Suggested Textbook
More informationA Simplified Framework for Return Accountability
Reprnted wth permsson from Fnancal Analysts Journal, May/June 1991. Copyrght 1991. Assocaton for Investment Management and Research, Charlottesvlle, VA. All rghts reserved. by Gary P. Brnson, Bran D. Snger
More informationH 1 : at least one is not zero
Chapter 6 More Multple Regresson Model The Ftest Jont Hypothess Tests Consder the lnear regresson equaton: () y = β + βx + βx + β4x4 + e for =,,..., N The tstatstc gve a test of sgnfcance of an ndvdual
More informationControl Charts for Means (Simulation)
Chapter 290 Control Charts for Means (Smulaton) Introducton Ths procedure allows you to study the run length dstrbuton of Shewhart (Xbar), Cusum, FIR Cusum, and EWMA process control charts for means usng
More informationPsych 5741 (Carey): 8/22/97 Parametric Statistics  1
Psych 5741 (Carey): 8//97 Parametrc Statstcs  1 1 Parametrc Statstcs: Tradtonal Approach 11 Denton o parametrc statstcs: Parametrc statstcs assume that the varable(s) o nterest n the populaton(s) o nterest
More informationFixed income risk attribution
5 Fxed ncome rsk attrbuton Chthra Krshnamurth RskMetrcs Group chthra.krshnamurth@rskmetrcs.com We compare the rsk of the actve portfolo wth that of the benchmark and segment the dfference between the two
More informationTransition Matrix Models of Consumer Credit Ratings
Transton Matrx Models of Consumer Credt Ratngs Abstract Although the corporate credt rsk lterature has many studes modellng the change n the credt rsk of corporate bonds over tme, there s far less analyss
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationVision Mouse. Saurabh Sarkar a* University of Cincinnati, Cincinnati, USA ABSTRACT 1. INTRODUCTION
Vson Mouse Saurabh Sarkar a* a Unversty of Cncnnat, Cncnnat, USA ABSTRACT The report dscusses a vson based approach towards trackng of eyes and fngers. The report descrbes the process of locatng the possble
More informationIDENTIFICATION AND CORRECTION OF A COMMON ERROR IN GENERAL ANNUITY CALCULATIONS
IDENTIFICATION AND CORRECTION OF A COMMON ERROR IN GENERAL ANNUITY CALCULATIONS Chrs Deeley* Last revsed: September 22, 200 * Chrs Deeley s a Senor Lecturer n the School of Accountng, Charles Sturt Unversty,
More information