THE METHOD OF LEAST SQUARES THE METHOD OF LEAST SQUARES


 Samuel Black
 2 years ago
 Views:
Transcription
1
2 The goal: to measure (determne) an unknown quantty x (the value of a RV X) Realsaton: n results: y 1, y 2,..., y j,..., y n, (the measured values of Y 1, Y 2,..., Y j,..., Y n ) every result s encumbered wth an error ε j : y j = x + ε j ; j = 1, 2,..., n the fundamental assumpton: the errors are normally dstrbuted wth the expected value equal to zero and wth some standard devaton σ ε j N(0, σ); E(ε j ) = 0; E(ε 2 j) = σ 2 f so, the probablty of havng a result n the range (y j, y j + dy j ) equals to: dp j dp (Y j (y j, y j + dy j )) = 1 exp [ (y j x) 2 ] 2πσ 2σ 2 dy j
3 Realsaton: dp j dp (Y j (y j, y j + dy j )) = 1 2πσ exp The lkelhood functon L s then: n 1 L = exp [ (y j x) 2 ] 2πσ 2σ 2 and ts logarthm l s: l = 1 2σ 2 n (y j x) 2 + a constant the demand l = maxmum [ (y j x) 2 2σ 2 n (y j x) 2 = mnmum n ε 2 j = mnmum ] dy j The sum of the squares of the errors should be as small as possble f the determnaton of ˆx s to be the most plausble.
4 Realsaton, cntd. The ML estmator s the arthmetc mean: ˆx = ȳ = 1 n n y j, σ 2 (ˆx) = σ2 n or, f the errors connected wth ndvdual measurements are dfferent: n ˆx = w jy j n w j [ ] w j = 1 n σj 2, σ 2 (ˆx) = 1 σ 2 j Now, f ˆx was the best estmator of X (ML estmator) of RV X then the quanttes ˆε j = y j ˆx are the best estmators of the quanttes ε j!! 1
5 We may construct a statstc: M = n ( ) 2 ˆεj = σ j n (y j ˆx) 2 = σ 2 j n (y j ˆx) 2 w j If the ε j have a normal dstrbuton the RV M should have a χ 2 dstrbuton wth n 1 degrees of freedom. Ths hypothess may be verfed (tested). A postve result of the test supports the data treatment. A negatve one calls for an extra analyss of the determnaton procedure.
6 An example (from: S. Brandt, Data analyss measurng the mass of the K 0 meson: (all data n MeV/c 2 ) m 1 = 498.1; σ 1 = 0.5, m 2 = ; σ 2 = 0.33, m 3 = 498.9; σ 3 = 0.4, m 4 = ; σ 4 = 0.4, ˆx = 4 y j 1 σ 2 j 4 1 = V AR(ˆx) = 1 σ 2 j 1 = 0.20 σ 2 j 4 M = j ˆx) (y 2 1 σj 2 = 7.2 χ ;3 = 7.82 there s no reason for dscredtng the above scheme of establshng the value of x.
7 LINEAR REGRESSION LINEAR REGRESSION s a powerfull tool for studyng fundamental relatonshps between two (or more) RVs Y and X. The method s based on the method of least squares. Let s dscuss the smplest case possble: we have a set of bvarate data,.e. a set of (x, y ) values and we presume a lnear relatonshp between the RV Y (dependent varable, response varable) and the explanatory (or regressor or predctor) varable X. Thus we should be able to wrte: ŷ = B 0 + B 1 x Note: Y are RVs, and y are ther measured values; ŷ are the ftted values,.e. the values resultng from the above relatonshp. We assume ths relatonshp be true and we are nterested n the numercal coeffcents n the proposed dependence. We shall fnd them va an adequate treatement of the measurement data.
8 LINEAR REGRESSION, cntd. As for x these are the values of a random varable too, but of a rather dfferent nature. For the sake of smplcty we should thnk about X (or the values x ) as of RV that take on values practcally free of any errors (uncertantes). We shall return to ths (unrealstc) assumpton later on. 1 The errors ε are to be consdered as dfferences between the measured (y ) and the ftted quanttes: ε = y ŷ y (B 0 + B 1 x ) As n the former case, we shall try to mnmse the sum of the error squares (SSE): Q = ε 2 ; t s not hard to show that ths sum may be decomposed nto 3 summands: ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. 1 One can magne a stuaton when the values of the predctor varable x had been carefully prepared pror to measurement,.e. any errors connected wth them are neglgble. On the other hand, the y values must be measured onlne and ther errors should not be dsregarded.
9 LINEAR REGRESSION, cntd. ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. The symbols used are: = (x x) 2 = x 2 n x 2 S yy = (y ȳ) 2 = y 2 nȳ 2 S xy = (x x)(y ȳ) = x y n xȳ The x and ȳ are the usual arthmetc means; fnally r = S xy Sxx Syy s the sample estmator of the correlaton coeffcent. In order to mnmse Q we are free to adjust properly the values of B 0 and B 1. It s obvous that Q wll be the smallest f the followng equatons are satsfed:
10 LINEAR REGRESSION, cntd. ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. B 1 Sxx r S yy = 0 ȳ B 0 + B 1 x = 0. We shall denote the solutons for the values of B 0 (ntercept) and B 1 (slope) coeffcents whch mnmse the sum of squares n a specal way: ˆβ 1 = r Syy = S xy ˆβ0 = ȳ ˆβ 1 x Wth the relaton: y = ˆβ 0 + ˆβ 1 x the SSE has mnmum: Q = S yy (1 r 2 ). (N.B. ths may be used to show that r must be 1.) For r > 0 the slope of the straght lne s postve, and for r < 0 negatve.
11 LINEAR REGRESSION, cntd. The r quantty (the sample correlaton coeffcent) gves us a measure of the adequacy of the assumed model (lnear dependence). It can be easly shown that the total sum of squares, SST = (y ȳ) 2 can be decomposed nto a sum of the regresson sum of squares, SSR and the ntroduced already error sum of squares, SSE: (y ȳ) 2 = (ŷ ȳ) 2 + (y ŷ ) 2 or SST = SSR + SSE SST s a quantty that consttutes a measure of total varablty of the true observatons; SSR s a measure of the varablty of the ftted values, and SSE s a measure of false ( erroneous ) varablty. We have: 1 = SSR SST + SSE SST but: SSR = SST SSE = SST SST (1 r 2 ) = r 2 SST. Thus the above unty s a sum of two terms: the frst of them s the square of the sample correlaton coeffcent, r 2 and t s sometmes called the coeffcent of determnaton. The closer s r 2 to 1 the better s the (lnear) model.
12 LINEAR REGRESSION, cntd. Up to now nothng has been sad about the random nature of the ftted coeffcents, B 0, B 1. We tactly assume them to be some real numbers coeffcents n an equaton. But n practce we calculate them from formulae that contan values of some RVs. Concluson: B 0, B 1 should be also perceved as RVs, n that sense that ther determnaton wll be accomplshed also wth some margns of errors. The lnear relatonshp should be wrtten n the form: Y = B 0 + B 1 X + ε, = 1,..., n or perhaps 2 Y = β 0 + β 1 X + ε, = 1,..., n where ε are errors,.e. all possble factors other than the X varable that can produce changes n Y. These errors are normally dstrbuted wth E(ε ) = 0 and V AR(ε ) equal σ 2. From the above relaton we have: E(Y ) = β 0 + β 1 x and V AR(Y ) = σ 2 (remember: any errors on x are to be neglected). The smple lnear regresson model has three unknown parameters: β 0, β 1 and σ 2. 2 Ths change of notaton reflects the change of our attude to the ftted coeffcents; we should thnk about them as about RVs.
13 LINEAR REGRESSION, cntd. The method of least squares allows us to fnd the numercal values of the beta coeffcents theses are the ML estmators and they should be perceved as the expected values: As for the varances we have: E(β 1 ) = ˆβ 1 = r Syy E(β 0 ) = ˆβ 0 = ȳ ˆβ 1 x V AR(β 1 ) = σ2 = S xy V AR(β 0 ) = σ 2 ( 1 n + x2 )
14 verfcaton (some manpulatons? = should be carefully justfed; for β 0 the verfcaton can be done n a smlar manner) The thrd parameter of the smple lnear regresson model s σ 2. It may be shown that the statstc E(β 1 ) = E = { Sxy? = 0 + β 1 } { = E (x x)(β 0 + β 1 x ) } (x x)(y Ȳ ) = β 0? = E { (x x) + β 1 (x x)(x x) = β 1 = β 1 V AR(β 1 ) = { } { SxY V AR = V AR (x x) 2? = S 2 xx (x x)y } (x x)x } (x x)(y Ȳ ) V AR(Y ) = Sxx 2 σ 2 = σ2
15 verfcaton, cntd. s 2 = SSE n 2 = (y ŷ ) 2 n 2 s an unbased estmator of σ 2. (The n 2 n the denomnator reflects the fact that the data are used for determnng two coeffcents). The RV (n 2)s 2 /σ 2 has a chsquare dstrbuton wth n 2 degrees of freedom. Replacng the values of σ 2 n the formulae for the varances of the beta coeffcents by the sample estmator s we conclude that these coeffcents can be regarded as two standardsed random varables: β 1 ˆβ 1 s β 0 and ˆβ 0. 1 s n + x2
16 verfcaton, cntd. Theˆvalues are the ML estmators and the denomnators are the estmated standard errors of our coeffcents. Both standardsed varables have a Student s dstrbuton wth the n 2 degrees of freedom. Ther confdence ntervals can de determned n the usual way.
Chapter 14 Simple Linear Regression
Sldes Prepared JOHN S. LOUCKS St. Edward s Unverst Slde Chapter 4 Smple Lnear Regresson Smple Lnear Regresson Model Least Squares Method Coeffcent of Determnaton Model Assumptons Testng for Sgnfcance Usng
More informationCausal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting
Causal, Explanatory Forecastng Assumes causeandeffect relatonshp between system nputs and ts output Forecastng wth Regresson Analyss Rchard S. Barr Inputs System Cause + Effect Relatonshp The job of
More informationThe covariance is the two variable analog to the variance. The formula for the covariance between two variables is
Regresson Lectures So far we have talked only about statstcs that descrbe one varable. What we are gong to be dscussng for much of the remander of the course s relatonshps between two or more varables.
More informationCHAPTER 14 MORE ABOUT REGRESSION
CHAPTER 14 MORE ABOUT REGRESSION We learned n Chapter 5 that often a straght lne descrbes the pattern of a relatonshp between two quanttatve varables. For nstance, n Example 5.1 we explored the relatonshp
More informationx f(x) 1 0.25 1 0.75 x 1 0 1 1 0.04 0.01 0.20 1 0.12 0.03 0.60
BIVARIATE DISTRIBUTIONS Let be a varable that assumes the values { 1,,..., n }. Then, a functon that epresses the relatve frequenc of these values s called a unvarate frequenc functon. It must be true
More informationSIMPLE LINEAR CORRELATION
SIMPLE LINEAR CORRELATION Smple lnear correlaton s a measure of the degree to whch two varables vary together, or a measure of the ntensty of the assocaton between two varables. Correlaton often s abused.
More informationPSYCHOLOGICAL RESEARCH (PYC 304C) Lecture 12
14 The Chsquared dstrbuton PSYCHOLOGICAL RESEARCH (PYC 304C) Lecture 1 If a normal varable X, havng mean µ and varance σ, s standardsed, the new varable Z has a mean 0 and varance 1. When ths standardsed
More informationIntroduction to Regression
Introducton to Regresson Regresson a means of predctng a dependent varable based one or more ndependent varables. Ths s done by fttng a lne or surface to the data ponts that mnmzes the total error. 
More information1. Measuring association using correlation and regression
How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a
More informationQuestions that we may have about the variables
Antono Olmos, 01 Multple Regresson Problem: we want to determne the effect of Desre for control, Famly support, Number of frends, and Score on the BDI test on Perceved Support of Latno women. Dependent
More informationHYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION
HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION Abdul Ghapor Hussn Centre for Foundaton Studes n Scence Unversty of Malaya 563 KUALA LUMPUR Emal: ghapor@umedumy Abstract Ths paper
More informationErrorPropagation.nb 1. Error Propagation
ErrorPropagaton.nb Error Propagaton Suppose that we make observatons of a quantty x that s subject to random fluctuatons or measurement errors. Our best estmate of the true value for ths quantty s then
More informationCHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES
CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES In ths chapter, we wll learn how to descrbe the relatonshp between two quanttatve varables. Remember (from Chapter 2) that the terms quanttatve varable
More informationSTATISTICAL DATA ANALYSIS IN EXCEL
Mcroarray Center STATISTICAL DATA ANALYSIS IN EXCEL Lecture 6 Some Advanced Topcs Dr. Petr Nazarov 1401013 petr.nazarov@crpsante.lu Statstcal data analyss n Ecel. 6. Some advanced topcs Correcton for
More informationEconomic Interpretation of Regression. Theory and Applications
Economc Interpretaton of Regresson Theor and Applcatons Classcal and Baesan Econometrc Methods Applcaton of mathematcal statstcs to economc data for emprcal support Economc theor postulates a qualtatve
More informationSIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA
SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA E. LAGENDIJK Department of Appled Physcs, Delft Unversty of Technology Lorentzweg 1, 68 CJ, The Netherlands Emal: e.lagendjk@tnw.tudelft.nl
More informationThe Analysis of Covariance. ERSH 8310 Keppel and Wickens Chapter 15
The Analyss of Covarance ERSH 830 Keppel and Wckens Chapter 5 Today s Class Intal Consderatons Covarance and Lnear Regresson The Lnear Regresson Equaton TheAnalyss of Covarance Assumptons Underlyng the
More information2.4 Bivariate distributions
page 28 2.4 Bvarate dstrbutons 2.4.1 Defntons Let X and Y be dscrete r.v.s defned on the same probablty space (S, F, P). Instead of treatng them separately, t s often necessary to thnk of them actng together
More informationCHAPTER 7 THE TWOVARIABLE REGRESSION MODEL: HYPOTHESIS TESTING
CHAPTER 7 THE TWOVARIABLE REGRESSION MODEL: HYPOTHESIS TESTING QUESTIONS 7.1. (a) In the regresson contet, the method of least squares estmates the regresson parameters n such a way that the sum of the
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationLinear Circuits Analysis. Superposition, Thevenin /Norton Equivalent circuits
Lnear Crcuts Analyss. Superposton, Theenn /Norton Equalent crcuts So far we hae explored tmendependent (resste) elements that are also lnear. A tmendependent elements s one for whch we can plot an / cure.
More informationThe Analysis of Outliers in Statistical Data
THALES Project No. xxxx The Analyss of Outlers n Statstcal Data Research Team Chrysses Caron, Assocate Professor (P.I.) Vaslk Karot, Doctoral canddate Polychrons Economou, Chrstna Perrakou, Postgraduate
More informationRegression Models for a Binary Response Using EXCEL and JMP
SEMATECH 997 Statstcal Methods Symposum Austn Regresson Models for a Bnary Response Usng EXCEL and JMP Davd C. Trndade, Ph.D. STATTECH Consultng and Tranng n Appled Statstcs San Jose, CA Topcs Practcal
More informationPRACTICE 1: MUTUAL FUNDS EVALUATION USING MATLAB.
PRACTICE 1: MUTUAL FUNDS EVALUATION USING MATLAB. INDEX 1. Load data usng the Edtor wndow and mfle 2. Learnng to save results from the Edtor wndow. 3. Computng the Sharpe Rato 4. Obtanng the Treynor Rato
More informationLinear Regression Analysis for STARDEX
Lnear Regresson Analss for STARDEX Malcolm Halock, Clmatc Research Unt The followng document s an overvew of lnear regresson methods for reference b members of STARDEX. Whle t ams to cover the most common
More informationAnalysis of Covariance
Chapter 551 Analyss of Covarance Introducton A common tas n research s to compare the averages of two or more populatons (groups). We mght want to compare the ncome level of two regons, the ntrogen content
More information9.1 The Cumulative Sum Control Chart
Learnng Objectves 9.1 The Cumulatve Sum Control Chart 9.1.1 Basc Prncples: Cusum Control Chart for Montorng the Process Mean If s the target for the process mean, then the cumulatve sum control chart s
More informationAn Analysis of Factors Influencing the SelfRated Health of Elderly Chinese People
Open Journal of Socal Scences, 205, 3, 520 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/ss http://dx.do.org/0.4236/ss.205.35003 An Analyss of Factors Influencng the SelfRated Health of
More informationLecture 10: Linear Regression Approach, Assumptions and Diagnostics
Approach to Modelng I Lecture 1: Lnear Regresson Approach, Assumptons and Dagnostcs Sandy Eckel seckel@jhsph.edu 8 May 8 General approach for most statstcal modelng: Defne the populaton of nterest State
More informationThe Probit Model. Alexander Spermann. SoSe 2009
The Probt Model Aleander Spermann Unversty of Freburg SoSe 009 Course outlne. Notaton and statstcal foundatons. Introducton to the Probt model 3. Applcaton 4. Coeffcents and margnal effects 5. Goodnessofft
More informationCommunication Networks II Contents
8 / 1  Communcaton Networs II (Görg)  www.comnets.unbremen.de Communcaton Networs II Contents 1 Fundamentals of probablty theory 2 Traffc n communcaton networs 3 Stochastc & Marovan Processes (SP
More informationInequality and The Accounting Period. Quentin Wodon and Shlomo Yitzhaki. World Bank and Hebrew University. September 2001.
Inequalty and The Accountng Perod Quentn Wodon and Shlomo Ytzha World Ban and Hebrew Unversty September Abstract Income nequalty typcally declnes wth the length of tme taen nto account for measurement.
More informationH 1 : at least one is not zero
Chapter 6 More Multple Regresson Model The Ftest Jont Hypothess Tests Consder the lnear regresson equaton: () y = β + βx + βx + β4x4 + e for =,,..., N The tstatstc gve a test of sgnfcance of an ndvdual
More informationgreatest common divisor
4. GCD 1 The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no
More informationGraph Theory and Cayley s Formula
Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll
More informationTime Series Analysis in Studies of AGN Variability. Bradley M. Peterson The Ohio State University
Tme Seres Analyss n Studes of AGN Varablty Bradley M. Peterson The Oho State Unversty 1 Lnear Correlaton Degree to whch two parameters are lnearly correlated can be expressed n terms of the lnear correlaton
More informationState function: eigenfunctions of hermitian operators> normalization, orthogonality completeness
Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators> normalzaton, orthogonalty completeness egenvalues and
More informationNonlinear data mapping by neural networks
Nonlnear data mappng by neural networks R.P.W. Dun Delft Unversty of Technology, Netherlands Abstract A revew s gven of the use of neural networks for nonlnear mappng of hgh dmensonal data on lower dmensonal
More informationQuantization Effects in Digital Filters
Quantzaton Effects n Dgtal Flters Dstrbuton of Truncaton Errors In two's complement representaton an exact number would have nfntely many bts (n general). When we lmt the number of bts to some fnte value
More informationLinear Regression, Regularization BiasVariance Tradeoff
HTF: Ch3, 7 B: Ch3 Lnear Regresson, Regularzaton BasVarance Tradeoff Thanks to C Guestrn, T Detterch, R Parr, N Ray 1 Outlne Lnear Regresson MLE = Least Squares! Bass functons Evaluatng Predctors Tranng
More informationPortfolio Loss Distribution
Portfolo Loss Dstrbuton Rsky assets n loan ortfolo hghly llqud assets holdtomaturty n the bank s balance sheet Outstandngs The orton of the bank asset that has already been extended to borrowers. Commtment
More informationChapter 15 Multiple Regression
Chapter 5 Multple Regresson In chapter 9, we consdered one dependent varable (Y) and one predctor (regressor or ndependent varable) (X) and predcted Y based on X only, whch also known as the smple lnear
More informationTHE DISTRIBUTION OF LOAN PORTFOLIO VALUE * Oldrich Alfons Vasicek
HE DISRIBUION OF LOAN PORFOLIO VALUE * Oldrch Alfons Vascek he amount of captal necessary to support a portfolo of debt securtes depends on the probablty dstrbuton of the portfolo loss. Consder a portfolo
More informationCan Auto Liability Insurance Purchases Signal Risk Attitude?
Internatonal Journal of Busness and Economcs, 2011, Vol. 10, No. 2, 159164 Can Auto Lablty Insurance Purchases Sgnal Rsk Atttude? ChuShu L Department of Internatonal Busness, Asa Unversty, Tawan ShengChang
More informationNPAR TESTS. OneSample ChiSquare Test. Cell Specification. Observed Frequencies 1O i 6. Expected Frequencies 1EXP i 6
PAR TESTS If a WEIGHT varable s specfed, t s used to replcate a case as many tmes as ndcated by the weght value rounded to the nearest nteger. If the workspace requrements are exceeded and samplng has
More informationn + d + q = 24 and.05n +.1d +.25q = 2 { n + d + q = 24 (3) n + 2d + 5q = 40 (2)
MATH 16T Exam 1 : Part I (InClass) Solutons 1. (0 pts) A pggy bank contans 4 cons, all of whch are nckels (5 ), dmes (10 ) or quarters (5 ). The pggy bank also contans a con of each denomnaton. The total
More information1 Example 1: Axisaligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationRecurrence. 1 Definitions and main statements
Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.
More informationLogistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification
Lecture 4: More classfers and classes C4B Machne Learnng Hlary 20 A. Zsserman Logstc regresson Loss functons revsted Adaboost Loss functons revsted Optmzaton Multple class classfcaton Logstc Regresson
More informationI. SCOPE, APPLICABILITY AND PARAMETERS Scope
D Executve Board Annex 9 Page A/R ethodologcal Tool alculaton of the number of sample plots for measurements wthn A/R D project actvtes (Verson 0) I. SOPE, PIABIITY AD PARAETERS Scope. Ths tool s applcable
More informationDescriptive Statistics (60 points)
Economcs 30330: Statstcs for Economcs Problem Set 2 Unversty of otre Dame Instructor: Julo Garín Sprng 2012 Descrptve Statstcs (60 ponts) 1. Followng a recent government shutdown, Mnnesota Governor Mark
More information1 De nitions and Censoring
De ntons and Censorng. Survval Analyss We begn by consderng smple analyses but we wll lead up to and take a look at regresson on explanatory factors., as n lnear regresson part A. The mportant d erence
More informationCalibration and Linear Regression Analysis: A SelfGuided Tutorial
Calbraton and Lnear Regresson Analyss: A SelfGuded Tutoral Part The Calbraton Curve, Correlaton Coeffcent and Confdence Lmts CHM314 Instrumental Analyss Department of Chemstry, Unversty of Toronto Dr.
More informationThe OC Curve of Attribute Acceptance Plans
The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationExhaustive Regression. An Exploration of RegressionBased Data Mining Techniques Using Super Computation
Exhaustve Regresson An Exploraton of RegressonBased Data Mnng Technques Usng Super Computaton Antony Daves, Ph.D. Assocate Professor of Economcs Duquesne Unversty Pttsburgh, PA 58 Research Fellow The
More informationOnline Appendix for Forecasting the Equity Risk Premium: The Role of Technical Indicators
Onlne Appendx for Forecastng the Equty Rsk Premum: The Role of Techncal Indcators Chrstopher J. Neely Federal Reserve Bank of St. Lous neely@stls.frb.org Davd E. Rapach Sant Lous Unversty rapachde@slu.edu
More information+ + +   This circuit than can be reduced to a planar circuit
MeshCurrent Method The meshcurrent s analog of the nodeoltage method. We sole for a new set of arables, mesh currents, that automatcally satsfy KCLs. As such, meshcurrent method reduces crcut soluton to
More informationLesson 2 Chapter Two Three Phase Uncontrolled Rectifier
Lesson 2 Chapter Two Three Phase Uncontrolled Rectfer. Operatng prncple of three phase half wave uncontrolled rectfer The half wave uncontrolled converter s the smplest of all three phase rectfer topologes.
More informationWhat is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More informationIntroduction: Analysis of Electronic Circuits
/30/008 ntroducton / ntroducton: Analyss of Electronc Crcuts Readng Assgnment: KVL and KCL text from EECS Just lke EECS, the majorty of problems (hw and exam) n EECS 3 wll be crcut analyss problems. Thus,
More informationCHOLESTEROL REFERENCE METHOD LABORATORY NETWORK. Sample Stability Protocol
CHOLESTEROL REFERENCE METHOD LABORATORY NETWORK Sample Stablty Protocol Background The Cholesterol Reference Method Laboratory Network (CRMLN) developed certfcaton protocols for total cholesterol, HDL
More informationMultivariate EWMA Control Chart
Multvarate EWMA Control Chart Summary The Multvarate EWMA Control Chart procedure creates control charts for two or more numerc varables. Examnng the varables n a multvarate sense s extremely mportant
More informationBERNSTEIN POLYNOMIALS
OnLne Geometrc Modelng Notes BERNSTEIN POLYNOMIALS Kenneth I. Joy Vsualzaton and Graphcs Research Group Department of Computer Scence Unversty of Calforna, Davs Overvew Polynomals are ncredbly useful
More informationQUANTUM MECHANICS, BRAS AND KETS
PH575 SPRING QUANTUM MECHANICS, BRAS AND KETS The followng summares the man relatons and defntons from quantum mechancs that we wll be usng. State of a phscal sstem: The state of a phscal sstem s represented
More informationStudy on CET4 Marks in China s Graded English Teaching
Study on CET4 Marks n Chna s Graded Englsh Teachng CHE We College of Foregn Studes, Shandong Insttute of Busness and Technology, P.R.Chna, 264005 Abstract: Ths paper deploys Logt model, and decomposes
More informationChapter 7. RandomVariate Generation 7.1. Prof. Dr. Mesut Güneş Ch. 7 RandomVariate Generation
Chapter 7 RandomVarate Generaton 7. Contents Inversetransform Technque AcceptanceRejecton Technque Specal Propertes 7. Purpose & Overvew Develop understandng of generatng samples from a specfed dstrbuton
More informationA Probabilistic Theory of Coherence
A Probablstc Theory of Coherence BRANDEN FITELSON. The Coherence Measure C Let E be a set of n propostons E,..., E n. We seek a probablstc measure C(E) of the degree of coherence of E. Intutvely, we want
More informationNasdaq Iceland Bond Indices 01 April 2015
Nasdaq Iceland Bond Indces 01 Aprl 2015 Fxed duraton Indces Introducton Nasdaq Iceland (the Exchange) began calculatng ts current bond ndces n the begnnng of 2005. They were a response to recent changes
More informationFormula of Total Probability, Bayes Rule, and Applications
1 Formula of Total Probablty, Bayes Rule, and Applcatons Recall that for any event A, the par of events A and A has an ntersecton that s empty, whereas the unon A A represents the total populaton of nterest.
More informationLecture 14: Implementing CAPM
Lecture 14: Implementng CAPM Queston: So, how do I apply the CAPM? Current readng: Brealey and Myers, Chapter 9 Reader, Chapter 15 M. Spegel and R. Stanton, 2000 1 Key Results So Far All nvestors should
More informationLatent Class Regression. Statistics for Psychosocial Research II: Structural Models December 4 and 6, 2006
Latent Class Regresson Statstcs for Psychosocal Research II: Structural Models December 4 and 6, 2006 Latent Class Regresson (LCR) What s t and when do we use t? Recall the standard latent class model
More informationPassive Filters. References: Barbow (pp 265275), Hayes & Horowitz (pp 3260), Rizzoni (Chap. 6)
Passve Flters eferences: Barbow (pp 6575), Hayes & Horowtz (pp 360), zzon (Chap. 6) Frequencyselectve or flter crcuts pass to the output only those nput sgnals that are n a desred range of frequences (called
More informationL10: Linear discriminants analysis
L0: Lnear dscrmnants analyss Lnear dscrmnant analyss, two classes Lnear dscrmnant analyss, C classes LDA vs. PCA Lmtatons of LDA Varants of LDA Other dmensonalty reducton methods CSCE 666 Pattern Analyss
More informationCapital asset pricing model, arbitrage pricing theory and portfolio management
Captal asset prcng model, arbtrage prcng theory and portfolo management Vnod Kothar The captal asset prcng model (CAPM) s great n terms of ts understandng of rsk decomposton of rsk nto securtyspecfc rsk
More informationLOOP ANALYSIS. The second systematic technique to determine all currents and voltages in a circuit
LOOP ANALYSS The second systematic technique to determine all currents and voltages in a circuit T S DUAL TO NODE ANALYSS  T FRST DETERMNES ALL CURRENTS N A CRCUT AND THEN T USES OHM S LAW TO COMPUTE
More informationThe Classical Model. GaussMarkov Theorem, Specification, Endogeneity
The Classcal Model GaussMarkov Theorem, Specfcaton, Endogenety Propertes of Least Squares Estmators Here s the model: Y = β + β + β + β + L+ β + ε 0 For the case wth regressor and constant, I showed some
More informationMULTIPLE LINEAR REGRESSION IN MINITAB
MULTIPLE LINEAR REGRESSION IN MINITAB Ths document shows a complcated Mntab multple regresson. It ncludes descrptons of the Mntab commands, and the Mntab output s heavly annotated. Comments n { } are used
More informationThe Magnetic Field. Concepts and Principles. Moving Charges. Permanent Magnets
. The Magnetc Feld Concepts and Prncples Movng Charges All charged partcles create electrc felds, and these felds can be detected by other charged partcles resultng n electrc force. However, a completely
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationTexas Instruments 30X IIS Calculator
Texas Instruments 30X IIS Calculator Keystrokes for the TI30X IIS are shown for a few topcs n whch keystrokes are unque. Start by readng the Quk Start secton. Then, before begnnng a specfc unt of the
More informationHow Sets of Coherent Probabilities May Serve as Models for Degrees of Incoherence
1 st Internatonal Symposum on Imprecse Probabltes and Ther Applcatons, Ghent, Belgum, 29 June 2 July 1999 How Sets of Coherent Probabltes May Serve as Models for Degrees of Incoherence Mar J. Schervsh
More informationA statistical approach to determine Microbiologically Influenced Corrosion (MIC) Rates of underground gas pipelines.
A statstcal approach to determne Mcrobologcally Influenced Corroson (MIC) Rates of underground gas ppelnes. by Lech A. Grzelak A thess submtted to the Delft Unversty of Technology n conformty wth the requrements
More informationTesting GOF & Estimating Overdispersion
Testng GOF & Estmatng Overdsperson Your Most General Model Needs to Ft the Dataset It s mportant that the most general (complcated) model n your canddate model lst fts the data well. Ths model s a benchmark
More informationForecasting the Direction and Strength of Stock Market Movement
Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract  Stock market s one of the most complcated systems
More informationSemiconductor sensors of temperature
Semconductor sensors of temperature he measurement objectve 1. Identfy the unknown bead type thermstor. Desgn the crcutry for lnearzaton of ts transfer curve.. Fnd the dependence of forward voltage drop
More informationFinite Math Chapter 10: Study Guide and Solution to Problems
Fnte Math Chapter 10: Study Gude and Soluton to Problems Basc Formulas and Concepts 10.1 Interest Basc Concepts Interest A fee a bank pays you for money you depost nto a savngs account. Prncpal P The amount
More informationThe Choice of Direct Dealing or Electronic Brokerage in Foreign Exchange Trading
The Choce of Drect Dealng or Electronc Brokerage n Foregn Exchange Tradng Mchael Melvn & Ln Wen Arzona State Unversty Introducton Electronc Brokerage n Foregn Exchange Start from a base of zero n 1992
More informationGeneral Iteration Algorithm for Classification Ratemaking
General Iteraton Algorthm for Classfcaton Ratemakng by Luyang Fu and Chengsheng eter Wu ABSTRACT In ths study, we propose a flexble and comprehensve teraton algorthm called general teraton algorthm (GIA)
More informationWe are now ready to answer the question: What are the possible cardinalities for finite fields?
Chapter 3 Fnte felds We have seen, n the prevous chapters, some examples of fnte felds. For example, the resdue class rng Z/pZ (when p s a prme) forms a feld wth p elements whch may be dentfed wth the
More informationSimon Acomb NAG Financial Mathematics Day
1 Why People Who Prce Dervatves Are Interested In Correlaton mon Acomb NAG Fnancal Mathematcs Day Correlaton Rsk What Is Correlaton No lnear relatonshp between ponts Comovement between the ponts Postve
More informationEstimation of Dispersion Parameters in GLMs with and without Random Effects
Mathematcal Statstcs Stockholm Unversty Estmaton of Dsperson Parameters n GLMs wth and wthout Random Effects Meng Ruoyan Examensarbete 2004:5 Postal address: Mathematcal Statstcs Dept. of Mathematcs Stockholm
More informationAnalysis of Premium Liabilities for Australian Lines of Business
Summary of Analyss of Premum Labltes for Australan Lnes of Busness Emly Tao Honours Research Paper, The Unversty of Melbourne Emly Tao Acknowledgements I am grateful to the Australan Prudental Regulaton
More informationLecture 3: Force of Interest, Real Interest Rate, Annuity
Lecture 3: Force of Interest, Real Interest Rate, Annuty Goals: Study contnuous compoundng and force of nterest Dscuss real nterest rate Learn annutymmedate, and ts present value Study annutydue, and
More informationEfficient Project Portfolio as a tool for Enterprise Risk Management
Effcent Proect Portfolo as a tool for Enterprse Rsk Management Valentn O. Nkonov Ural State Techncal Unversty Growth Traectory Consultng Company January 5, 27 Effcent Proect Portfolo as a tool for Enterprse
More informationSIGNIFICANT FIGURES (4SF) (4SF) (5SF) (3 SF) 62.4 (3 SF) x 10 4 (5 SF) Figure 0
SIGIFICAT FIGURES Wth any calbrated nstrument, there s a lmt to the number of fgures that can be relably kept n the answer. For dgtal nstruments, the lmtaton s the number of fgures appearng n the dsplay.
More informationCovariance & Correlation
Covarance & Correlaton The covarance between two varables s defned by: cov x,y= x x y y =xyxy Ths s the most useful thng they never tell you n most lab courses! Note that cov(x,x)=v(x). The correlaton
More informationtotal A A reag total A A r eag
hapter 5 Standardzng nalytcal Methods hapter Overvew 5 nalytcal Standards 5B albratng the Sgnal (S total ) 5 Determnng the Senstvty (k ) 5D Lnear Regresson and albraton urves 5E ompensatng for the Reagent
More informationAlthough ordinary leastsquares (OLS) regression
egresson through the Orgn Blackwell Oxford, TEST 014198X 003 5 31000 Orgnal Joseph Teachng G. UK Artcle Publshng Esenhauer through Statstcs the Ltd Trust Orgn 001 KEYWODS: Teachng; egresson; Analyss of
More informationChapter XX More advanced approaches to the analysis of survey data. Gad Nathan Hebrew University Jerusalem, Israel. Abstract
Household Sample Surveys n Developng and Transton Countres Chapter More advanced approaches to the analyss of survey data Gad Nathan Hebrew Unversty Jerusalem, Israel Abstract In the present chapter, we
More information