# THE METHOD OF LEAST SQUARES THE METHOD OF LEAST SQUARES

Save this PDF as:

Size: px
Start display at page:

## Transcription

1

2 The goal: to measure (determne) an unknown quantty x (the value of a RV X) Realsaton: n results: y 1, y 2,..., y j,..., y n, (the measured values of Y 1, Y 2,..., Y j,..., Y n ) every result s encumbered wth an error ε j : y j = x + ε j ; j = 1, 2,..., n the fundamental assumpton: the errors are normally dstrbuted wth the expected value equal to zero and wth some standard devaton σ ε j N(0, σ); E(ε j ) = 0; E(ε 2 j) = σ 2 f so, the probablty of havng a result n the range (y j, y j + dy j ) equals to: dp j dp (Y j (y j, y j + dy j )) = 1 exp [ (y j x) 2 ] 2πσ 2σ 2 dy j

3 Realsaton: dp j dp (Y j (y j, y j + dy j )) = 1 2πσ exp The lkelhood functon L s then: n 1 L = exp [ (y j x) 2 ] 2πσ 2σ 2 and ts logarthm l s: l = 1 2σ 2 n (y j x) 2 + a constant the demand l = maxmum [ (y j x) 2 2σ 2 n (y j x) 2 = mnmum n ε 2 j = mnmum ] dy j The sum of the squares of the errors should be as small as possble f the determnaton of ˆx s to be the most plausble.

4 Realsaton, cntd. The ML estmator s the arthmetc mean: ˆx = ȳ = 1 n n y j, σ 2 (ˆx) = σ2 n or, f the errors connected wth ndvdual measurements are dfferent: n ˆx = w jy j n w j [ ] w j = 1 n σj 2, σ 2 (ˆx) = 1 σ 2 j Now, f ˆx was the best estmator of X (ML estmator) of RV X then the quanttes ˆε j = y j ˆx are the best estmators of the quanttes ε j!! 1

5 We may construct a statstc: M = n ( ) 2 ˆεj = σ j n (y j ˆx) 2 = σ 2 j n (y j ˆx) 2 w j If the ε j have a normal dstrbuton the RV M should have a χ 2 dstrbuton wth n 1 degrees of freedom. Ths hypothess may be verfed (tested). A postve result of the test supports the data treatment. A negatve one calls for an extra analyss of the determnaton procedure.

6 An example (from: S. Brandt, Data analyss measurng the mass of the K 0 meson: (all data n MeV/c 2 ) m 1 = 498.1; σ 1 = 0.5, m 2 = ; σ 2 = 0.33, m 3 = 498.9; σ 3 = 0.4, m 4 = ; σ 4 = 0.4, ˆx = 4 y j 1 σ 2 j 4 1 = V AR(ˆx) = 1 σ 2 j 1 = 0.20 σ 2 j 4 M = j ˆx) (y 2 1 σj 2 = 7.2 χ ;3 = 7.82 there s no reason for dscredtng the above scheme of establshng the value of x.

7 LINEAR REGRESSION LINEAR REGRESSION s a powerfull tool for studyng fundamental relatonshps between two (or more) RVs Y and X. The method s based on the method of least squares. Let s dscuss the smplest case possble: we have a set of bvarate data,.e. a set of (x, y ) values and we presume a lnear relatonshp between the RV Y (dependent varable, response varable) and the explanatory (or regressor or predctor) varable X. Thus we should be able to wrte: ŷ = B 0 + B 1 x Note: Y are RVs, and y are ther measured values; ŷ are the ftted values,.e. the values resultng from the above relatonshp. We assume ths relatonshp be true and we are nterested n the numercal coeffcents n the proposed dependence. We shall fnd them va an adequate treatement of the measurement data.

8 LINEAR REGRESSION, cntd. As for x these are the values of a random varable too, but of a rather dfferent nature. For the sake of smplcty we should thnk about X (or the values x ) as of RV that take on values practcally free of any errors (uncertantes). We shall return to ths (unrealstc) assumpton later on. 1 The errors ε are to be consdered as dfferences between the measured (y ) and the ftted quanttes: ε = y ŷ y (B 0 + B 1 x ) As n the former case, we shall try to mnmse the sum of the error squares (SSE): Q = ε 2 ; t s not hard to show that ths sum may be decomposed nto 3 summands: ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. 1 One can magne a stuaton when the values of the predctor varable x had been carefully prepared pror to measurement,.e. any errors connected wth them are neglgble. On the other hand, the y values must be measured on-lne and ther errors should not be dsregarded.

9 LINEAR REGRESSION, cntd. ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. The symbols used are: = (x x) 2 = x 2 n x 2 S yy = (y ȳ) 2 = y 2 nȳ 2 S xy = (x x)(y ȳ) = x y n xȳ The x and ȳ are the usual arthmetc means; fnally r = S xy Sxx Syy s the sample estmator of the correlaton coeffcent. In order to mnmse Q we are free to adjust properly the values of B 0 and B 1. It s obvous that Q wll be the smallest f the followng equatons are satsfed:

10 LINEAR REGRESSION, cntd. ( Q = S yy (1 r 2 ) + B 1 Sxx r ) 2 S yy + n (ȳ B0 + B 1 x) 2. B 1 Sxx r S yy = 0 ȳ B 0 + B 1 x = 0. We shall denote the solutons for the values of B 0 (ntercept) and B 1 (slope) coeffcents whch mnmse the sum of squares n a specal way: ˆβ 1 = r Syy = S xy ˆβ0 = ȳ ˆβ 1 x Wth the relaton: y = ˆβ 0 + ˆβ 1 x the SSE has mnmum: Q = S yy (1 r 2 ). (N.B. ths may be used to show that r must be 1.) For r > 0 the slope of the straght lne s postve, and for r < 0 negatve.

11 LINEAR REGRESSION, cntd. The r quantty (the sample correlaton coeffcent) gves us a measure of the adequacy of the assumed model (lnear dependence). It can be easly shown that the total sum of squares, SST = (y ȳ) 2 can be decomposed nto a sum of the regresson sum of squares, SSR and the ntroduced already error sum of squares, SSE: (y ȳ) 2 = (ŷ ȳ) 2 + (y ŷ ) 2 or SST = SSR + SSE SST s a quantty that consttutes a measure of total varablty of the true observatons; SSR s a measure of the varablty of the ftted values, and SSE s a measure of false ( erroneous ) varablty. We have: 1 = SSR SST + SSE SST but: SSR = SST SSE = SST SST (1 r 2 ) = r 2 SST. Thus the above unty s a sum of two terms: the frst of them s the square of the sample correlaton coeffcent, r 2 and t s sometmes called the coeffcent of determnaton. The closer s r 2 to 1 the better s the (lnear) model.

12 LINEAR REGRESSION, cntd. Up to now nothng has been sad about the random nature of the ftted coeffcents, B 0, B 1. We tactly assume them to be some real numbers coeffcents n an equaton. But n practce we calculate them from formulae that contan values of some RVs. Concluson: B 0, B 1 should be also perceved as RVs, n that sense that ther determnaton wll be accomplshed also wth some margns of errors. The lnear relatonshp should be wrtten n the form: Y = B 0 + B 1 X + ε, = 1,..., n or perhaps 2 Y = β 0 + β 1 X + ε, = 1,..., n where ε are errors,.e. all possble factors other than the X varable that can produce changes n Y. These errors are normally dstrbuted wth E(ε ) = 0 and V AR(ε ) equal σ 2. From the above relaton we have: E(Y ) = β 0 + β 1 x and V AR(Y ) = σ 2 (remember: any errors on x are to be neglected). The smple lnear regresson model has three unknown parameters: β 0, β 1 and σ 2. 2 Ths change of notaton reflects the change of our attude to the ftted coeffcents; we should thnk about them as about RVs.

13 LINEAR REGRESSION, cntd. The method of least squares allows us to fnd the numercal values of the beta coeffcents theses are the ML estmators and they should be perceved as the expected values: As for the varances we have: E(β 1 ) = ˆβ 1 = r Syy E(β 0 ) = ˆβ 0 = ȳ ˆβ 1 x V AR(β 1 ) = σ2 = S xy V AR(β 0 ) = σ 2 ( 1 n + x2 )

14 verfcaton (some manpulatons? = should be carefully justfed; for β 0 the verfcaton can be done n a smlar manner) The thrd parameter of the smple lnear regresson model s σ 2. It may be shown that the statstc E(β 1 ) = E = { Sxy? = 0 + β 1 } { = E (x x)(β 0 + β 1 x ) } (x x)(y Ȳ ) = β 0? = E { (x x) + β 1 (x x)(x x) = β 1 = β 1 V AR(β 1 ) = { } { SxY V AR = V AR (x x) 2? = S 2 xx (x x)y } (x x)x } (x x)(y Ȳ ) V AR(Y ) = Sxx 2 σ 2 = σ2

15 verfcaton, cntd. s 2 = SSE n 2 = (y ŷ ) 2 n 2 s an unbased estmator of σ 2. (The n 2 n the denomnator reflects the fact that the data are used for determnng two coeffcents). The RV (n 2)s 2 /σ 2 has a ch-square dstrbuton wth n 2 degrees of freedom. Replacng the values of σ 2 n the formulae for the varances of the beta coeffcents by the sample estmator s we conclude that these coeffcents can be regarded as two standardsed random varables: β 1 ˆβ 1 s β 0 and ˆβ 0. 1 s n + x2

16 verfcaton, cntd. Theˆ-values are the ML estmators and the denomnators are the estmated standard errors of our coeffcents. Both standardsed varables have a Student s dstrbuton wth the n 2 degrees of freedom. Ther confdence ntervals can de determned n the usual way.

### Chapter 14 Simple Linear Regression

Sldes Prepared JOHN S. LOUCKS St. Edward s Unverst Slde Chapter 4 Smple Lnear Regresson Smple Lnear Regresson Model Least Squares Method Coeffcent of Determnaton Model Assumptons Testng for Sgnfcance Usng

### Causal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting

Causal, Explanatory Forecastng Assumes cause-and-effect relatonshp between system nputs and ts output Forecastng wth Regresson Analyss Rchard S. Barr Inputs System Cause + Effect Relatonshp The job of

### The covariance is the two variable analog to the variance. The formula for the covariance between two variables is

Regresson Lectures So far we have talked only about statstcs that descrbe one varable. What we are gong to be dscussng for much of the remander of the course s relatonshps between two or more varables.

### CHAPTER 14 MORE ABOUT REGRESSION

CHAPTER 14 MORE ABOUT REGRESSION We learned n Chapter 5 that often a straght lne descrbes the pattern of a relatonshp between two quanttatve varables. For nstance, n Example 5.1 we explored the relatonshp

### x f(x) 1 0.25 1 0.75 x 1 0 1 1 0.04 0.01 0.20 1 0.12 0.03 0.60

BIVARIATE DISTRIBUTIONS Let be a varable that assumes the values { 1,,..., n }. Then, a functon that epresses the relatve frequenc of these values s called a unvarate frequenc functon. It must be true

### SIMPLE LINEAR CORRELATION

SIMPLE LINEAR CORRELATION Smple lnear correlaton s a measure of the degree to whch two varables vary together, or a measure of the ntensty of the assocaton between two varables. Correlaton often s abused.

### PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 12

14 The Ch-squared dstrbuton PSYCHOLOGICAL RESEARCH (PYC 304-C) Lecture 1 If a normal varable X, havng mean µ and varance σ, s standardsed, the new varable Z has a mean 0 and varance 1. When ths standardsed

### Introduction to Regression

Introducton to Regresson Regresson a means of predctng a dependent varable based one or more ndependent varables. -Ths s done by fttng a lne or surface to the data ponts that mnmzes the total error. -

### 1. Measuring association using correlation and regression

How to measure assocaton I: Correlaton. 1. Measurng assocaton usng correlaton and regresson We often would lke to know how one varable, such as a mother's weght, s related to another varable, such as a

### Questions that we may have about the variables

Antono Olmos, 01 Multple Regresson Problem: we want to determne the effect of Desre for control, Famly support, Number of frends, and Score on the BDI test on Perceved Support of Latno women. Dependent

### HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION

HYPOTHESIS TESTING OF PARAMETERS FOR ORDINARY LINEAR CIRCULAR REGRESSION Abdul Ghapor Hussn Centre for Foundaton Studes n Scence Unversty of Malaya 563 KUALA LUMPUR E-mal: ghapor@umedumy Abstract Ths paper

### ErrorPropagation.nb 1. Error Propagation

ErrorPropagaton.nb Error Propagaton Suppose that we make observatons of a quantty x that s subject to random fluctuatons or measurement errors. Our best estmate of the true value for ths quantty s then

### CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES

CHAPTER 5 RELATIONSHIPS BETWEEN QUANTITATIVE VARIABLES In ths chapter, we wll learn how to descrbe the relatonshp between two quanttatve varables. Remember (from Chapter 2) that the terms quanttatve varable

### STATISTICAL DATA ANALYSIS IN EXCEL

Mcroarray Center STATISTICAL DATA ANALYSIS IN EXCEL Lecture 6 Some Advanced Topcs Dr. Petr Nazarov 14-01-013 petr.nazarov@crp-sante.lu Statstcal data analyss n Ecel. 6. Some advanced topcs Correcton for

### Economic Interpretation of Regression. Theory and Applications

Economc Interpretaton of Regresson Theor and Applcatons Classcal and Baesan Econometrc Methods Applcaton of mathematcal statstcs to economc data for emprcal support Economc theor postulates a qualtatve

### SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA

SIX WAYS TO SOLVE A SIMPLE PROBLEM: FITTING A STRAIGHT LINE TO MEASUREMENT DATA E. LAGENDIJK Department of Appled Physcs, Delft Unversty of Technology Lorentzweg 1, 68 CJ, The Netherlands E-mal: e.lagendjk@tnw.tudelft.nl

### The Analysis of Covariance. ERSH 8310 Keppel and Wickens Chapter 15

The Analyss of Covarance ERSH 830 Keppel and Wckens Chapter 5 Today s Class Intal Consderatons Covarance and Lnear Regresson The Lnear Regresson Equaton TheAnalyss of Covarance Assumptons Underlyng the

### 2.4 Bivariate distributions

page 28 2.4 Bvarate dstrbutons 2.4.1 Defntons Let X and Y be dscrete r.v.s defned on the same probablty space (S, F, P). Instead of treatng them separately, t s often necessary to thnk of them actng together

### CHAPTER 7 THE TWO-VARIABLE REGRESSION MODEL: HYPOTHESIS TESTING

CHAPTER 7 THE TWO-VARIABLE REGRESSION MODEL: HYPOTHESIS TESTING QUESTIONS 7.1. (a) In the regresson contet, the method of least squares estmates the regresson parameters n such a way that the sum of the

### benefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).

REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or

### Linear Circuits Analysis. Superposition, Thevenin /Norton Equivalent circuits

Lnear Crcuts Analyss. Superposton, Theenn /Norton Equalent crcuts So far we hae explored tmendependent (resste) elements that are also lnear. A tmendependent elements s one for whch we can plot an / cure.

### The Analysis of Outliers in Statistical Data

THALES Project No. xxxx The Analyss of Outlers n Statstcal Data Research Team Chrysses Caron, Assocate Professor (P.I.) Vaslk Karot, Doctoral canddate Polychrons Economou, Chrstna Perrakou, Postgraduate

### Regression Models for a Binary Response Using EXCEL and JMP

SEMATECH 997 Statstcal Methods Symposum Austn Regresson Models for a Bnary Response Usng EXCEL and JMP Davd C. Trndade, Ph.D. STAT-TECH Consultng and Tranng n Appled Statstcs San Jose, CA Topcs Practcal

### PRACTICE 1: MUTUAL FUNDS EVALUATION USING MATLAB.

PRACTICE 1: MUTUAL FUNDS EVALUATION USING MATLAB. INDEX 1. Load data usng the Edtor wndow and m-fle 2. Learnng to save results from the Edtor wndow. 3. Computng the Sharpe Rato 4. Obtanng the Treynor Rato

### Linear Regression Analysis for STARDEX

Lnear Regresson Analss for STARDEX Malcolm Halock, Clmatc Research Unt The followng document s an overvew of lnear regresson methods for reference b members of STARDEX. Whle t ams to cover the most common

### Analysis of Covariance

Chapter 551 Analyss of Covarance Introducton A common tas n research s to compare the averages of two or more populatons (groups). We mght want to compare the ncome level of two regons, the ntrogen content

### 9.1 The Cumulative Sum Control Chart

Learnng Objectves 9.1 The Cumulatve Sum Control Chart 9.1.1 Basc Prncples: Cusum Control Chart for Montorng the Process Mean If s the target for the process mean, then the cumulatve sum control chart s

### An Analysis of Factors Influencing the Self-Rated Health of Elderly Chinese People

Open Journal of Socal Scences, 205, 3, 5-20 Publshed Onlne May 205 n ScRes. http://www.scrp.org/ournal/ss http://dx.do.org/0.4236/ss.205.35003 An Analyss of Factors Influencng the Self-Rated Health of

### Lecture 10: Linear Regression Approach, Assumptions and Diagnostics

Approach to Modelng I Lecture 1: Lnear Regresson Approach, Assumptons and Dagnostcs Sandy Eckel seckel@jhsph.edu 8 May 8 General approach for most statstcal modelng: Defne the populaton of nterest State

### The Probit Model. Alexander Spermann. SoSe 2009

The Probt Model Aleander Spermann Unversty of Freburg SoSe 009 Course outlne. Notaton and statstcal foundatons. Introducton to the Probt model 3. Applcaton 4. Coeffcents and margnal effects 5. Goodness-of-ft

### Communication Networks II Contents

8 / 1 -- Communcaton Networs II (Görg) -- www.comnets.un-bremen.de Communcaton Networs II Contents 1 Fundamentals of probablty theory 2 Traffc n communcaton networs 3 Stochastc & Marovan Processes (SP

### Inequality and The Accounting Period. Quentin Wodon and Shlomo Yitzhaki. World Bank and Hebrew University. September 2001.

Inequalty and The Accountng Perod Quentn Wodon and Shlomo Ytzha World Ban and Hebrew Unversty September Abstract Income nequalty typcally declnes wth the length of tme taen nto account for measurement.

### H 1 : at least one is not zero

Chapter 6 More Multple Regresson Model The F-test Jont Hypothess Tests Consder the lnear regresson equaton: () y = β + βx + βx + β4x4 + e for =,,..., N The t-statstc gve a test of sgnfcance of an ndvdual

### greatest common divisor

4. GCD 1 The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no

### Graph Theory and Cayley s Formula

Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll

### Time Series Analysis in Studies of AGN Variability. Bradley M. Peterson The Ohio State University

Tme Seres Analyss n Studes of AGN Varablty Bradley M. Peterson The Oho State Unversty 1 Lnear Correlaton Degree to whch two parameters are lnearly correlated can be expressed n terms of the lnear correlaton

### State function: eigenfunctions of hermitian operators-> normalization, orthogonality completeness

Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators-> normalzaton, orthogonalty completeness egenvalues and

### Nonlinear data mapping by neural networks

Nonlnear data mappng by neural networks R.P.W. Dun Delft Unversty of Technology, Netherlands Abstract A revew s gven of the use of neural networks for nonlnear mappng of hgh dmensonal data on lower dmensonal

### Quantization Effects in Digital Filters

Quantzaton Effects n Dgtal Flters Dstrbuton of Truncaton Errors In two's complement representaton an exact number would have nfntely many bts (n general). When we lmt the number of bts to some fnte value

### Linear Regression, Regularization Bias-Variance Tradeoff

HTF: Ch3, 7 B: Ch3 Lnear Regresson, Regularzaton Bas-Varance Tradeoff Thanks to C Guestrn, T Detterch, R Parr, N Ray 1 Outlne Lnear Regresson MLE = Least Squares! Bass functons Evaluatng Predctors Tranng

### Portfolio Loss Distribution

Portfolo Loss Dstrbuton Rsky assets n loan ortfolo hghly llqud assets hold-to-maturty n the bank s balance sheet Outstandngs The orton of the bank asset that has already been extended to borrowers. Commtment

### Chapter 15 Multiple Regression

Chapter 5 Multple Regresson In chapter 9, we consdered one dependent varable (Y) and one predctor (regressor or ndependent varable) (X) and predcted Y based on X only, whch also known as the smple lnear

### THE DISTRIBUTION OF LOAN PORTFOLIO VALUE * Oldrich Alfons Vasicek

HE DISRIBUION OF LOAN PORFOLIO VALUE * Oldrch Alfons Vascek he amount of captal necessary to support a portfolo of debt securtes depends on the probablty dstrbuton of the portfolo loss. Consder a portfolo

### Can Auto Liability Insurance Purchases Signal Risk Attitude?

Internatonal Journal of Busness and Economcs, 2011, Vol. 10, No. 2, 159-164 Can Auto Lablty Insurance Purchases Sgnal Rsk Atttude? Chu-Shu L Department of Internatonal Busness, Asa Unversty, Tawan Sheng-Chang

### NPAR TESTS. One-Sample Chi-Square Test. Cell Specification. Observed Frequencies 1O i 6. Expected Frequencies 1EXP i 6

PAR TESTS If a WEIGHT varable s specfed, t s used to replcate a case as many tmes as ndcated by the weght value rounded to the nearest nteger. If the workspace requrements are exceeded and samplng has

### n + d + q = 24 and.05n +.1d +.25q = 2 { n + d + q = 24 (3) n + 2d + 5q = 40 (2)

MATH 16T Exam 1 : Part I (In-Class) Solutons 1. (0 pts) A pggy bank contans 4 cons, all of whch are nckels (5 ), dmes (10 ) or quarters (5 ). The pggy bank also contans a con of each denomnaton. The total

### 1 Example 1: Axis-aligned rectangles

COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton

### Recurrence. 1 Definitions and main statements

Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.

### Logistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification

Lecture 4: More classfers and classes C4B Machne Learnng Hlary 20 A. Zsserman Logstc regresson Loss functons revsted Adaboost Loss functons revsted Optmzaton Multple class classfcaton Logstc Regresson

### I. SCOPE, APPLICABILITY AND PARAMETERS Scope

D Executve Board Annex 9 Page A/R ethodologcal Tool alculaton of the number of sample plots for measurements wthn A/R D project actvtes (Verson 0) I. SOPE, PIABIITY AD PARAETERS Scope. Ths tool s applcable

### Descriptive Statistics (60 points)

Economcs 30330: Statstcs for Economcs Problem Set 2 Unversty of otre Dame Instructor: Julo Garín Sprng 2012 Descrptve Statstcs (60 ponts) 1. Followng a recent government shutdown, Mnnesota Governor Mark

### 1 De nitions and Censoring

De ntons and Censorng. Survval Analyss We begn by consderng smple analyses but we wll lead up to and take a look at regresson on explanatory factors., as n lnear regresson part A. The mportant d erence

### Calibration and Linear Regression Analysis: A Self-Guided Tutorial

Calbraton and Lnear Regresson Analyss: A Self-Guded Tutoral Part The Calbraton Curve, Correlaton Coeffcent and Confdence Lmts CHM314 Instrumental Analyss Department of Chemstry, Unversty of Toronto Dr.

### The OC Curve of Attribute Acceptance Plans

The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4

### 8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by

6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng

### Exhaustive Regression. An Exploration of Regression-Based Data Mining Techniques Using Super Computation

Exhaustve Regresson An Exploraton of Regresson-Based Data Mnng Technques Usng Super Computaton Antony Daves, Ph.D. Assocate Professor of Economcs Duquesne Unversty Pttsburgh, PA 58 Research Fellow The

### Online Appendix for Forecasting the Equity Risk Premium: The Role of Technical Indicators

Onlne Appendx for Forecastng the Equty Rsk Premum: The Role of Techncal Indcators Chrstopher J. Neely Federal Reserve Bank of St. Lous neely@stls.frb.org Davd E. Rapach Sant Lous Unversty rapachde@slu.edu

### + + + - - This circuit than can be reduced to a planar circuit

MeshCurrent Method The meshcurrent s analog of the nodeoltage method. We sole for a new set of arables, mesh currents, that automatcally satsfy KCLs. As such, meshcurrent method reduces crcut soluton to

### Lesson 2 Chapter Two Three Phase Uncontrolled Rectifier

Lesson 2 Chapter Two Three Phase Uncontrolled Rectfer. Operatng prncple of three phase half wave uncontrolled rectfer The half wave uncontrolled converter s the smplest of all three phase rectfer topologes.

### What is Candidate Sampling

What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble

### Introduction: Analysis of Electronic Circuits

/30/008 ntroducton / ntroducton: Analyss of Electronc Crcuts Readng Assgnment: KVL and KCL text from EECS Just lke EECS, the majorty of problems (hw and exam) n EECS 3 wll be crcut analyss problems. Thus,

### CHOLESTEROL REFERENCE METHOD LABORATORY NETWORK. Sample Stability Protocol

CHOLESTEROL REFERENCE METHOD LABORATORY NETWORK Sample Stablty Protocol Background The Cholesterol Reference Method Laboratory Network (CRMLN) developed certfcaton protocols for total cholesterol, HDL

### Multivariate EWMA Control Chart

Multvarate EWMA Control Chart Summary The Multvarate EWMA Control Chart procedure creates control charts for two or more numerc varables. Examnng the varables n a multvarate sense s extremely mportant

### BERNSTEIN POLYNOMIALS

On-Lne Geometrc Modelng Notes BERNSTEIN POLYNOMIALS Kenneth I. Joy Vsualzaton and Graphcs Research Group Department of Computer Scence Unversty of Calforna, Davs Overvew Polynomals are ncredbly useful

### QUANTUM MECHANICS, BRAS AND KETS

PH575 SPRING QUANTUM MECHANICS, BRAS AND KETS The followng summares the man relatons and defntons from quantum mechancs that we wll be usng. State of a phscal sstem: The state of a phscal sstem s represented

### Study on CET4 Marks in China s Graded English Teaching

Study on CET4 Marks n Chna s Graded Englsh Teachng CHE We College of Foregn Studes, Shandong Insttute of Busness and Technology, P.R.Chna, 264005 Abstract: Ths paper deploys Logt model, and decomposes

### Chapter 7. Random-Variate Generation 7.1. Prof. Dr. Mesut Güneş Ch. 7 Random-Variate Generation

Chapter 7 Random-Varate Generaton 7. Contents Inverse-transform Technque Acceptance-Rejecton Technque Specal Propertes 7. Purpose & Overvew Develop understandng of generatng samples from a specfed dstrbuton

### A Probabilistic Theory of Coherence

A Probablstc Theory of Coherence BRANDEN FITELSON. The Coherence Measure C Let E be a set of n propostons E,..., E n. We seek a probablstc measure C(E) of the degree of coherence of E. Intutvely, we want

### Nasdaq Iceland Bond Indices 01 April 2015

Nasdaq Iceland Bond Indces 01 Aprl 2015 -Fxed duraton Indces Introducton Nasdaq Iceland (the Exchange) began calculatng ts current bond ndces n the begnnng of 2005. They were a response to recent changes

### Formula of Total Probability, Bayes Rule, and Applications

1 Formula of Total Probablty, Bayes Rule, and Applcatons Recall that for any event A, the par of events A and A has an ntersecton that s empty, whereas the unon A A represents the total populaton of nterest.

### Lecture 14: Implementing CAPM

Lecture 14: Implementng CAPM Queston: So, how do I apply the CAPM? Current readng: Brealey and Myers, Chapter 9 Reader, Chapter 15 M. Spegel and R. Stanton, 2000 1 Key Results So Far All nvestors should

### Latent Class Regression. Statistics for Psychosocial Research II: Structural Models December 4 and 6, 2006

Latent Class Regresson Statstcs for Psychosocal Research II: Structural Models December 4 and 6, 2006 Latent Class Regresson (LCR) What s t and when do we use t? Recall the standard latent class model

### Passive Filters. References: Barbow (pp 265-275), Hayes & Horowitz (pp 32-60), Rizzoni (Chap. 6)

Passve Flters eferences: Barbow (pp 6575), Hayes & Horowtz (pp 360), zzon (Chap. 6) Frequencyselectve or flter crcuts pass to the output only those nput sgnals that are n a desred range of frequences (called

### L10: Linear discriminants analysis

L0: Lnear dscrmnants analyss Lnear dscrmnant analyss, two classes Lnear dscrmnant analyss, C classes LDA vs. PCA Lmtatons of LDA Varants of LDA Other dmensonalty reducton methods CSCE 666 Pattern Analyss

### Capital asset pricing model, arbitrage pricing theory and portfolio management

Captal asset prcng model, arbtrage prcng theory and portfolo management Vnod Kothar The captal asset prcng model (CAPM) s great n terms of ts understandng of rsk decomposton of rsk nto securty-specfc rsk

### LOOP ANALYSIS. The second systematic technique to determine all currents and voltages in a circuit

LOOP ANALYSS The second systematic technique to determine all currents and voltages in a circuit T S DUAL TO NODE ANALYSS - T FRST DETERMNES ALL CURRENTS N A CRCUT AND THEN T USES OHM S LAW TO COMPUTE

### The Classical Model. Gauss-Markov Theorem, Specification, Endogeneity

The Classcal Model Gauss-Markov Theorem, Specfcaton, Endogenety Propertes of Least Squares Estmators Here s the model: Y = β + β + β + β + L+ β + ε 0 For the case wth regressor and constant, I showed some

### MULTIPLE LINEAR REGRESSION IN MINITAB

MULTIPLE LINEAR REGRESSION IN MINITAB Ths document shows a complcated Mntab multple regresson. It ncludes descrptons of the Mntab commands, and the Mntab output s heavly annotated. Comments n { } are used

### The Magnetic Field. Concepts and Principles. Moving Charges. Permanent Magnets

. The Magnetc Feld Concepts and Prncples Movng Charges All charged partcles create electrc felds, and these felds can be detected by other charged partcles resultng n electrc force. However, a completely

### Module 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur

Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..

### Texas Instruments 30X IIS Calculator

Texas Instruments 30X IIS Calculator Keystrokes for the TI-30X IIS are shown for a few topcs n whch keystrokes are unque. Start by readng the Quk Start secton. Then, before begnnng a specfc unt of the

### How Sets of Coherent Probabilities May Serve as Models for Degrees of Incoherence

1 st Internatonal Symposum on Imprecse Probabltes and Ther Applcatons, Ghent, Belgum, 29 June 2 July 1999 How Sets of Coherent Probabltes May Serve as Models for Degrees of Incoherence Mar J. Schervsh

### A statistical approach to determine Microbiologically Influenced Corrosion (MIC) Rates of underground gas pipelines.

A statstcal approach to determne Mcrobologcally Influenced Corroson (MIC) Rates of underground gas ppelnes. by Lech A. Grzelak A thess submtted to the Delft Unversty of Technology n conformty wth the requrements

### Testing GOF & Estimating Overdispersion

Testng GOF & Estmatng Overdsperson Your Most General Model Needs to Ft the Dataset It s mportant that the most general (complcated) model n your canddate model lst fts the data well. Ths model s a benchmark

### Forecasting the Direction and Strength of Stock Market Movement

Forecastng the Drecton and Strength of Stock Market Movement Jngwe Chen Mng Chen Nan Ye cjngwe@stanford.edu mchen5@stanford.edu nanye@stanford.edu Abstract - Stock market s one of the most complcated systems

### Semiconductor sensors of temperature

Semconductor sensors of temperature he measurement objectve 1. Identfy the unknown bead type thermstor. Desgn the crcutry for lnearzaton of ts transfer curve.. Fnd the dependence of forward voltage drop

### Finite Math Chapter 10: Study Guide and Solution to Problems

Fnte Math Chapter 10: Study Gude and Soluton to Problems Basc Formulas and Concepts 10.1 Interest Basc Concepts Interest A fee a bank pays you for money you depost nto a savngs account. Prncpal P The amount

### The Choice of Direct Dealing or Electronic Brokerage in Foreign Exchange Trading

The Choce of Drect Dealng or Electronc Brokerage n Foregn Exchange Tradng Mchael Melvn & Ln Wen Arzona State Unversty Introducton Electronc Brokerage n Foregn Exchange Start from a base of zero n 1992

### General Iteration Algorithm for Classification Ratemaking

General Iteraton Algorthm for Classfcaton Ratemakng by Luyang Fu and Cheng-sheng eter Wu ABSTRACT In ths study, we propose a flexble and comprehensve teraton algorthm called general teraton algorthm (GIA)

### We are now ready to answer the question: What are the possible cardinalities for finite fields?

Chapter 3 Fnte felds We have seen, n the prevous chapters, some examples of fnte felds. For example, the resdue class rng Z/pZ (when p s a prme) forms a feld wth p elements whch may be dentfed wth the

### Simon Acomb NAG Financial Mathematics Day

1 Why People Who Prce Dervatves Are Interested In Correlaton mon Acomb NAG Fnancal Mathematcs Day Correlaton Rsk What Is Correlaton No lnear relatonshp between ponts Co-movement between the ponts Postve

### Estimation of Dispersion Parameters in GLMs with and without Random Effects

Mathematcal Statstcs Stockholm Unversty Estmaton of Dsperson Parameters n GLMs wth and wthout Random Effects Meng Ruoyan Examensarbete 2004:5 Postal address: Mathematcal Statstcs Dept. of Mathematcs Stockholm

Summary of Analyss of Premum Labltes for Australan Lnes of Busness Emly Tao Honours Research Paper, The Unversty of Melbourne Emly Tao Acknowledgements I am grateful to the Australan Prudental Regulaton

### Lecture 3: Force of Interest, Real Interest Rate, Annuity

Lecture 3: Force of Interest, Real Interest Rate, Annuty Goals: Study contnuous compoundng and force of nterest Dscuss real nterest rate Learn annuty-mmedate, and ts present value Study annuty-due, and

### Efficient Project Portfolio as a tool for Enterprise Risk Management

Effcent Proect Portfolo as a tool for Enterprse Rsk Management Valentn O. Nkonov Ural State Techncal Unversty Growth Traectory Consultng Company January 5, 27 Effcent Proect Portfolo as a tool for Enterprse

### SIGNIFICANT FIGURES (4SF) (4SF) (5SF) (3 SF) 62.4 (3 SF) x 10 4 (5 SF) Figure 0

SIGIFICAT FIGURES Wth any calbrated nstrument, there s a lmt to the number of fgures that can be relably kept n the answer. For dgtal nstruments, the lmtaton s the number of fgures appearng n the dsplay.

### Covariance & Correlation

Covarance & Correlaton The covarance between two varables s defned by: cov x,y= x x y y =xyxy Ths s the most useful thng they never tell you n most lab courses! Note that cov(x,x)=v(x). The correlaton

### total A A reag total A A r eag

hapter 5 Standardzng nalytcal Methods hapter Overvew 5 nalytcal Standards 5B albratng the Sgnal (S total ) 5 Determnng the Senstvty (k ) 5D Lnear Regresson and albraton urves 5E ompensatng for the Reagent