Chapter 6 Best Linear Unbiased Estimate (BLUE)



Similar documents
Basically, logarithmic transformations ask, a number, to what power equals another number?

Solution to Problem Set 1

Optimal Pricing Scheme for Information Services

Use Geometry Expressions to create a more complex locus of points. Find evidence for equivalence using Geometry Expressions.

Vectors Recap of vectors

Goals Rotational quantities as vectors. Math: Cross Product. Angular momentum

Chapter 7 Kinetic energy and work

Newton-Raphson Method of Solving a Nonlinear Equation Autar Kaw

9 CONTINUOUS DISTRIBUTIONS

Graphs on Logarithmic and Semilogarithmic Paper

Treatment Spring Late Summer Fall Mean = 1.33 Mean = 4.88 Mean = 3.

9.3. The Scalar Product. Introduction. Prerequisites. Learning Outcomes

Lecture 3 Gaussian Probability Distribution

Resistive Network Analysis. The Node Voltage Method - 1

Binary Representation of Numbers Autar Kaw

Bayesian Updating with Continuous Priors Class 13, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom

and thus, they are similar. If k = 3 then the Jordan form of both matrices is

LINEAR TRANSFORMATIONS AND THEIR REPRESENTING MATRICES

Figure 1. Inventory Level vs. Time - EOQ Problem

Example 27.1 Draw a Venn diagram to show the relationship between counting numbers, whole numbers, integers, and rational numbers.

PROF. BOYAN KOSTADINOV NEW YORK CITY COLLEGE OF TECHNOLOGY, CUNY

A.7.1 Trigonometric interpretation of dot product A.7.2 Geometric interpretation of dot product

16. Mean Square Estimation

Algebra Review. How well do you remember your algebra?

Alternatives to an Inefficient International Telephony. Settlement System

4.11 Inner Product Spaces

Review guide for the final exam in Math 233

Ring structure of splines on triangulations

Lectures 8 and 9 1 Rectangular waveguides

MODULE 3. 0, y = 0 for all y

benefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).

Math 135 Circles and Completing the Square Examples

Irregular Repeat Accumulate Codes 1

Logistic Regression. Lecture 4: More classifiers and classes. Logistic regression. Adaboost. Optimization. Multiple class classification

Lecture 5. Inner Product

WHAT HAPPENS WHEN YOU MIX COMPLEX NUMBERS WITH PRIME NUMBERS?

8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by

Brillouin Zones. Physics 3P41 Chris Wiebe

How To Understand The Recipe Notes Of A Recipe Card

LECTURE #05. Learning Objective. To describe the geometry in and around a unit cell in terms of directions and planes.

The Velocity Factor of an Insulated Two-Wire Transmission Line

JFET AMPLIFIER CONFIGURATIONS

N V V L. R a L I. Transformer Equation Notes

Physics 43 Homework Set 9 Chapter 40 Key

NMT EE 589 & UNM ME 482/582 ROBOT ENGINEERING. Dr. Stephen Bruder NMT EE 589 & UNM ME 482/582

Chapter System of Equations

Vector Geometry for Computer Graphics

Problem Set 3. a) We are asked how people will react, if the interest rate i on bonds is negative.

Polynomial Functions. Polynomial functions in one variable can be written in expanded form as ( )

Chapter 4 ECONOMIC DISPATCH AND UNIT COMMITMENT

Example A rectangular box without lid is to be made from a square cardboard of sides 18 cm by cutting equal squares from each corner and then folding

Integration by Substitution

Lecture 2: Single Layer Perceptrons Kevin Swingler

Physics 2102 Lecture 2. Physics 2102

Section 5.4 Annuities, Present Value, and Amortization

Distributions. (corresponding to the cumulative distribution function for the discrete case).

Cypress Creek High School IB Physics SL/AP Physics B MP2 Test 1 Newton s Laws. Name: SOLUTIONS Date: Period:

ACUSCOMP and ACUSYS A powerful hybrid linear/non linear simulation suite to analyse pressure pulsations in piping

Rotation Kinematics, Moment of Inertia, and Torque

Experiment 6: Friction

Mathematics. Vectors. hsn.uk.net. Higher. Contents. Vectors 128 HSN23100

s-domain Circuit Analysis

RIGHT TRIANGLES AND THE PYTHAGOREAN TRIPLETS


EQUATIONS OF LINES AND PLANES

3. Present value of Annuity Problems

Regular Sets and Expressions

ALABAMA ASSOCIATION of EMERGENCY MANAGERS

Lesson 4.1 Triangle Sum Conjecture

SIMPLE LINEAR CORRELATION

Words Symbols Diagram. abcde. a + b + c + d + e

Answer: A). There is a flatter IS curve in the high MPC economy. Original LM LM after increase in M. IS curve for low MPC economy

Luby s Alg. for Maximal Independent Sets using Pairwise Independence

v a 1 b 1 i, a 2 b 2 i,..., a n b n i.

Rotating DC Motors Part II

Support Vector Machines

COMPONENTS: COMBINED LOADING

Babylonian Method of Computing the Square Root: Justifications Based on Fuzzy Techniques and on Computational Complexity

QUADRATURE METHODS. July 19, Kenneth L. Judd. Hoover Institution

Lesson 2.1 Inductive Reasoning

Causal, Explanatory Forecasting. Analysis. Regression Analysis. Simple Linear Regression. Which is Independent? Forecasting

Series Solutions of ODEs 2 the Frobenius method. The basic idea of the Frobenius method is to look for solutions of the form 3

Trivial lump sum R5.0

1 Example 1: Axis-aligned rectangles

Homework 3 Solutions

Formulating & Solving Integer Problems Chapter

5.2. LINE INTEGRALS 265. Let us quickly review the kind of integrals we have studied so far before we introduce a new one.

STATISTICAL PROPERTIES OF LEAST SQUARES ESTIMATORS. x, where. = y - ˆ " 1

c b N/m 2 (0.120 m m 3 ), = J. W total = W a b + W b c 2.00

Exact Confidence Intervals

1. Measuring association using correlation and regression

Chapter 7: Answers to Questions and Problems

Production. 2. Y is closed A set is closed if it contains its boundary. We need this for the solution existence in the profit maximization problem.

Factoring Polynomials

CS 2750 Machine Learning. Lecture 3. Density estimation. CS 2750 Machine Learning. Announcements

Calculation of Sampling Weights

Transcription:

hpter 6 Bet Lner Unbed Etmte BLUE

Motvton for BLUE Except for Lner Model ce, the optml MVU etmtor mght:. not even ext. be dffcult or mpoble to fnd Reort to ub-optml etmte BLUE one uch ub-optml etmte Ide for BLUE:. Retrct etmte to be lner n dt x. Retrct etmte to be unbed 3. Fnd the bet one.e. wth mnmum vrnce dvntge of BLUE:eed only t nd nd moment of PDF Ddvntge of BLUE:. Sub-optml n generl. Sometme totlly npproprte ee bottom of p. 34 Men & ovrnce

6.3 Defnton of BLUE clr ce Oberved Dt: x [x[0] x[]... x[ ] ] PDF: px;θ depend on unknown θ BLUE contrned to be lner n dt: hooe to gve: θˆ BLU nx[ n] x n0. unbed etmtor. then mnmze vrnce Vrnce Lner Unbed Etmtor BLUE onlner Unbed Etmtor MVUE ote: h not Fg. 6. 3

6.4 Fndng he BLUE Sclr e. ontrn to be Lner: ˆ θ n 0 n x[ n]. ontrn to be Unbed: E { θˆ} θ Ung lner contrnt n 0 n E { x[ n ]} θ Q: When cn we meet both of thee contrnt? : Only for certn obervton model e.g., lner obervton 4

Fndng BLUE for Sclr Lner Obervton onder clr-prmeter lner obervton: x[n] θ[n] + w[n] E{x[n]} θ[n] hen for the unbed condton we need: ell how to chooe weght to ue n the BLUE etmtor form { ˆ} E θ θ n ow gven tht thee contrnt re met We need to mnmze the vrnce!! 0 eed ˆ θ n n[ n] θ #"! 0 n x[ n] Gven tht the covrnce mtrx of x we hve: vr θˆ { } { } vr x BLU Lke vr{x} vr{x} 5

6 Gol: mnmze ubject to ontrned optmzton ppendx 6: Ue Lgrngn Multpler: Mnmze J + λ 0 : Set J λ λ λ $ #$"$! ˆ vr θ x x ˆ θ BLUE ppendx 6 how tht th cheve globl mnmum

pplcblty of BLUE We jut derved the BLUE under the followng:. Lner obervton but wth no contrnt on the noe PDF. o knowledge of the noe PDF other thn t men nd cov!! Wht doe th tell u??? BLUE pplcble to lner obervton But noe need not be Gun!!! w umed n h. 4 Lner Model nd ll we need re the t nd nd moment of the PDF!!! But we ll ee n the Exmple tht we cn often lnerze nonlner model!!! 7

6.5 Vector Prmeter e: Gu-Mrkov hm Gu-Mrkov heorem: If dt cn be modeled hvng lner obervton n noe: x Hθ + w Known Mtrx Known Men & ov PDF otherwe rbtrry & unknown ˆ hen the BLUE : θ H H H x BLUE nd t covrnce : θ ˆ H H ote: If noe Gun then BLUE MVUE 8

Ex. 4.3: DO-Bed Emtter Locton t x @ x,y t t Rx x,y t t Rx t t 3 x,y Rx 3 x 3,y 3 Hyperbol: τ t t contnt Hyperbol: τ 3 t 3 t contnt DO me-dfference-of-rrvl ume tht the th Rx cn meure t O: t hen from the et of O compute DO hen from the et of DO etmte locton x,y We won t worry bout how they do tht. lo there re DO ytem tht never ctully etmte O! 9

O Meurement Model ume meurement of O t recever only 3 hown bove: t 0, t,,t - here re meurement error O meurement model: o me the gnl emtted R Rnge from x to Rx c Speed of Propgton for EM: c 3x0 8 m/ t o + R /c + 0,,..., - Meurement oe zero-men, vrnce σ, ndependent but PDF unknown vrnce determned from etmtor ued to etmte t ow ue: R [ x x + y - y ] / t f x, y o + c x x + y y + onlner Model 0

Lnerzton of O Model So we lnerze the model o we cn pply BLUE: ume ome rough etmte vlble x n, y n x x n + δx y y n + δy know etmte know etmte θ [δx δy] ow ue truncted ylor ere to lnerze R x n, y n : R Known R n + xn x δx Rn # $"$! + yn y δy Rn # $"$! B ~ Rn B pply to O: t t o + δ x + δy + c c c known known known hree unknown prmeter to etmte: o, δy, δy

O Model v. DO Model wo opton now:. Ue O to etmte 3 prmeter: o, δy, δy. Ue DO to etmte prmeter: δy, δy Generlly the fewer prmeter the better Everythng ele beng the me. But here everythng ele not the me: Opton & hve dfferent noe model Opton h ndependent noe Opton h correlted noe In prctce we d explore both opton nd ee whch bet.

3 onveron to DO Model DO rther thn O DO:,,,, ~ ~ t t τ $"$! # #$"$! $"$! # noe correlted known known + + y c B B x c δ δ In mtrx form: x Hθ + w w H 0 0 0 B B B B B B c & & & & & & & [ ] τ τ τ ' x [ ] y δx δ θ See book for tructure of mtrx w w } cov{ σ

pply BLUE to DO Lnerzed Model θˆ BLUE H H w H w x θˆ H H w H Dependence on σ cncel out!!! H H x σ H Decrbe how lrge the locton error H hng we cn now do:. Explore etmton error cov for dfferent x/rx geometre Plot error ellpe. nlytclly explore mple geometre to fnd trend See next chrt more detl n book 4

pply DO Reult to Smple Geometry x R R x α R x α R x3 d d hen cn how: θˆ σ c co 0 α 0 3/ nα Dgonl Error ov lgned Error Ellpe e y nd y-error lwy bgger thn x-error e x 5

σ x /cσ or σ y /cσ 0 3 0 0 0 0 σ x σ y 0-0 0 0 30 40 50 60 70 80 90 α degre e Ued Std. Dev. to how unt of X & Y ormlzed by cσ get ctul vlue by multplyng by your pecfc cσ vlue x R R x α R x α R x3 d d For Fxed Rnge R: Increng Rx Spcng d Improve ccurcy For Fxed Spcng d: Decreng Rnge R Improve ccurcy 6