ECE302 Spring 2006 HW7 Solutions March 11, 2006 1

Similar documents
ECE302 Spring 2006 HW5 Solutions February 21,

ECE302 Spring 2006 HW3 Solutions February 2,

Covariance and Correlation

Statistics 100A Homework 7 Solutions

ECE302 Spring 2006 HW4 Solutions February 6,

Math 431 An Introduction to Probability. Final Exam Solutions

SF2940: Probability theory Lecture 8: Multivariate Normal Distribution

SF2940: Probability theory Lecture 8: Multivariate Normal Distribution

Some probability and statistics

Summary of Formulas and Concepts. Descriptive Statistics (Ch. 1-4)

Joint Exam 1/P Sample Exam 1

5. Continuous Random Variables

Lecture Notes 1. Brief Review of Basic Probability

The Bivariate Normal Distribution

Department of Mathematics, Indian Institute of Technology, Kharagpur Assignment 2-3, Probability and Statistics, March Due:-March 25, 2015.

Notes on Continuous Random Variables

For a partition B 1,..., B n, where B i B j = for i. A = (A B 1 ) (A B 2 ),..., (A B n ) and thus. P (A) = P (A B i ) = P (A B i )P (B i )

MULTIVARIATE PROBABILITY DISTRIBUTIONS

Lecture 6: Discrete & Continuous Probability and Random Variables

Feb 28 Homework Solutions Math 151, Winter Chapter 6 Problems (pages )

UNIT I: RANDOM VARIABLES PART- A -TWO MARKS

Correlation in Random Variables

6.041/6.431 Spring 2008 Quiz 2 Wednesday, April 16, 7:30-9:30 PM. SOLUTIONS

Overview of Monte Carlo Simulation, Probability Review and Introduction to Matlab

Definition: Suppose that two random variables, either continuous or discrete, X and Y have joint density

Statistics 100A Homework 8 Solutions

Section 6.1 Joint Distribution Functions

Multi-variable Calculus and Optimization

Math 370, Spring 2008 Prof. A.J. Hildebrand. Practice Test 2 Solutions

Microeconomic Theory: Basic Math Concepts

), 35% use extra unleaded gas ( A

ST 371 (IV): Discrete Random Variables

Probability and Statistics Prof. Dr. Somesh Kumar Department of Mathematics Indian Institute of Technology, Kharagpur

Chapter 4 Lecture Notes

Math 151. Rumbos Spring Solutions to Assignment #22

Examples: Joint Densities and Joint Mass Functions Example 1: X and Y are jointly continuous with joint pdf

Section 5.1 Continuous Random Variables: Introduction

e.g. arrival of a customer to a service station or breakdown of a component in some system.

Homework 4 - KEY. Jeff Brenion. June 16, Note: Many problems can be solved in more than one way; we present only a single solution here.

Probability Calculator

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 18. A Brief Introduction to Continuous Probability

December 4, 2013 MATH 171 BASIC LINEAR ALGEBRA B. KITCHENS

MATH4427 Notebook 2 Spring MATH4427 Notebook Definitions and Examples Performance Measures for Estimators...

Econometrics Simple Linear Regression

Probability Generating Functions

Autocovariance and Autocorrelation

Lecture 9: Introduction to Pattern Analysis

Lecture 3: Continuous distributions, expected value & mean, variance, the normal distribution

Math 461 Fall 2006 Test 2 Solutions

1 Portfolio mean and variance

Normal distribution. ) 2 /2σ. 2π σ

Math 241, Exam 1 Information.

Tenth Problem Assignment

Principle of Data Reduction

6.4 Normal Distribution

M2S1 Lecture Notes. G. A. Young ayoung

Section 1.1 Linear Equations: Slope and Equations of Lines

Some special discrete probability distributions

The sample space for a pair of die rolls is the set. The sample space for a random number between 0 and 1 is the interval [0, 1].

WHERE DOES THE 10% CONDITION COME FROM?

Data Mining: Algorithms and Applications Matrix Math Review

What is Statistics? Lecture 1. Introduction and probability review. Idea of parametric inference

Martingale Ideas in Elementary Probability. Lecture course Higher Mathematics College, Independent University of Moscow Spring 1996

Lesson 20. Probability and Cumulative Distribution Functions

CHAPTER 6: Continuous Uniform Distribution: 6.1. Definition: The density function of the continuous random variable X on the interval [A, B] is.

Practice problems for Homework 11 - Point Estimation

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

Math 370/408, Spring 2008 Prof. A.J. Hildebrand. Actuarial Exam Practice Problem Set 2 Solutions

1 Determinants and the Solvability of Linear Systems

Chapter 17. Orthogonal Matrices and Symmetries of Space

Math 370, Actuarial Problemsolving Spring 2008 A.J. Hildebrand. Practice Test, 1/28/2008 (with solutions)

E3: PROBABILITY AND STATISTICS lecture notes

Master s Theory Exam Spring 2006

An Introduction to Basic Statistics and Probability

Unified Lecture # 4 Vectors

Review of Fundamental Mathematics

Practice Problems for Homework #6. Normal distribution and Central Limit Theorem.

Solution to Homework 2

STA 256: Statistics and Probability I

Chapter 9. Systems of Linear Equations

Multivariate normal distribution and testing for means (see MKB Ch 3)

CONDITIONAL, PARTIAL AND RANK CORRELATION FOR THE ELLIPTICAL COPULA; DEPENDENCE MODELLING IN UNCERTAINTY ANALYSIS

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 14 10/27/2008 MOMENT GENERATING FUNCTIONS

Aggregate Loss Models

MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS

Lecture 1: Systems of Linear Equations

Lecture 7: Continuous Random Variables

4. Continuous Random Variables, the Pareto and Normal Distributions

Stats on the TI 83 and TI 84 Calculator

THREE DIMENSIONAL GEOMETRY

Financial Mathematics and Simulation MATH Spring 2011 Homework 2

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.

Probability for Estimation (review)

Introduction: Overview of Kernel Methods

IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem

Lecture 8. Confidence intervals and the central limit theorem

Linear Algebra Notes for Marsden and Tromba Vector Calculus

Polynomial Invariants

Without data, all you are is just another person with an opinion.

Transcription:

ECE32 Spring 26 HW7 Solutions March, 26 Solutions to HW7 Note: Most of these solutions were generated by R. D. Yates and D. J. Goodman, the authors of our textbook. I have added comments in italics where I thought more detail was appropriate. The solution to problem 5.8.3 is mine. Problem 4.. Random variables X and Y have the joint CDF ( e x )( e y ) x ; F X,Y (x,y) y, otherwise. (a) What is P[X 2,Y 3]? (b) What is the marginal CDF, F X (x)? (c) What is the marginal CDF, F Y (y)? Problem 4.. Solution (a) Using Definition 4. The probability P[X 2,Y 3] can be found be evaluating the joint CDF F X,Y (x,y) at x 2 and y 3. This yields P [X 2,Y 3] F X,Y (2,3) ( e 2 )( e 3 ) () (b) By Theorem 4. To find the marginal CDF of X, F X (x), we simply evaluate the joint CDF at y. F X (x) F X,Y (x, ) { e x x otherwise (2) (c) Likewise by Theorem 4. for the marginal CDF of Y, we evaluate the joint CDF at X. { e y y F Y (y) F X,Y (,y) (3) otherwise Problem 4..2 Express the following extreme values of F X,Y (x,y) in terms of the marginal cumulative distribution functions F X (x) and F Y (y). (a) F X,Y (x, ) (b) F X,Y (x, ) (c) F X,Y (, )

ECE32 Spring 26 HW7 Solutions March, 26 2 (d) F X,Y (,y) (e) F X,Y (,y) Problem 4..2 Solution (a) Because the probability that any random variable is less than is zero, we have (also by Theorem 4.d) F X,Y (x, ) P [X x,y ] P [Y ] () (b) The probability that any random variable is less than infinity is always one. See also Theorem 4..b. F X,Y (x, ) P [X x,y ] P [X x] F X (x) (2) (c) Although P[Y ], P[X ]. Therefore the following is true. (Theorem 4.b and the definition of the CDF) F X,Y (, ) P [X,Y ] P [X ] (3) (d) Part (d) follows the same logic as that of part (a). Theorem 4.d F X,Y (,y) P [X,Y y] P [X ] (4) (e) Analogous to Part (b), we find that (See also Theorem 4.c.) F X,Y (,y) P [X,Y y] P [Y y] F Y (y) (5) Problem 4.2. Random variables X and Y have the joint PMF { cxy x,2,4; y,3, P X,Y (x,y) otherwise. (a) What is the value of the constant c? (b) What is P[Y < X]? (c) What is P[Y > X]? (d) What is P[Y X]? (e) What is P[Y 3]?

ECE32 Spring 26 HW7 Solutions March, 26 3 Problem 4.2. Solution In this problem, it is helpful to label points with nonzero probability on the X,Y plane: y P X,Y (x,y) 4 3 3c 6c 2c 2 c 2c 4c x 2 3 4 (a) We must choose c so the PMF sums to one: P X,Y (x,y) c x y () x,2,4 y,3 x,2,4 y,3 c[( + 3) + 2( + 3) + 4( + 3)] 28c (2) Thus c /28. (b) The event {Y < X} has probability P [Y < X] P X,Y (x,y) x,2,4 y<x () + 2() + 4( + 3) 28 8 28 (3) (c) The event {Y > X} has probability P [Y > X] P X,Y (x,y) x,2,4 y>x (3) + 2(3) + 4() 28 9 28 (4) (d) There are two ways to solve this part. The direct way is to calculate P [Y X] P X,Y (x,y) x,2,4 yx () + 2() 28 28 (5) The indirect way is to use the previous results and the observation that P [Y X] P [Y < X] P [Y > X] ( 8/28 9/28) /28 (6) (e) P [Y 3] x,2,4 P X,Y (x,3) ()(3) + (2)(3) + (4)(3) 28 2 28 3 4 (7)

ECE32 Spring 26 HW7 Solutions March, 26 4 Problem 4.4. Random variables X and Y have the joint PDF { c x + y,x,y, f X,Y (x,y) otherwise. (a) What is the value of the constant c? (b) What is P[X Y ]? (c) What is P[X + Y /2]? Problem 4.4. Solution (a) The joint PDF of X and Y is Y Y + X { c x + y,x,y f X,Y (x,y) otherwise () X To find the constant c we integrate over the region shown. Note that we are integrating a constant over a region of area /2, so we should expect the result of the integration to be c/2. This gives Therefore c 2. x cdy dx cx cx 2 c 2 (2) (b) To find the P[X Y ] we look to integrate over the area indicated by the graph This time we re determining the probability by integrating the constant PDF over /2 the region indicated above, so we should expect the probability to be /2. Y X Y /2 x XY P [X Y ] dy dx (3) X /2 x (2 4x)dx (4) /2 (5) (c) The probability P[X + Y /2] can be seen in the figure. Here we integrate the constant PDF over /4 of the original region so we should expect the probability to be /4. Here we can set up the following integrals

ECE32 Spring 26 HW7 Solutions March, 26 5 Y Y + X Y + X ½ X P [X + Y /2] /2 /2 x /2 2dy dx (6) ( 2x)dx (7) /2 /4 /4 (8) Problem 5.. Every laptop returned to a repair center is classified according its needed repairs: () LCD screen, (2) motherboard, (3) keyboard, or (4) other. A random broken laptop needs a type i repair with probability p i 2 4 i /5. Let N i equal the number of type i broken laptops returned on a day in which four laptops are returned. (a) Find the joint PMF P N,N 2,N 3,N 4 (n,n 2,n 3,n 4 ) (b) What is the probability that two laptops require LCD repairs? (c) What is the probability that more laptops require motherboard repairs than keyboard repairs? Problem 5.. Solution The repair of each laptop can be viewed as an independent trial with four possible outcomes corresponding to the four types of needed repairs. My first question here was whether a laptop could need two repairs. I resolved this by summing the probabilities assigned to each of the individual pairs and determining that the sum was one, so there were no laptops requiring two repairs. The problem would be much more complicated if this were not the case. (a) Since the four types of repairs are mutually exclusive choices and since 4 laptops are returned for repair, the joint distribution of N,...,N 4 is the multinomial PMF ( ) 4 P N,...,N 4 (n,...,n 4 ) p n n,n 2,n 3,n pn 2 2 pn 3 3 pn 4 4 () 4 { ( 4! 8 ) n ( 4 n2 ( 2 ) n3 ( n4 n!n 2!n 3!n 4! 5 5) 5 5) n + + n 4 4;n i otherwise (2) (b) Let L 2 denote the event that exactly two laptops need LCD repairs. Thus P[L 2 ] P N (2). Since each laptop requires an LCD repair with probability p 8/5, the number of LCD repairs, N, is a binomial (4,8/5) random variable with PMF ( ) ( ) 4 P N (n ) (8/5) n (7/5) 4 n 4 (8/7) n (7/5) 4 (3) n n

ECE32 Spring 26 HW7 Solutions March, 26 6 The probability that two laptops need LCD repairs is ( ) 4 P N (2) (8/5) 2 (7/5) 2.377 (4) 2 (c) A repair is type (2) with probability p 2 4/5. A repair is type (3) with probability p 3 2/5; otherwise a repair is type other [Note that this is not the same other as the fourth type of repairs in the problem statement. This other includes both types and types 4.] with probability p o 9/5. Define X as the number of other repairs needed. The joint PMF of X,N 2,N 3 is the multinomial PMF ( )( 4 4 P N2,N 3,X (n 2,n 3,x) n 2,n 3,x 5 However, Since X + 4 N 2 N 3, we observe that ) n2 ( 2 5 ) n3 ( 9 5 ) x (5) P N2,N 3 (n 2,n 3 ) P N2,N 3,X (n 2,n 3,4 n 2 n 3 ) (6) ( )( ) 4 4 n2 ( ) 2 n3 ( ) 9 4 n2 n 3 (7) n 2,n 3,4 n 2 n 3 5 5 5 ( ) 9 4 ( )( ) 4 4 n2 ( ) 2 n3 (8) 5 n 2,n 3,4 n 2 n 3 9 9 Similarly, since each repair is a motherboard repair with probability p 2 4/5, the number of motherboard repairs has binomial PMF ( )( 4 4 P N2 (n 2 ) 5 n 2 ) n2 ( ) 4 n2 ( )( 4 4 5 n 2 ) n2 ( ) 4 (9) 5 Finally, the probability that more laptops require motherboard repairs than keyboard repairs is P [N 2 > N 3 ] P N2,N 3 (,) + P N2,N 3 (2,) + P N2,N 3 (2,) + P N2 (3) + P N2 (4) () where we use the fact that if N 2 3 or N 2 4, then we must have N 2 > N 3. Inserting the various probabilities, we obtain P [N 2 > N 3 ] P N2,N 3 (,) + P N2,N 3 (2,) + P N2,N 3 (2,) + P N2 (3) + P N2 (4) () Plugging in the various probabilities yields P[N 2 > N 3 ] 8,656/6,875.529. Problem 4.3. Given the random variables X and Y in Problem 4.2., find (a) The marginal PMFs P X (x) and P Y (y), (b) The expected values E[X] and E[Y ],

ECE32 Spring 26 HW7 Solutions March, 26 7 (c) The standard deviations σ X and σ Y. Problem 4.3. Solution On the X,Y plane, the joint PMF P X,Y (x,y) is 4 3 2 y 3c c P X,Y (x,y) 6c 2c 2c 4c 2 3 4 x By choosing c /28, the PMF sums to one. (a) The marginal PMFs of X and Y are P X (x) 4/28 x 8/28 x 2 P X,Y (x,y) 6/28 x 4 y,3 otherwise P Y (y) x,2,4 P X,Y (x,y) 7/28 y 2/28 y 3 otherwise () (2) (b) The expected values of X and Y are E [X] xp X (x) (4/28) + 2(8/28) + 4(6/28) 3 (3) x,2,4 E [Y ] y,3 (c) The second moments are E [ X 2] x,2,4 E [ Y 2] The variances are y,3 yp Y (y) 7/28 + 3(2/28) 5/2 (4) xp X (x) 2 (4/28) + 2 2 (8/28) + 4 2 (6/28) 73/7 (5) yp Y (y) 2 (7/28) + 3 2 (2/28) 7 (6) Var[X] E [ X 2] (E [X]) 2 /7 Var[Y ] E [ Y 2] (E [Y ]) 2 3/4 (7) The standard deviations are σ X /7 and σ Y 3/4.

ECE32 Spring 26 HW7 Solutions March, 26 8 Problem 4.3.3 For n,,... and k, the joint PMF of random variables N and K is P N,K (n,k) n e ( ) p k ( p) k. n! k Otherwise, P N,K (n,k). Find the marginal PMFs P N (n) and P K (k). Problem 4.3.3 Solution We recognize that the given joint PMF is written as the product of two marginal PMFs P N (n) and P K (k) where P N (n) P N,K (n,k) P K (k) k { n e n! n,,... otherwise { ( ) P N,K (n,k) k p k ( p) k k,,..., otherwise n () (2) Problem 4.5. Random variables X and Y have the joint PDF { /2 x y, f X,Y (x,y) otherwise. (a) Sketch the region of nonzero probability. (b) What is P[X > ]? (c) What is f X (x)? (d) What is E[X]? Problem 4.5. Solution (a) The joint PDF (and the corresponding region of nonzero probability) are Y X f X,Y (x,y) { /2 x y otherwise () -

ECE32 Spring 26 HW7 Solutions March, 26 9 (b) P [X > ] x x dy dx dx /4 (2) 2 2 This result can be deduced by geometry. The shaded triangle of the X, Y plane corresponding to the event X > is /4 of the total shaded area. (c) For x > or x <, f X (x). For x, f X (x) f X,Y (x,y) dy The complete expression for the marginal PDF is { ( x)/2 x, f X (x) otherwise. (d) From the marginal PDF f X (x), the expected value of X is E [X] x dy ( x)/2. (3) 2 (4) xf X (x) dx x( x)dx (5) 2 x2 4 x3 6 3. (6) Problem 5.3.2 A wireless data terminal has three messages waiting for transmission. After sending a message, it expects an acknowledgement from the receiver. When it receives the acknowledgement, it transmits the next message. If the acknowledgement does not arrive, it sends the message again. The probability of successful transmission of a message is p independent of other transmissions. Let K [ ] K K 2 K 3 be the 3-dimensional random vector in which K i is the total number of transmissions when message i is received successfully. (K 3 is the total number of transmissions used to send all three messages.) Show that P K (k) Problem 5.3.2 Solution Since J, J 2 and J 3 are independent, we can write p 3 ( p) k 3 3 k < k 2 < k 3 ; k i {,2...}, otherwise. P K (k) P J (k )P J2 (k 2 k )P J3 (k 3 k 2 ) () Since P Ji (j) > only for integers j >, we have that P K (k) > only for < k < k 2 < k 3 ; otherwise P K (k). Finally, for < k < k 2 < k 3, P K (k) ( p) k p( p) k 2 k p( p) k 3 k 2 p (2) ( p) k 3 3 p 3 (3)

ECE32 Spring 26 HW7 Solutions March, 26 I solved this differently. I first defined new random variables N, N 2, and N 3 to be the number of transmissions needed for successful receipt of message i, i {,2,3}. Then for each N i, P Ni (n i ) ( p) n i p (4) where we have no ( x y) because we know which of the transmissions is the successful one. It is the last. Now the successes or failures of the transmissions being independent, we have for n, n 2, and n 3 positive integers, P N,N 2,N 3 (n,n 2,n 3 ) ( p) n p ( p) n 2 p ( p) n 3 p ( p) n +n 2 +n 3 3 p 3 (5) so with K N, K 2 N + N 2, and K 3 N + N 2 + N 3, we have { ( p) k 3 3 p P K (k) 3 k < k 2 < k 3, integers otherwise. (6) Problem 4..2 X and Y are independent, identically distributed random variables with PMF 3/4 k, P X (k) P Y (k) /4 k 2, otherwise. Find the following quantities: Problem 4..2 Solution Using the following probability model E [X], Var[X], E [X + Y ], Var[X + Y ], E [ XY 2 XY ]. P X (k) P Y (k) We can calculate the requested moments. 3/4 k /4 k 2 otherwise E [X] 3/4 + /4 2 5 (2) Var[X] 3/4 ( 5) 2 + /4 (2 5) 2 75 (3) E [X + Y ] E [X] + E [X] 2E [X] (4) Since X and Y are independent, Theorem 4.27 yields Var[X + Y ] Var[X] + Var[Y ] 2Var[X] 5 (5) Since X and Y are independent, P X,Y (x,y) P X (x)p Y (y) and E [ XY 2 XY ] XY 2 XY P X,Y (x,y) (2)(2)2 2(2) P X (2)P Y (2) (6) x,2 y,2 () 6.46 2 (7)

ECE32 Spring 26 HW7 Solutions March, 26 Problem 4..7 X and Y are independent random variables with PDFs { f X (x) 3 e x/3 x, otherwise, { f Y (y) 2 e y/2 y, otherwise. (a) What is P[X > Y ]? (b) What is E[XY ]? (c) What is Cov[X, Y ]? Problem 4..7 Solution X and Y are independent random variables with PDFs { f X (x) 3 e x/3 x f otherwise Y (y) { 2 e y/2 y otherwise (a) To calculate P[X > Y ], we use the joint PDF f X,Y (x,y) f X (x)f Y (y). P [X > Y ] f X (x) f Y (y) dxdy (2) x>y 2 e y/2 y () 3 e x/3 dxdy (3) 2 e y/2 e y/3 dy (4) /2 2 e (/2+/3)y dy /2 + 2/3 3 7 (5) (b) Since X and Y are exponential random variables with parameters λ X /3 and λ Y /2, Appendix A tells us that E[X] /λ X 3 and E[Y ] /λ Y 2. Since X and Y are independent, the correlation is E[XY ] E[X]E[Y ] 6. (c) Since X and Y are independent, Cov[X, Y ]. Problem 5.4.2 In Problem 5.., are N,N 2,N 3,N 4 independent? Problem 5.4.2 Solution The random variables N, N 2, N 3 and N 4 are dependent. To see this we observe that P Ni (4) p 4 i. However, P N,N 2,N 3,N 4 (4,4,4,4) p 4 p 4 2p 4 3p 4 4 P N (4) P N2 (4) P N3 (4) P N4 (4). () Note that this can also be determined by calculating the marginals and checking to see whether the product of the marginals equals the original function (more work, but just as effective).

ECE32 Spring 26 HW7 Solutions March, 26 2 Problem 5.4.5 The PDF of the 3-dimensional random vector X is { e x 3 x f X (x) x 2 x 3, otherwise. Are the components of X independent random variables? Problem 5.4.5 Solution This problem can be solved without any real math. Some thought should convince you that for any x i >, f Xi (x i ) >. Thus, f X () >, f X2 (9) >, and f X3 (8) >. Thus f X ()f X2 (9)f X3 (8) >. However, from the definition of the joint PDF f X,X 2,X 3 (,9,8) f X ()f X2 (9) f X3 (8). () It follows that X, X 2 and X 3 are dependent. Readers who find this quick answer dissatisfying are invited to confirm this conclusions by solving Problem 5.4.6 for the exact expressions for the marginal PDFs f X (x ), f X2 (x 2 ), and f X3 (x 3 ). Solution to 5.4.6. is included below. Problem 5.4.6 The random vector X has PDF { e x 3 x f X (x) x 2 x 3, otherwise. Find the marginal PDFs f X (x ), f X2 (x 2 ), and f X3 (x 3 ). Problem 5.4.6 Solution This problem was not assigned but contains the straightforward solution to problem 5.4.5, hence is included here in the solutions. We find the marginal PDFs using Theorem 5.5. First we note that for x <, f Xi (x). For x, ( ) f X (x ) e x 3 dx 3 dx 2 e x 2 dx 2 e x () x 2 x Similarly, for x 2, X 2 has marginal PDF x2 ( ) f X2 (x 2 ) e x 3 dx 3 dx x 2 Lastly, f X3 (x 3 ) x x3 ( x3 x2 e x 2 dx x 2 e x 2 (2) ) x3 e x 3 dx 2 dx (x 3 x )e x 3 dx (3) x 2 (x 3 x ) 2 e x x x 3 3 2 x2 3e x 3 (4) x

ECE32 Spring 26 HW7 Solutions March, 26 3 The complete expressions for the three marginal PDFs are { e x x f X (x ) otherwise { x2 e f X2 (x 2 ) x 2 x 2 otherwise { (/2)x 2 f X3 (x 3 ) 3 e x 3 x 3 otherwise (5) (6) (7) In fact, each X i is an Erlang (n,λ) (i,) random variable. Problem 4.6. Given random variables X and Y in Problem 4.2. and the function W X Y, find (a) The probability mass function P W (w), (b) The expected value E[W], (c) P[W > ]. Problem 4.6. Solution In this problem, it is helpful to label possible points X,Y along with the corresponding values of W X Y. From the statement of Problem 4.6., y 4 P X,Y (x,y) 3 W 2 3/28 W 6/28 W 2/28 2 W /28 W 2/28 W3 4/28 2 3 4 x (a) To find the PMF of W, we simply add the probabilities associated with each possible value of W: P W ( 2) P X,Y (,3) 3/28 P W ( ) P X,Y (2,3) 6/28 () P W () P X,Y (,) /28 P W () P X,Y (2,) + P X,Y (4,3) (2) P W (3) P X,Y (4,) 4/28 4/28 (3) For all other values of w, P W (w).

ECE32 Spring 26 HW7 Solutions March, 26 4 (b) The expected value of W is E [W] w wp W (w) (4) 2(3/28) + (6/28) + (/28) + (4/28) + 3(4/28) /2 (5) (c) P[W > ] P W () + P W (3) 8/28. Problem 5.5.2 In the message transmission problem, Problem 5.3.2, the PMF for the number of transmissions when message i is received successfully is p 3 ( p) k 3 3 k < k 2 < k 3 ; P K (k) k i {,2...}, otherwise. Let J 3 K 3 K 2, the number of transmissions of message 3; J 2 K 2 K, the number of transmissions of message 2; and J K, the number of transmissions of message. Derive a formula for P J (j), the PMF of the number of transmissions of individual messages. Problem 5.5.2 Solution The random variable J n is the number of times that message n is transmitted. Since each transmission is a success with probability p, independent of any other transmission, the number of transmissions of message n is independent of the number of transmissions of message m. That is, for m n, J m and J n are independent random variables. Moreover, because each message is transmitted over and over until it is transmitted succesfully, each J m is a geometric (p) random variable with PMF P Jm (j) Thus the PMF of J [ J J 2 J 3 ] is { ( p) j p j,2,... otherwise. p 3 ( p) j +j 2 +j 3 3 j i,2,... ; i,2,3 P J (j) P J (j )P J2 (j 2 ) P J3 (j 3 ) otherwise. () (2) Problem 4.7. For the random variables X and Y in Problem 4.2., find (a) The expected value of W Y/X, (b) The correlation, E[XY ],

ECE32 Spring 26 HW7 Solutions March, 26 5 (c) The covariance, Cov[X, Y ], (d) The correlation coefficient, ρ X,Y, (e) The variance of X + Y, Var[X + Y ]. (Refer to the results of Problem 4.3. to answer some of these questions.) Problem 4.7. Solution 4 3 2 y P X,Y (x,y) 3/28 6/28 2/28 /28 2/28 2 3 4 4/28 x In Problem 4.2., we found the joint PMF P X,Y (x,y) as shown. Also the expected values and variances were E [X] 3 Var[X] /7 () E [Y ] 5/2 Var[Y ] 3/4 (2) We use these results now to solve this problem. (a) Random variable W Y/X has expected value E [Y/X] y x P X,Y (x,y) (3) x,2,4 y,3 28 + 3 3 28 + 2 2 28 + 3 6 2 28 + 4 4 28 + 3 2 5/4 (4) 4 28 (b) The correlation of X and Y is r X,Y xyp X,Y (x,y) (5) x,2,4 y,3 + 3 3 + 2 2 + 2 3 6 + 4 4 + 4 3 2 28 28 28 28 28 28 (6) 2/28 5/4 (7) Recognizing that P X,Y (x,y) xy/28 yields the faster calculation r X,Y E [XY ] (xy) 2 x,2,4 y,3 28 28 x,2,4 y,3 (8) x 2 y 2 (9) 28 ( + 22 + 4 2 )( 2 + 3 2 ) 2/28 5/4 () (c) The covariance of X and Y is Cov [X,Y ] E [XY ] E [X] E [Y ] 5 2 35 2 ()

ECE32 Spring 26 HW7 Solutions March, 26 6 (d) Since X and Y have zero covariance, the correlation coefficient is ρ X,Y Cov [X,Y ] Var[X]Var[Y ]. (2) (e) Since X and Y are uncorrelated, the variance of X + Y is Var[X + Y ] Var[X] + Var[Y ] 6 28. (3) Problem 5.6. Random variables X and X 2 have zero expected value and variances Var[X ] 4 and Var[X 2 ] 9. Their covariance is Cov[X,X 2 ] 3. (a) Find the covariance matrix of X [ X X 2 ]. (b) X and X 2 are transformed to new variables Y and Y 2 according to Y X 2X 2 Y 2 3X + 4X 2 Find the covariance matrix of Y [ Y Y 2 ]. Problem 5.6. Solution (a) The coavariance matrix of X [ X C X (b) From the problem statement, X 2 ] is [ ] Var[X ] Cov [X,X 2 ] Cov [X,X 2 ] Var[X 2 ] Y [ Y Y 2 ] By Theorem 5.3, Y has covariance matrix [ ][ ][ ] C Y AC X A 2 4 3 3 3 4 3 9 2 4 [ ] 4 3. () 3 9 [ ] 2 X AX. (2) 3 4 [ ] 28 66. (3) 66 252

ECE32 Spring 26 HW7 Solutions March, 26 7 Problem 4.. Random variables X and Y have joint PDF f X,Y (x,y) ce (x2 /8) (y 2 /8). What is the constant c? Are X and Y independent? Problem 4.. Solution f X,Y (x,y) ce (x2 /8) (y 2 /8) The omission of any limits for the PDF indicates that it is defined over all x and y. We know that f X,Y (x,y) is in the form of the bivariate Gaussian distribution so we look to Definition 4.7 and attempt to find values for σ Y, σ X, E[X], E[Y ] and ρ. First, we know that the constant is c (2) 2πσ X σ Y ρ 2 Because the exponent of f X,Y (x,y) doesn t contain any cross terms we know that ρ must be zero, and we are left to solve the following for E[X], E[Y ], σ X, and σ Y : () ( x E [X] σ X From which we can conclude that ) 2 x2 8 ( y E [Y ] σ Y ) 2 y2 8 (3) E [X] E [Y ] (4) σ X 8 (5) σ Y 8 (6) Putting all the pieces together, we find that c 24π. Since ρ, we also find that X and Y are independent. Problem 5.7. X is the 3-dimensional Gaussian random vector with expected value µ X [ 4 8 6 ] and covariance 4 2 C X 2 4 2. 2 4 Calculate (a) the correlation matrix, R X, (b) the PDF of the first two components of X, f X,X 2 (x,x 2 ), (c) the probability that X > 8.

ECE32 Spring 26 HW7 Solutions March, 26 8 Problem 5.7. Solution (a) From Theorem 5.2, the correlation matrix of X is R X C X + µ X µ X () 4 2 4 2 4 2 + 8 [ 4 8 6 ] (2) 2 4 6 4 2 6 32 24 2 3 25 2 4 2 + 32 64 48 3 68 46 (3) 2 4 24 48 36 25 46 4 (b) Let Y [ ]. X X 2 Since Y is a subset of the components of X, it is a Gaussian random vector with expected velue vector and covariance matrix C Y We note that det(c Y ) 2 and that µ Y [ E [X ] E [X 2 ] ] [ 4 8 ]. (4) [ ] Var[X ] Cov [X,X 2 ] C X X 2 Var[X 2 ] C Y 2 [ 4 2 2 4 ] [ 4 ] 2 2 4 (5) [ ] /3 /6. (6) /6 /3 This implies that (y µ Y ) C Y (y µ Y ) [ y 4 y 2 8 ][ ][ ] /3 /6 y 4 /6 /3 y 2 8 The PDF of Y is [ y 4 y 2 8 ][ y /3 + y 2 /6 8/3 y /6 + y 2 /3 /3 y2 3 + y y 2 6y 2y 2 + y2 2 3 3 3 3 + 2 3 f Y (y) 2π 2 e (y µ Y ) CY Y )/2 () 48π 2 e (y2 +y y 2 6y 2y 2 +y2 2+2)/6 () Since Y [ X,X 2 ], the PDF of X and X 2 is simply f X,X 2 (x,x 2 ) f Y,Y 2 (x,x 2 ) ] (7) (8) (9) 48π 2 e (x2 +x x 2 6x 2x 2 +x 2 2 +2)/6 (2) (c) We can observe directly from µ X and C X that X is a Gaussian (4,2) random variable. Thus, [ X 4 P [X > 8] P > 8 4 ] Q(2).228 (3) 2 2

ECE32 Spring 26 HW7 Solutions March, 26 9 Problem 5.8. Consider the vector X in Problem 5.7. and define the average to be Y (X +X 2 +X 3 )/3. What is the probability that Y > 4? Problem 5.8. Solution We can use Theorem 5.6 since the scalar Y is also a -dimensional vector. To do so, we write Y [ /3 /3 /3 ] X AX. () By Theorem 5.6, Y is a Gaussian vector with expected value and covariance matrix E [Y ] Aµ X (E [X ] + E [X 2 ] + E [X 3 ])/3 (4 + 8 + 6)/3 6 (2) C Y Var[Y ] AC X A (3) [ /3 /3 /3 ] 4 2 /3 2 4 2 /3 2 (4) 3 2 4 /3 Thus Y is a Gaussian (6, 2/3) random variable, implying [ ] Y 6 P [Y > 4] P > 4 6 Φ( 6) Φ( 6).9928 (5) 2/3 2/3 Problem 5.8.3 For the vector of daily temperatures [ ] T T 3 and average temperature Y modeled in Quiz 5.8, we wish to estimate the probability of the event { } A Y 82,min T i 72 i To form an estimate of A, generate, independent samples of the vector T and calculate the relative frequency of A in those trials. Problem 5.8.3 Solution We are given that the random temperature vector has covariance Cov [T i,t j ] C T [i j] 36 + i j where i and j indicate the ith and jth days of the month and corresponding elements of the temperature vector. Thus C T [] C T [] C T [3]. C T C T [] C T [].......... CT []. (2) C T [3] C T [] C T [] ()

ECE32 Spring 26 HW7 Solutions March, 26 2 Applying the method discussed on p. 236 of the textbook, we use the matlab script below to generate the, samples and estimate the relative frequency of occurance of the event A. % % Solves problem 5.8.3 of Yates and Goodman. 3/9/6 sk % % 5.8.3 Generate, random samples of the vector T of length 3 % having E[T_i]8 and Cov[T_i,T_j]36/(+ i-j ). Let Y sum_i(t_i)/3. % Let A be the event that Y \leq 82 AND min_i(t_i) \geq 72 % mut 8*ones(3,); % First generate covariance matrix C. for iindex:3, for jindex :3, C(iindex,jindex)36/(+abs(iindex-jindex)); end; end; % Then generate samples. To avoid having a,x3 variable in our % workspace, after generating each sample, let s keep only Y and min(t). [u,d,v]svd(c); % as shown on page 236. for index :, T v*(d^(.5))*randn(3,) + mut; Y(index) sum(t)/3; mint(index) min(t); end; % Finally count the number of times A occurs out of the, samples. for index :, if and((y(index)< 82),(minT(index) > 72)), A(index) ; else A(index) ; end; end; % Now estimate P[A]. disp([ On the basis of this experiment, we estimate P[A] to be,... num2str((sum(a)/))]); The output obtained is >> p5_8_3 On the basis of this experiment, we estimate P[A] to be.79