Probability and Random Variables. Generation of random variables (r.v.)

Size: px
Start display at page:

Download "Probability and Random Variables. Generation of random variables (r.v.)"

Transcription

1 Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly filtered random process P.S.D and Auto Correlation Generation of random variables (r.v.) o Simulate effects of noise signals o Random phenomenon in the real world o To study the effects through simulation of communication Systems Uniform r.v. A number between 0 and 1 with equal probability 0 <= A <=1 o A random variable ( r.v.) has the range 0 to 1 o The uniform probability density function (pdf) for the r.v. A is denoted by f(a) pdf : Probability density function f(a) The average value or mean value of a r.v. is m A m A =½ pdf can be defined for any r.v. while CDF or PDF can only be defined for continuous r.v.

2 Probability Distribution Function (PDF) or Cumulative distribution function (CDF) F(A) of a uniformly distributed r.v. A The integral of the probability density function (pdf) is called the Probability Distribution Function (PDF) or Cumulative Distribution Function (CDF) of the r.v. A is the area under f(a) denoted by F(A) or F X (x) ( i.e. P(X<=x) ) For any R.V. this area must always be unity ; maximum value of the distribution function. For the uniform random variable A the range of F(A) is 0<= F(A) <= 1 for 0 <= A <=1 Generating uniform distributed noise in interval (b,b+1) can be done by using output A of the random number generator and shifting it by an amount B=A+b B is new r.v. has mean m B = b+½ If b=-½ then the r.v. B is uniformly distributed in interval (-½, ½)

3 Generating the r.v. with other PDF Zero Mean uniformly distributed r.v. in the range (0,1) can be used to generate the r.v with other PDF. Suppose C with PDF F(C) Since the range of F(C) is the interval (0,1) o Begin with generating a uniformly distributed r.v. A in the range (0,1) and o Set F(C) =A hence C=F -1 (A). o This is the inverse mapping from A to C

4 Gaussian Process A random process X(t) is a Gaussian process if for all n and all (t 1, t 2, t 3,. t n ) the r.v.s have Joint Gaussian density function, f(x) as x vector of n r.vs x = (x 1, x 2,..., x n ) t, m mean, m=e(x) C n x n covariance matrix t transpose C -1 Properties inverse of covariance matrix C o At any time instant t 0 the r.v. X(t 0 ) is Gaussian o At any two points t 1, t 2 the r.vs. (X(t 1 ), X(t 2 )) are distributed according to a two dimensional Gaussian r.v. 1. For a Gaussian processes, the knowledge of the Mean m and the Covariance C provides a complete statistical description of the process. 2. If the Gaussian process X(t) is passed through a LTI system, the output of the system is also a Gaussian process. The effect of the system on X(t) is simply reflected by a change in the mean value and the covariance of X(t)

5 Markov Process o A Markov process X(t) is a random process whose past has no influence on the future if its present is specified. i.e. If t n > t n-1, then In other way If t 1 < t 2 <.. < t n, then Gauss-Markov Process A Gauss-Markov process X(t) is a Markov process whose probability density function is Gaussian o The simplest method for generating a Markov process is by means of a simple recursive formula W n where is a sequence of zero mean i.i.d (white) r.v.s and is a parameter that determines the degree of correlation between X n and X n-1 o If the sequence {W n } is Gaussian, then the resulting process X(t) is Gauss-Markov FIGURE Gauss- Markov Sequence (left) Auto - Correlation of the Gauss- Markov process (right)

6 Power Spectrum of Random Processes and White processes A stationary process X(t) is characterize in the frequency domain by its power spectrum which is the F.T. of the autocorrelation function of the random process. That is The auto-correlation function of a stationary random process X(t) is obtained from the power spectrum by means of the IFT White Process A random process X(t) is called the white process i.e. if it has a flat power spectrum is constant for all f o Information sources are modeled as the output of LTI systems driven by a white process. o If then or all f the total power is infinite. No real Physical process can have infinite power and therefore, a white process may not be meaningful physical process

7 However thermal noise can be modeled for all practical purposes as white noise process with the power spectrum equating The value kt is denoted by N0 PSD of thermal noise is PSD of thermal noise is referred to two sided power spectral density For a white random process X(t) with power spectrum the auto correlation function is where is the unit impulse for all we have o If we sample a white process at two points t 1, t 2, r.v.s will be un-correlated. the resulting o If in addition to being white, the random process is also Gaussian, the sampled r.v.s will be statistically independent Gaussian r.v.s

8 Linear Filtering of Random Processes o Suppose that a stationary random process X(t) is passed through a LTI filter that is characterized in time domain by Its I.R. and in the frequency domain by its F.R. o It follows that the output of the linear filter is the random process o The mean value of Y(t) is where H(0) is the F.R. H(f) of the filter evaluated at f = 0 o The autocorrelation function of Y(t)

9 o In the frequency domain, the power spectrum of the output Y(t) is related to the power spectrum of the input process X(t) and the frequency response of the linear filter by the expression o This is easily know by taking the F.T. of Low pass and Band Pass Processes o Random signals can also be characterized as low pass random processes. Definition o A random process is called lowpass if its power spectrum is larger in the vicinity of f = 0 and small ( approaching 0) at high frequencies. In other words a low pass random process has most of its power contracted at low frequencies. Definition o A lowpass random process X(t) is bandlimited if the power spectrum for the parameter B is called Bandwidth of the random process Definition o A random process is called bandpass if its power spectrum is large in the band of frequencies centered in the neighborhood of a central frequency and relatively small outside this band of frequencies. o A random process is called narrowband if its bandwidth the vicinity of f=0 and small ( approaching 0) at high frequencies. o In other words a low pass random process has most of its power contracted at low frequencies. in

10 Properties o Bandpass process are suitable for representing modulated signals. o The information bearing signal is usually a lowpass random process that modulates over a bandpass (narrowband) communication channel. o Modulated signal is a bandpass random process. o A bandpass random process X(t) can be represented as where and are called in-phase and quadratic components of X(t) and are lowpass process Theorem: o If X(t) is a zero-mean stationary random process, the processes are also zero-mean, jointly stationary processes. o The autocorrelation functions of and are identical and may be expressed as and where is the autocorrelation function of the bandpass process X(t) and is the Hilbert transform of and is defined as o The cross-correlation function of and is expressed as o The auto-correlation function of the bandpass process X(t) is expressed in terms of the autocorrelation function and the cross-correlation function as

11

Lecture Notes 9 Course Summary. Random Variables. Mean and Covariance matrix. Vector Detection and Estimation. Convergence and Limit Theorems

Lecture Notes 9 Course Summary. Random Variables. Mean and Covariance matrix. Vector Detection and Estimation. Convergence and Limit Theorems Lecture Notes 9 Course Summary Random Variables Mean and Covariance matrix Gaussians Vector Detection and Estimation Convergence and Limit Theorems Random Processes Random processes in Linear Systems EE

More information

Lecture 11: Introduction to Random Processes -cont d

Lecture 11: Introduction to Random Processes -cont d Lecture 11: Introduction to Random Processes -cont d ELE 525: Random Processes in Information Systems Hisashi Kobayashi Department of Electrical Engineering Princeton University October 16, 2013 Textbook:

More information

Preface to the Third Edition Preface to the First Edition

Preface to the Third Edition Preface to the First Edition Preface to the Third Edition Preface to the First Edition xiii xv 1. Probability Theory 1 Random Experiment 1 Mathematical or Apriori Definition of Probability 1 Statistical or Aposteriori Definition of

More information

Module 4. Signal Representation and Baseband Processing. Version 2 ECE IIT, Kharagpur

Module 4. Signal Representation and Baseband Processing. Version 2 ECE IIT, Kharagpur Module 4 Signal Representation and Baseband Processing Version ECE IIT, Kharagpur Lesson Matched Filter Version ECE IIT, Kharagpur After reading this lesson, you will learn about Principle of matched filter

More information

Linear System Response to Random Inputs

Linear System Response to Random Inputs Linear System Response to Random Inputs M. Sami Fadali Professor of Electrical Engineering University of Nevada Outline Linear System Response to deterministic input. Response to stochastic input. Characterize

More information

Topic 8: Power spectral density and LTI systems. The autocorrelation function and the rate of change

Topic 8: Power spectral density and LTI systems. The autocorrelation function and the rate of change Topic 8: Power spectral density and LTI systems The power spectral density of a WSS random process Response of an LTI system to random signals Linear MSE estimation ES150 Harvard SEAS 1 The autocorrelation

More information

Communications Engineering Task Collection

Communications Engineering Task Collection Communications Engineering ask Collection International Graduate Program Master of Science in Communications and Signal Processing Dr. Mike Wolf, Communications Research Laboratory (Fachgebiet Nachrichtentechnik)

More information

Chapter 7 - Correlation Functions

Chapter 7 - Correlation Functions Chapter 7 - Correlation Functions Let X(t) denote a random process. The autocorrelation of X is defined as x 1 1 - - 1 1 1 1 R (t,t ) E[X(t )X(t )] x x f(x,x ;t,t )dx dx. (7-1) The autocovariance function

More information

Topic 7: Random Processes. Random processes

Topic 7: Random Processes. Random processes Topic 7: Random Processes Definition, discrete and continuous processes Specifying random processes Joint cdf s or pdf s Mean, auto-covariance, auto-correlation Cross-covariance, cross-correlation Stationary

More information

Digital Modulation Lecture 03

Digital Modulation Lecture 03 Digital Modulation Lecture 03 Inter-Symbol Interference Power Spectral Density Richard Harris Objectives To be able to discuss Inter-Symbol Interference (ISI), its causes and possible remedies. To be able

More information

A general representation for a matched filter is illustrated in Figure 3-1. FIGURE 3-1 Matched filter

A general representation for a matched filter is illustrated in Figure 3-1. FIGURE 3-1 Matched filter MATCHED FILTERS The matched filter is the optimal linear filter for maximizing the signal to noise ratio (SNR) in the presence of additive stochastic noise. Matched filters are commonly used in radar,

More information

Chapter 8 - Power Density Spectrum

Chapter 8 - Power Density Spectrum EE385 Class Notes 8/8/03 John Stensby Chapter 8 - Power Density Spectrum Let X(t) be a WSS random process. X(t) has an average power, given in watts, of E[X(t) ], a constant. his total average power is

More information

Power Spectral Density

Power Spectral Density Power Spectral Density Derivation In applying frequency-domain techniques to the analysis of random signals the natural approach is to Fourier transform the signals. Unfortunately the Fourier transform

More information

Purpose of Time Series Analysis. Autocovariance Function. Autocorrelation Function. Part 3: Time Series I

Purpose of Time Series Analysis. Autocovariance Function. Autocorrelation Function. Part 3: Time Series I Part 3: Time Series I Purpose of Time Series Analysis (Figure from Panofsky and Brier 1968) Autocorrelation Function Harmonic Analysis Spectrum Analysis Data Window Significance Tests Some major purposes

More information

Probability of error in transmission

Probability of error in transmission Probability of error in transmission In a binary PCM system, binary digits may be represented by two pulse levels. If these levels are chosen to be and A, the signal is termed an on-off binary signal.

More information

Random Variables and Stochastic Processes

Random Variables and Stochastic Processes Random Variables and Stochastic Processes 1 Randomness The word random effectively means unpredictable In engineering practice we may treat some signals as random to simplify the analysis even though they

More information

Digital Communication Systems Master of Electrical Engineering and Informaiton Technology. Lecture 4 : Channel Models and Channel Capacity

Digital Communication Systems Master of Electrical Engineering and Informaiton Technology. Lecture 4 : Channel Models and Channel Capacity Digital Communication Systems Master of Electrical Engineering and Informaiton Technology Lecture 4 : Channel Models and Channel Capacity Channel Models and Channel Capacity Ref: Digital Communication

More information

Lecture Notes 6 Random Processes. Definition and Simple Examples

Lecture Notes 6 Random Processes. Definition and Simple Examples Lecture Notes 6 Random Processes Definition and Simple Examples Important Classes of Random Processes IID Random Walk Process Markov Processes Independent Increment Processes Counting processes and Poisson

More information

We define the power spectral density (PSD) (also called the spectrum ) as: Average Power

We define the power spectral density (PSD) (also called the spectrum ) as: Average Power Noise in RF Design What is Noise? Noise is a random process. Since the instantaneous noise amplitude is not known, we resort to statistical models, i.e., some properties that can be predicted. We define

More information

INTRODUCTION TO SIGNAL PROCESSING

INTRODUCTION TO SIGNAL PROCESSING INTRODUCTION TO SIGNAL PROCESSING Iasonas Kokkinos Ecole Centrale Paris Lecture 7 Introduction to Random Signals Sources of randomness Inherent in the signal generation Noise due to imaging Prostate MRI

More information

Baseband Data Transmission I After this lecture, you will be able to

Baseband Data Transmission I After this lecture, you will be able to Baseband Data Transmission I After this lecture, you will be able to describe the components of a digital transmission system Information source, transmitter, channel, receiver and destination calculate

More information

ECE 361: Lecture 3: Matched Filters Part I

ECE 361: Lecture 3: Matched Filters Part I University of Illinois Spring 011 ECE 361: Lecture 3: Matched Filters Part I 3.1 The Receiver Model In Lecture, we studied the decision-making process in the digital communications receiver which was modeled

More information

Characteristics of Noise Received by Software Defined Radio

Characteristics of Noise Received by Software Defined Radio Characteristics of Noise Received by Software Defined Radio Department of Electrical Engineering Indian Institute of Technology Madras December 2012 Abstract To study the characteristics of the noise received

More information

SIGNAL PROCESSING & SIMULATION NEWSLETTER

SIGNAL PROCESSING & SIMULATION NEWSLETTER 1 of 7 1/25/2008 3:27 AM S x (f) -f c 0 f c SIGNAL PROCESSING & SIMULATION NEWSLETTER TUTORIAL 1 - Basic concepts in signal processing Power and Energy Energy of a pulse g(t) is defined as 1 This expression

More information

PROBABILITY AND RANDOM PROCESSES. Unit I RANDOM VARIABLES. X P(x) a 3a 5a 7a 9a 11a 13a 15a 17a Determine the value of a

PROBABILITY AND RANDOM PROCESSES. Unit I RANDOM VARIABLES. X P(x) a 3a 5a 7a 9a 11a 13a 15a 17a Determine the value of a PROBABILITY AND RANDOM PROCESSES Unit I RANDOM VARIABLES PART-A 1. A random sample X has the probability function X 0 1 2 3 4 5 6 7 8 P(x) a 3a 5a 7a 9a 11a 13a 15a 17a Determine the value of a Solution:

More information

Formatting and Baseband Modulation. Dr. Syed Anwar Lecture 3&4 Digital Communication

Formatting and Baseband Modulation. Dr. Syed Anwar Lecture 3&4 Digital Communication Formatting and Baseband Modulation Dr. Syed Anwar Lecture 3&4 Digital Communication Formatting A transformation on the message or source signal to make it compatible with digital processing. Source Coding

More information

ELEC-E8104 Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems

ELEC-E8104 Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems Stochastics models and estimation, Lecture 3b: Linear Estimation in Static Systems Minimum Mean Square Error (MMSE) MMSE estimation of Gaussian random vectors Linear MMSE estimator for arbitrarily distributed

More information

Lecture 8 The Kalman filter

Lecture 8 The Kalman filter EE363 Winter 2008-09 Lecture 8 The Kalman filter Linear system driven by stochastic process Statistical steady-state Linear Gauss-Markov model Kalman filter Steady-state Kalman filter 8 1 Linear system

More information

Analog to Digital Conversion

Analog to Digital Conversion Analog to Digital Conversion Lecture No. 7 Dr. Aoife Moloney School of Electronics and Communications Dublin Institute of Technology Overview Now that we have finished the maths and theory we will have

More information

Lecture 3: Bayesian Optimal Filtering Equations and Kalman Filter

Lecture 3: Bayesian Optimal Filtering Equations and Kalman Filter Equations and Kalman Filter Department of Biomedical Engineering and Computational Science Aalto University February 10, 2011 Contents 1 Probabilistics State Space Models 2 Bayesian Optimal Filter 3 Kalman

More information

Outline. Random Variables. Examples. Random Variable

Outline. Random Variables. Examples. Random Variable Outline Random Variables M. Sami Fadali Professor of Electrical Engineering University of Nevada, Reno Random variables. CDF and pdf. Joint random variables. Correlated, independent, orthogonal. Correlation,

More information

ECE302 Spring 2006 HW12 Solutions April 27,

ECE302 Spring 2006 HW12 Solutions April 27, ECE02 Spring 2006 HW2 Solutions April 27, 2006 Solutions to HW2 Note: These solutions are D. J. Goodman, the authors of our textbook. I have annotated and corrected them as necessary. Text in italics is

More information

use a correlation receiver to determine whether a +1 or a,1 We transmitted at a time instant m. We assume that the was is connected to an information

use a correlation receiver to determine whether a +1 or a,1 We transmitted at a time instant m. We assume that the was is connected to an information a binary discrete-time communication system with the Consider signal a time sequence fr m g 1 m=0 dened by received r m = Eb m + w m b m is the sequence of information symbols (antipodal binary, where

More information

Lecture 7 The Kalman filter

Lecture 7 The Kalman filter Adapted from EE363: Linear Dynamical Systems, Winter 2005-2006 Stephen Boyd - Stanford University Lecture 7 The Kalman filter Linear system driven by stochastic process Statistical steady-state Linear

More information

Advanced Signal Processing 2 Fundamentals of Signal Decomposition Lessiak Andreas 1/18

Advanced Signal Processing 2 Fundamentals of Signal Decomposition Lessiak Andreas 1/18 Lessiak Andreas 1/18 A common theme in many signal processing applications is to decompose a signal into its primitive or fundamental constituents and perform simple operations separately on each component.

More information

Chapter 4 - Lecture 1 Probability Density Functions and Cumul. Distribution Functions

Chapter 4 - Lecture 1 Probability Density Functions and Cumul. Distribution Functions Chapter 4 - Lecture 1 Probability Density Functions and Cumulative Distribution Functions October 21st, 2009 Review Probability distribution function Useful results Relationship between the pdf and the

More information

Properties of the power spectral density

Properties of the power spectral density Signals and systems class, HSE, Spring 5, A. Ossadtchi, Ph.D. Lecture 8 Properties of the power spectral density Introduction As we could see from the derivation of Wiener-Khinthine theorem the Power Spectral

More information

CDMA - SPREAD SPECTRUM

CDMA - SPREAD SPECTRUM CDMA - SPREAD SPECTRUM http://www.tutorialspoint.com/cdma/cdma_spread_spectrum.htm Copyright tutorialspoint.com All technical modulation and demodulation strive for greater power and/or efficiency of bandwidth

More information

Class 7: Examples and exercises

Class 7: Examples and exercises et 4235 - Digital signal processing Class 7: Eamples and eercises Rocio Arroyo Valles, Geert Leus, and Alle-Jan van der Veen 01-10-2012 Faculty of EEMCS, Delft University of Technology Delft University

More information

Discrete-time Signals and Systems

Discrete-time Signals and Systems Chapter 2 Discrete-time Signals and Systems 2.1 Discrete-time signals Digital signals are discrete in both time (the independent variable) and amplitude (the dependent variable). Signals that are disrete

More information

Stochastic Processes

Stochastic Processes Stochastic Processes Definition A random variable is a number X assigned to every outcome of an experiment. ( ) A stochastic process is the assignment of a function of t to each outcome of an experiment.

More information

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science

MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 1 MASSACHUSETTS INSTITUTE OF TECHNOLOGY Department of Electrical Engineering and Computer Science 6.011 Introduction to Communication, Control and Signal Processing Fall 2003 FINAL EXAM Tuesday, December

More information

Introduction to Time Series and Forecasting

Introduction to Time Series and Forecasting Peter J. Brockwell Richard A. Davis Introduction to Time Series and Forecasting Second Edition With 126 Illustrations Includes CD-ROM Springer Preface vii 1. Introduction 1 1.1. Examples of Time Series

More information

5 Signal Design for Bandlimited Channels

5 Signal Design for Bandlimited Channels 225 5 Signal Design for Bandlimited Channels So far, we have not imposed any bandwidth constraints on the transmitted passband signal, or equivalently, on the transmitted baseband signal s b (t) I[k]g

More information

2. Linear Minimum Mean Squared Error Estimation

2. Linear Minimum Mean Squared Error Estimation . Linear inimum ean Squared Error Estimation.1. Linear minimum mean squared error estimators Situation considered: - A random sequence X ( 1,, X( whose realizations can be observed. - A random variable

More information

EE 179 April 28, 2014 Digital and Analog Communication Systems Handout #21 Homework #3 Solutions

EE 179 April 28, 2014 Digital and Analog Communication Systems Handout #21 Homework #3 Solutions EE 179 April 28, 214 Digital and Analog Communication Systems Handout #21 Homework #3 Solutions 1. DSB-SC modulator (Lathi& Ding 4.2-3). You are asked to design a DSB-SC modulator to generate a modulated

More information

Digital Communication Fundamentals

Digital Communication Fundamentals Chapter 2 Digital Communication Fundamentals 2.1 Introduction As we said at the end of Chapter 1, CDMA is applicable to digital (as opposed to analog) communication. This chapter is therefore devoted to

More information

Multi-user MC-CDMA Using Pseudo Noise Code for Rayleigh and Gaussian Channel

Multi-user MC-CDMA Using Pseudo Noise Code for Rayleigh and Gaussian Channel 882 PIERS Proceedings, Kuala Lumpur, MALAYSIA, March 27 30, 2012 Multi-user MC-CDMA Using Pseudo Noise Code for Rayleigh and Gaussian Channel M. F. Ghanim and M. F. L. Abdullah Department of Communication

More information

ERG 2310: Principles of Communications

ERG 2310: Principles of Communications ERG 231: Principles of Communications Chapter 3 Angle Modulation 3.1 Introduction Besides using the amplitude of a carrier to carrier information, one can also use the angle of a carrier to carrier information.

More information

Introduction to RF and Wireless

Introduction to RF and Wireless Introduction to RF and Wireless Wireless is everywhere Cellphones: Worldwide Sales of Mobile Terminals 1100 1000 900 800 700 600 2004 2005 2006 2007 Million 2008 2009 GPS: RFIDs: Wireless Home: 1 Wireless

More information

Sampling: DAC and ADC conversion

Sampling: DAC and ADC conversion Sampling: DAC and ADC conversion Course Objectives Specific Course Topics: -Basic test signals and their properties -Basic system examples and their properties -Signals and systems interaction (Time Domain:

More information

Lecture 6. Cross covariance and cross spectra. Introduction to ARMA models.

Lecture 6. Cross covariance and cross spectra. Introduction to ARMA models. Lecture 6. Cross covariance and cross spectra. Introduction to ARMA models. Jesper Rydén Department of Mathematics, Uppsala University jesper@math.uu.se Stationary Stochastic Processes Fall 2011 Cross

More information

Elements of a Digital Communications System Digital Modulation Channel Model Receiver MATLAB Simulation

Elements of a Digital Communications System Digital Modulation Channel Model Receiver MATLAB Simulation Matched Filter It is well known, that the optimum receiver for an AWGN channel is the matched filter receiver. The matched filter for a linearly modulated signal using pulse shape p(t) is shown below.

More information

Random Variables, Independence and Covariance

Random Variables, Independence and Covariance Random Variables, Independence and Covariance Jack Xin (Lecture) and J. Ernie Esser (Lab) Abstract Classnotes on random variables, (joint) distribution, density function, covariance. 1 Basic Notion and

More information

EE4512 Analog and Digital Communications Chapter 8. Chapter 8 Analog-to. to-digital and Digital to Analog Conversion

EE4512 Analog and Digital Communications Chapter 8. Chapter 8 Analog-to. to-digital and Digital to Analog Conversion Chapter 8 Analog-to to-digital and Digital to Analog Conversion Chapter 8 Analog-to to-digital and Digital-to to-analog Conversion Sampling and Quantization Pages 390-391 391 Traditional analog transmission

More information

Introduction to Digital Modulation. Introduction

Introduction to Digital Modulation. Introduction Introduction to Digital Modulation Introduction In a digital communication system, the source to be transmitted is discrete both in time and amplitude Digital information carrying signals must be first

More information

ECEN 447 Digital Image Processing

ECEN 447 Digital Image Processing ECEN 447 Digital Image Processing Lecture 5: Enhancement in Frequency Domain Ulisses Braga-Neto ECE Department Texas A&M University 2-D Fourier Transform The Fourier Transform, both continuous and discrete,

More information

EXAM QUESTIONS. Communications 2 1/5

EXAM QUESTIONS. Communications 2 1/5 EXAM QUESTIONS 1. This question is compulsory. a) Answer the following questions about probability and random processes. i) Explain what is meant by a wide-sense stationary random process and what the

More information

Chapter 8: Baseband Digital

Chapter 8: Baseband Digital Chapter 8: Baseband Digital Transmission 6/8/2010 1 Introduction Transmission of digital signal Over a baseband channel (Chapter 8) local communications Over a band pass channel using modulation (Chapter

More information

ENSC327 Communications Systems 24: Ch. 9: Noise in Analog Systems. Jie Liang School of Engineering Science Simon Fraser University

ENSC327 Communications Systems 24: Ch. 9: Noise in Analog Systems. Jie Liang School of Engineering Science Simon Fraser University ENSC327 Communications Systems 24: Ch. 9: Noise in Analog Systems Jie Liang School of Engineering Science Simon Fraser University 1 Chapter 9 Noise in Analog Comm. Chap 9 studies noise performance of various

More information

TSKS04 Digital Communication, Continuation Course

TSKS04 Digital Communication, Continuation Course SKS04 Digital Communication, Continuation Course Problems for utorial 1 1. Let the input to a digital modulator consist of independent, equally probable bits. Determine the power-spectral densities in

More information

Lecture Notes for ECE 361. Fall 1995

Lecture Notes for ECE 361. Fall 1995 Introduction to Digital Communication Systems Lecture Notes for ECE 361 Fall 1995 Dilip V. Sarwate Department of Electrical and Computer Engineering University of Illinois at Urbana-Champaign Urbana, Illinois

More information

min ǫ = E{e 2 [n]}. (11.2)

min ǫ = E{e 2 [n]}. (11.2) C H A P T E R 11 Wiener Filtering INTRODUCTION In this chapter we will consider the use of LTI systems in order to perform minimum mean-square-error (MMSE) estimation of a WSS random process of interest,

More information

4.3 Moving Average Process MA(q)

4.3 Moving Average Process MA(q) 66 CHAPTER 4. STATIONARY TS MODELS 4.3 Moving Average Process MA(q) Definition 4.5. {X t } is a moving-average process of order q if X t = Z t + θ 1 Z t 1 +... + θ q Z t q, (4.9) where and θ 1,...,θ q

More information

Solutions to Midterm Exam

Solutions to Midterm Exam &C 411, Solutions to Midterm xam, Spring 5, G Gong 1 Solutions to Midterm xam Question 1 Solution a) The signal-to-quantization noise ratio is given by SNR o σ X /1 where is the quantization step size

More information

Digital Transmission (Line Coding)

Digital Transmission (Line Coding) Digital Transmission (Line Coding) Pulse Transmission Source Multiplexer Line Coder Line Coding: Output of the multiplexer (TDM) is coded into electrical pulses or waveforms for the purpose of transmission

More information

3.5.1 CORRELATION MODELS FOR FREQUENCY SELECTIVE FADING

3.5.1 CORRELATION MODELS FOR FREQUENCY SELECTIVE FADING Environment Spread Flat Rural.5 µs Urban 5 µs Hilly 2 µs Mall.3 µs Indoors.1 µs able 3.1: ypical delay spreads for various environments. If W > 1 τ ds, then the fading is said to be frequency selective,

More information

NRZ Bandwidth - HF Cutoff vs. SNR

NRZ Bandwidth - HF Cutoff vs. SNR Application Note: HFAN-09.0. Rev.2; 04/08 NRZ Bandwidth - HF Cutoff vs. SNR Functional Diagrams Pin Configurations appear at end of data sheet. Functional Diagrams continued at end of data sheet. UCSP

More information

Principles of Communications

Principles of Communications Principles of Communications Chapter 5: Digital Transmission through Bandlimited Channels Selected from Chapter 9.1-9.4 of Fundamentals of Communications Systems, Pearson Prentice Hall 2005, by Proakis

More information

Some notes on the Power Spectral Density of Random Processes. S. Tubaro July 4, 2011

Some notes on the Power Spectral Density of Random Processes. S. Tubaro July 4, 2011 Some notes on the Power Spectral Density of Random Processes S. Tubaro July 4, 20 Contents Energy/Power Spectral Density for Continuous Deterministic Signals 3 2 Energy/Power Spectral Density for Discrete

More information

6 Digital transmission of analog signals

6 Digital transmission of analog signals 6 Digital transmission of analog signals 6.1 Sampling of signals Sampling: A continuous time signal x(t) is converted into a corresponding sequences of samples such that the continuous time signal x(t)

More information

1B Paper 6: Communications Handout 1: Introduction, Signals, and Channels

1B Paper 6: Communications Handout 1: Introduction, Signals, and Channels 1B Paper 6: Communications Handout 1: Introduction, Signals, and Channels Ramji Venkataramanan Signal Processing and Communications Lab Department of Engineering ramji.v@eng.cam.ac.uk Lent Term 2016 1

More information

Nonlinear Systems and Control Lecture # 1 Introduction. p. 1/1

Nonlinear Systems and Control Lecture # 1 Introduction. p. 1/1 Nonlinear Systems and Control Lecture # 1 Introduction p. 1/1 p. 2/1 Nonlinear State Model ẋ 1 = f 1 (t, x 1,..., x n, u 1,..., u p ) ẋ 2 = f 2 (t, x 1,..., x n, u 1,..., u p ).. ẋ n = f n (t, x 1,...,

More information

!"#$%&'()*+#& - SAMPLING -

!#$%&'()*+#& - SAMPLING - !"#$%&'()*+#& - SAMPLING -!"#$%&'(!$# $)*!+!#%!,#$-$+)*!+!#,,#.//01234# 67&+)+!#8##9##',!:6;)#5##9##',!

More information

What is a Filter? Output Signal. Input Signal Amplitude. Frequency. Low Pass Filter

What is a Filter? Output Signal. Input Signal Amplitude. Frequency. Low Pass Filter What is a Filter? Input Signal Amplitude Output Signal Frequency Time Sequence Low Pass Filter Time Sequence What is a Filter Input Signal Amplitude Output Signal Frequency Signal Noise Signal Noise Frequency

More information

12.1 Fourier Transform of Discretely Sampled Data

12.1 Fourier Transform of Discretely Sampled Data 500 Chapter 12. Fast Fourier Transform PSD-per-unit-time converges to finite values at all frequencies except those where h(t) has a discrete sine-wave (or cosine-wave) component of finite amplitude. At

More information

Power Spectral Density

Power Spectral Density C H A P E R 0 Power Spectral Density INRODUCION Understanding how the strength of a signal is distributed in the frequency domain, relative to the strengths of other ambient signals, is central to the

More information

II.B Baseband Transmission (Reception & Applications)

II.B Baseband Transmission (Reception & Applications) II.B Baseband Transmission (Reception & Applications) Digital Baseband Reception Matched filter Definition Implementation (correlator) Application to digital baseband signal M-ary Baseband Reception Brief

More information

ECE 275B Homework # 3 Solutions Winter 2015

ECE 275B Homework # 3 Solutions Winter 2015 ECE 275B Homework # 3 Solutions Winter 25. Kay. I) Use of the prior pdf p(θ) = δ(θ θ ) means that we are % certain that θ = θ. In this case, one computes θ MSE = θ MAP = θ regardless of the quality and

More information

Extensions and Variations on the Kalman Filter

Extensions and Variations on the Kalman Filter Extensions and Variations on the Kalman Filter The Information Filter - rewriting the KF recursion in terms of Based on the Matrix Inversion Lemma/Woodbury-Sherman-Morrison formula Liewise (A + BD 1 C)

More information

ORTHOGONALITY CRITERIA FOR OPTIMALITY

ORTHOGONALITY CRITERIA FOR OPTIMALITY MINIMUM MEAN-SQUARED ERROR LINEAR ESTIMATION Consider the task of linearly estimating random variable Y from random variables X 1,...,X N with minimum mean squared error (MSE). That is, we wish to choose

More information

Unit 3 Spread Spectrum Modulation

Unit 3 Spread Spectrum Modulation Unit 3 Spread Spectrum Modulation Instructor: Sau-Hsuan Wu Dept. of Electrical and Computer Eng., NCTU 1 What is spread spectrum modulation? A means of transmission in which data sequences occupy a bandwidth

More information

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA ABSTRACT Random vibration is becoming increasingly recognized as the most realistic method of simulating the dynamic environment of military

More information

Notes on Random Processes

Notes on Random Processes otes on Random Processes Brian Borchers and Rick Aster October 25, 2011 A Brief Review of Probability In this section of the course, we will work with random variables which are denoted by capital letters,

More information

8 Kinematic Models for Target Tracking

8 Kinematic Models for Target Tracking Technion Israel Institute of Technology, Department of Electrical Engineering Estimation and Identification in Dynamical Systems (04885) Lecture Notes, Fall 009, Prof. N. Shimkin 8 Kinematic Models for

More information

EE 179 April 21, 2014 Digital and Analog Communication Systems Handout #16 Homework #2 Solutions

EE 179 April 21, 2014 Digital and Analog Communication Systems Handout #16 Homework #2 Solutions EE 79 April, 04 Digital and Analog Communication Systems Handout #6 Homework # Solutions. Operations on signals (Lathi& Ding.3-3). For the signal g(t) shown below, sketch: a. g(t 4); b. g(t/.5); c. g(t

More information

The Hilbert Transform

The Hilbert Transform The Hilbert Transform Frank R. Kschischang The Edward S. Rogers Sr. Department of Electrical and Computer Engineering University of Toronto October 22, 2006 1 Definition The Hilbert transform H[g(t)] of

More information

Chapter 3. Digital Communication Fundamentals for Cognitive Radio

Chapter 3. Digital Communication Fundamentals for Cognitive Radio Chapter 3 Digital Communication Fundamentals for Cognitive Radio 1 Outline Fundamental of Data Transmission Digital Modulation Techniques Probability of Bit Error Multicarrier Modulation Multicarrier Equlization

More information

Moments and Polyspectra of the Discrete-Time Random Telegraph Signal

Moments and Polyspectra of the Discrete-Time Random Telegraph Signal IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 46, NO. 7, NOVEMBER 2000 2735 Moments and Polyspectra of the Discrete-Time Random Telegraph Signal Bernard Picinbono, Fellow, IEEE Abstract The random telegraph

More information

Performance Analysis of DS-CDMA Receiver in Presence of Partial Band Jamming

Performance Analysis of DS-CDMA Receiver in Presence of Partial Band Jamming 13 th International Conference on AEROSPACE SCIENCES & AVIATION TECHNOLOGY, ASAT- 13, May 26 28, 2009, E-Mail: asat@mtc.edu.eg Military Technical College, Kobry Elkobbah, Cairo, Egypt Tel : +(202) 24025292

More information

M5MS09. Graphical Modelling

M5MS09. Graphical Modelling Course: MMS09 Setter: Walden Checker: Ginzberg Editor: Calderhead External: Wood Date: April, 0 MSc EXAMINATIONS (STATISTICS) May-June 0 MMS09 Graphical Modelling Setter s signature Checker s signature

More information

Basics of the Probability Theory

Basics of the Probability Theory Basics of the Probability Theory (Com S 477/577 Notes) Yan-Bin Jia Dec 8, 2016 1 Probability and Random Variable Suppose we run an experiment like throwing a die a number of times. Sometimes six dots show

More information

Maximum Entropy. Information Theory 2013 Lecture 9 Chapter 12. Tohid Ardeshiri. May 22, 2013

Maximum Entropy. Information Theory 2013 Lecture 9 Chapter 12. Tohid Ardeshiri. May 22, 2013 Maximum Entropy Information Theory 2013 Lecture 9 Chapter 12 Tohid Ardeshiri May 22, 2013 Why Maximum Entropy distribution? max f (x) h(f ) subject to E r(x) = α Temperature of a gas corresponds to the

More information

Topic 4: Continuous-Time Fourier Transform (CTFT)

Topic 4: Continuous-Time Fourier Transform (CTFT) ELEC264: Signals And Systems Topic 4: Continuous-Time Fourier Transform (CTFT) Aishy Amer Concordia University Electrical and Computer Engineering o Introduction to Fourier Transform o Fourier transform

More information

ST 371 (VIII): Theory of Joint Distributions

ST 371 (VIII): Theory of Joint Distributions ST 371 (VIII): Theory of Joint Distributions So far we have focused on probability distributions for single random variables. However, we are often interested in probability statements concerning two or

More information

Discrete Kalman Filter Tutorial

Discrete Kalman Filter Tutorial Discrete Kalman Filter Tutorial Gabriel A. Terejanu Department of Computer Science and Engineering University at Buffalo, Buffalo, NY 14260 terejanu@buffalo.edu 1 Introduction Consider the following stochastic

More information

Examples of Stationary Time Series

Examples of Stationary Time Series Statistics 91, #2 1 Overview Examples of Stationary Time Series 1. Stationarity 2. Linear processes 3. Cyclic models 4. Nonlinear models Stationarity Strict stationarity (Defn 1.6) Probability distribution

More information

SYSM 6304: Risk and Decision Analysis Lecture 3 Monte Carlo Simulation

SYSM 6304: Risk and Decision Analysis Lecture 3 Monte Carlo Simulation SYSM 6304: Risk and Decision Analysis Lecture 3 Monte Carlo Simulation M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu September 19, 2015 Outline

More information

ECE 45 Homework 4 Solutions

ECE 45 Homework 4 Solutions Spring 26 ECE 45 Homework 4 Solutions Problem. The signal y(t) is generated by convolving a band-limited signal x (t) with another bandlimited signal x 2(t), that is, where, y(t) = x (t) x 2 (t) X (ω)

More information

cq( xxˆ, ) cu( xxˆ, ) - 2 d - 2

cq( xxˆ, ) cu( xxˆ, ) - 2 d - 2 Contents 8 Parameter Estimation 2 8.1 Estimation of a random parameter...................... 3 8.1.1 Bayes risk............................... 4 8.1.2 Minimum mean square error estimators (MMSE)..........

More information