Signal Detection. Outline. Detection Theory. Example Applications of Detection Theory



Similar documents
Lecture 8: Signal Detection and Noise Assumption

Signal Detection C H A P T E R SIGNAL DETECTION AS HYPOTHESIS TESTING

Introduction to Detection Theory

Radar Systems Engineering Lecture 6 Detection of Signals in Noise

The CUSUM algorithm a small review. Pierre Granjon

Time-frequency segmentation : statistical and local phase analysis

E190Q Lecture 5 Autonomous Robot Navigation

STATISTICA Formula Guide: Logistic Regression. Table of Contents

67 Detection: Determining the Number of Sources

Least Squares Estimation

Basics of Floating-Point Quantization

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department sss40@eng.cam.ac.

COMPARED PERFORMANCES OF MF-BASED AND LOCALLY OPTIMAL-BASED MAGNETIC ANOMALY DETECTION

Detection of Magnetic Anomaly Using Total Field Magnetometer

Department of Electrical and Computer Engineering Ben-Gurion University of the Negev. LAB 1 - Introduction to USRP

T = 1 f. Phase. Measure of relative position in time within a single period of a signal For a periodic signal f(t), phase is fractional part t p

Log-Likelihood Ratio-based Relay Selection Algorithm in Wireless Network

Convolution. 1D Formula: 2D Formula: Example on the web:

TCOM 370 NOTES 99-4 BANDWIDTH, FREQUENCY RESPONSE, AND CAPACITY OF COMMUNICATION LINKS

Exploiting A Constellation of Narrowband RF Sensors to Detect and Track Moving Targets

CCNY. BME I5100: Biomedical Signal Processing. Linear Discrimination. Lucas C. Parra Biomedical Engineering Department City College of New York

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

A Statistical Framework for Operational Infrasound Monitoring

Interpreting Kullback-Leibler Divergence with the Neyman-Pearson Lemma

Adaptive Equalization of binary encoded signals Using LMS Algorithm

Digital Modulation. David Tipper. Department of Information Science and Telecommunications University of Pittsburgh. Typical Communication System

Lecture 14. Point Spread Function (PSF)

MIMO CHANNEL CAPACITY

Introduction to General and Generalized Linear Models

Coding and decoding with convolutional codes. The Viterbi Algor

5 Signal Design for Bandlimited Channels

System Aware Cyber Security

Two-Sample T-Tests Assuming Equal Variance (Enter Means)

Introduction to Mobile Robotics Bayes Filter Particle Filter and Monte Carlo Localization

Example: Credit card default, we may be more interested in predicting the probabilty of a default than classifying individuals as default or not.

Advanced Signal Processing and Digital Noise Reduction

1 Maximum likelihood estimation

LOGISTIC REGRESSION. Nitin R Patel. where the dependent variable, y, is binary (for convenience we often code these values as

Two-Sample T-Tests Allowing Unequal Variance (Enter Difference)

Multisensor Data Fusion and Applications

Implementation of Digital Signal Processing: Some Background on GFSK Modulation

Master s Theory Exam Spring 2006

Maximum likelihood estimation of mean reverting processes

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

An introduction to OBJECTIVE ASSESSMENT OF IMAGE QUALITY. Harrison H. Barrett University of Arizona Tucson, AZ

How To Check For Differences In The One Way Anova

Online Filtering for Radar Detection of Meteors

PHASE ESTIMATION ALGORITHM FOR FREQUENCY HOPPED BINARY PSK AND DPSK WAVEFORMS WITH SMALL NUMBER OF REFERENCE SYMBOLS

Penalized regression: Introduction

INFERRING TRADING STRATEGIES FROM PROBABILITY DISTRIBUTION FUNCTIONS

Moral Hazard. Itay Goldstein. Wharton School, University of Pennsylvania

Maximum Likelihood Estimation of ADC Parameters from Sine Wave Test Data. László Balogh, Balázs Fodor, Attila Sárhegyi, and István Kollár

STUDY OF MUTUAL INFORMATION IN PERCEPTUAL CODING WITH APPLICATION FOR LOW BIT-RATE COMPRESSION

Logistic Regression. Jia Li. Department of Statistics The Pennsylvania State University. Logistic Regression

A New Interpretation of Information Rate

SAS Software to Fit the Generalized Linear Model

Decision Theory Rational prospecting

Ex. 2.1 (Davide Basilio Bartolini)

TTT4110 Information and Signal Theory Solution to exam

The Effect of Network Cabling on Bit Error Rate Performance. By Paul Kish NORDX/CDT

Jitter Measurements in Serial Data Signals

Application Note Noise Frequently Asked Questions

Understanding and Applying Kalman Filtering

Broadband Networks. Prof. Dr. Abhay Karandikar. Electrical Engineering Department. Indian Institute of Technology, Bombay. Lecture - 29.

Monitoring of Internet traffic and applications

Lecture 5: Variants of the LMS algorithm

The Wondrous World of fmri statistics

Lezione 6 Communications Blockset

MATHEMATICAL METHODS OF STATISTICS

Solutions to Exam in Speech Signal Processing EN2300

MATRIX TECHNICAL NOTES


Discrete Frobenius-Perron Tracking

STA 4273H: Statistical Machine Learning

Using median filtering in active queue management for telecommunication networks

12: Analysis of Variance. Introduction

Dynamic Process Modeling. Process Dynamics and Control

Conquering Noise for Accurate RF and Microwave Signal Measurements. Presented by: Ernie Jackson

Chapter 6: Multivariate Cointegration Analysis

Accurate Loss-of-Signal Detection in 10Gbps Optical Receivers using the MAX3991

Descriptive Statistics

NRZ Bandwidth - HF Cutoff vs. SNR

Monotonicity Hints. Abstract

Chapter 2 Probability Topics SPSS T tests

Pattern Recognition and Prediction in Equity Market

Message-passing sequential detection of multiple change points in networks

Statistics in Retail Finance. Chapter 6: Behavioural models

IN current film media, the increase in areal density has

The p-norm generalization of the LMS algorithm for adaptive filtering

Cyber-Security Analysis of State Estimators in Power Systems

Multivariate Normal Distribution

PROBABILITY AND STATISTICS. Ma To teach a knowledge of combinatorial reasoning.

Bayesian probability theory

Fundamentals of modern UV-visible spectroscopy. Presentation Materials

Generalized Linear Models

Data Mining. Cluster Analysis: Advanced Concepts and Algorithms

Transcription:

Outline Signal Detection M. Sami Fadali Professor of lectrical ngineering University of Nevada, Reno Hypothesis testing. Neyman-Pearson (NP) detector for a known signal in white Gaussian noise (WGN). Matched filter implementation. Detection performance. 1 2 Detection Theory Detection Problem: Decide based on noisy measurements with a measure of confidence 1. If an event occurred or not. 2. Which of a number of possible outcomes has occurred? Statistics: called decision theory. xample Applications of Detection Theory Radar/sonar. Communications. Speech/image processing. Biomedicine. Fault detection. Seismology. 3 4

Radar/Sonar Detect the presence of a target. Transmit an electromagnetic pulse. Test received noisy signal: If a pulse is detected, it was reflected from the target and a target is present. If no pulse is detected then no target is present. Classes of Detection Problems Detect signals from noisy measurements 1. Known signals in additive noise. 2. Deterministic signals with unknown parameters in additive noise. 3. Random signals in additive noise. Typically, assume additive Gaussian noise. 5 6 Known Signals Using one or more noisy measurements decide if the known signal is present. Additive noise: Binary Hypothesis: H 0 or H 1 Statistical Decision: D 0 or D 1 Probability density functions: Possible Outcomes of Binary xperiment 1. D 0 H 0 : correct decision. 2. D 1 H 0 : Type I rror, false alarm. 3. D 1 H 1 : correct decision. 4. D 0 H 1 : Type II rror, miss. 7 8

Radar/ Sonar Terminology Probability of Detection Decompose observation space into two disjoint subspaces: Define the following probabilities: 1. False alarm Density 0.35 0.3 0.25 0.2 0.15 0.1 P D 2. Proper dismissal 0.05 P FA 0-6 -4-2 0 2 4 6 Critical Value 9 10 Likelihood Ratio (LR) Log-likelihood Ratio (LLR) = threshold Different detectors yield different thresholds. Use the likelihood ratio to decide. Both sides of the inequality are positive. Log is an order preserving transformation. Often more convenient (exponential pdfs). 11 12

Neyman-Pearson Criterion Select the threshold level NP Criterion: Maximize the probability of detection such that the probability of false alarm remains below a specified level. Maximize s.t. the constraint 13 Matched Filters Known deterministic signal in white Gaussian noise NP criterion: upper bound on probability of false alarm. Detection: distinguish between two hypotheses N 14 Likelihood Ratio Simplify Likelihood Ratio / / / / 15 16

Log-likelihood Ratio NP Detection: Choose to maximize and satisfy the false alarm rate constraint Replica Correlator is the correlation of the data and the known signal (or its replica). weights the data samples with the values of the signal. The larger the signal amplitude the higher the weight. Negative amplitudes have negative weights. 17 18 Replica Correlator Block Diagram Matched Filter x(n) s(n) + N 1 n0 x ( n) s( n) T(x) D 1 ' D 0 19 1 = = Match filter impulse response to the signal. Obtain impulse response by i. Flipping the signal. ii. Right shifting the signal by 1. 20

Matched Filter Block Diagram Matched Filter Remarks Derivation requires known arrival time. x(n) h(n) Close at n = N1 T(x) D 1 ' D 0 Filter output is maximum at N Signal energy the square of the norm of the signal vector. For no additive noise, = signal energy 21 22 Output of Filter: Mean & Variance For any filter with impulse response Signal to Noise Ratio (SNR) SNR ratio of the signal : ratio of signal energy to noise energy. 23 24

Matched Filter Maximizes SNR Consider all possible FIR filters. Maximum signal energy at the output of an FIR filter if and are colinear. Performance of matched filter increases monotonically with the maximum SNR. 25 Matched Filter Performance Obtain for a given. Gaussian: linear combination of Gaussian Mean of Variance of 26 Distribution of Threshold Calculation N N N N Performance improves as increases(snr). Densities move farther apart but have the same shape. 27 = right tail probability for N Solve for 28

NP Detection Probability Normalize: standard normal N 29 Non-Gaussian Noise Known deterministic signal in white Gaussian noise: NP criterion and the max SNR criterion give the matched filter detector. Non-Gaussian noise 1. Matched filter detector is not NP optimal but still maximizes SNR. 2. NP filter is nonlinear but the linear filter works well for moderate deviations from Gaussian. 30 References R. D. Hippenstiel, Detection Theory: Application and Digital Signal Processing, CRC Press, Boca Raton, 2002. S. M. Kay, Fundamentals of Statistical Signal Processing, Volume II Detection Theory, Prentice-Hall, Upper Saddle River, NJ, 1998. 31