Stefanos D. Georgiadis Perttu O. Ranta-aho Mika P. Tarvainen Pasi A. Karjalainen. University of Kuopio Department of Applied Physics Kuopio, FINLAND

Size: px
Start display at page:

Download "Stefanos D. Georgiadis Perttu O. Ranta-aho Mika P. Tarvainen Pasi A. Karjalainen. University of Kuopio Department of Applied Physics Kuopio, FINLAND"

Transcription

1 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland Stefanos D. Georgiadis Perttu O. Ranta-aho Mika P. Tarvainen Pasi A. Karjalainen University of Kuopio Department of Applied Physics Kuopio, FINLAND Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 1

2 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland INTRODUCTION To understand human neurophysiology, we relay on several types of non-invasive neuroimaging techniques. These techniques include electroencephalography (EEG), magnetoencephalography (MEG), anatomical magnetic resonance imaging (MRI) and functional MRI (fmri). Neural activity in the cerebral cortex generates small electric currents which create potential differences on the surface of the scalp (detected by EEG). EEG recording is a useful tool for studying the functional states of the brain and for diagnosing certain neurophysiological states and disorders. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 2

3 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland NOISE One of the challenging tasks is how to reliably detect, enhance and estimate very week, non stationary brain signals corrupted by noise. E.g. De-noising or estimation of Event Related Potentials (ERPs). Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 3

4 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland EVENT RELATED POTENTIALS (ERPs) ERPs are voltage changes of brain electric activity due to stimulation, e.g external auditory. The simplest way to investigate them is to use ensemble averages of time-locked EEG data epochs. The investigation of the variability of ERP parameters can be used to reveal information related to changes of the cognitive state. Single-trial analysis methods are under concern. Different methods exist, e.g. digital filtering, wavelets, or multichannel methods, e.g Independent Component Analysis. Here we focus on single-trial single channel ERP estimation. We are interested in cases that the ERPs have dynamic changes form trial-to-trial, e.g. some trend at the amplitude or latency of some peak. Recursive estimation methods can be used to track such changes. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 4

5 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland SINGLE-TRIAL ERP EXTRACTION Preprocessing (e.g. bandpass 1-4Hz) Channel CZ Stim. no. 1 Stim. no. 2 Stim. no. 3 Stim. no. 4 Amplitude and latency of different peaks Ensemble Average 1 N1 N P3 Single-trial estimation Difficulties with low frequencies. Spectra of the unknown interesting activity and background noise overlap heavily. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 5

6 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland ERP ESTIMATION The sampled ERP measurement of length M at stimulus t, t = 1, 2,..., T can be denoted with the column vector: z t = (z t,1, z t,2,..., z t,m ) T, (measurement epoch) ERPs can be modeled as a linear combination of some preselected basis vectors z t = H t θ t + υ t, (additive noise model) Ht, observation model, basis vectors of length M it its columns. st = H t θ t, part of the activity that is related to the stimulation. υt, noise vector. θt parameter vector to be estimated, e.g. Least Squares. ŝt = H t ˆθt, the estimated response. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 6

7 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland STATE-SPACE FORMALISM Of special interest is the case that some characteristics of the ERPs change dynamically from stimulus to stimulus. This case can be naturally modeled with a state-space model θ t+1 = F t θ t + ω t, (state equation) The hidden states are not observed directly, but through the measurement model z t = H t θ t + υ t, (space equation) Ft, known matrices, for F t = I we have a random walk model. ωt is white noise vector process, independent of θ and υ t. The covariance matrices Cυt and C ωt are known. Estimators for the parameters optimal in the mean square sense are given by Kalman filter and smoother algorithms. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 7

8 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland RECURSIVE MEAN SQUARE ESTIMATION The mean square estimator for the state θt given the past and present observations z 1,..., z t is given by the conditional mean ˆθ t = E{θ t z 1,..., z t }. If the processes υt and ω t are Gaussian then this estimator is linear and maximizes the posterior density p(θ t z 1,..., z t ), Bayesian maximum a posteriori estimator (MAP). Recursive solution (linear mean square) for the problem is given by Kalman filter algorithm. If all the data set is available, the mean square estimator given all observations z 1,..., z T is given by the conditional mean ˆθ s t = E{θ t z 1,..., z T }. And solution is obtained by Kalman smoother algorithm. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 8

9 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland KALMAN FILTER AND SMOOTHER Kalman filter equations can be written as ˆθ t t 1 = F t 1 ˆθt 1 C θt t 1 = F t 1 C θt 1 F T t 1 + C wt 1 K t = C θt t 1 H T t (H t C θt t 1 H T t + C υt ) 1 C θt = (I K t H t )C θt t 1 ˆθ t = ˆθt t 1 + K t (z t H t ˆθt t 1 ), θ t is the state estimation error θ t = θ t ˆθ t, C denotes covariance matrices and K t is the Kalman gain matrix. The solution for the fixed-interval Kalman smoother is ˆθ t s = ˆθt + A t (ˆθ t+1 s ˆθ t+1 t ) A t = F T C θt t C 1, θ t+1 t error covariances and Kalman filter state estimates need to be stored. ˆθ s t are then obtained by running backward in time. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 9

10 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland MEASUREMENTS AND SIMULATIONS simulations noisy simulations 4 epochs and mean Simulations resembling P3 type responses. As linear combinations of 3 Gaussian shaped functions, sinusoidal+random variability for both amplitude, latency of the third peak. Noisy simulations, prestimulus EEG as additive noise real measurments P3 responses from an odd-ball paradigm with auditory stimuli, channel CZ, sampling rate 5Hz, bandpass 1-4Hz. Epochs form -1ms to 6ms relative to deviant stimuli time. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 1

11 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland RESULTS: IMAGE PLOTS Kalman filter Estimates for simulations Kalman smoother epochs and mean Estimates for real measurements Kalman filter epochs and mean Kalman smoother Columns Observation model H Observation model 3 time shifted Gaussian shaped functions, random walk model: H t = H, F t = I, C υt = I, C ωt =.1I, t. Same selections for Kalman filter and smoother and for simulations and real data. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 11

12 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland RESULTS: DYNAMIC VARIABILITY time interval data points Simulations Time interval for the computation of amplitudes and latencies of the 3 peak, simple max. Time-lag (noiseless) Amplitude trends (simulations) Amplitude trends (real data) Real data Latency trends (simulations) Latency trends (real data) MSE KF noisy KF KS noisy KS State noise variance parameter Average of the Mean Square Error C υt = I, C ωt = σ 2 ωi Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 12

13 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland RESULTS: SINGLE TRIALS Single-Trial Estimates simulations: stim real data: stim simulations: stim real data: stim Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 13

14 5 Finnish Signal Processing Symposium (Finsig 5) Kuopio, Finland CONCLUSIONS Recursive mean square estimations methods provide excellent single-trial ERP estimates in realistic noise conditions. The methods are suitable when some characteristics of the ERPs change dynamically from trial-to-trial, e.g. habituations to stimulation, fatigue, and other time varying effects. The benefit of the Kalman smoother approach is the avoidance of the time-lag in the estimates. Kalman filter can be used for on line estimation, e.g. measuring the depth of anesthesia. Data based observation models can also be used, e.g. eigenvectors of the data correlation matrix There are extensions of the method for multichannel simultaneous processing Improvement of the methods relates to the so called state-space identification procedures for the time evolution of the states. Stefanos D. Georgiadis, Department of Applied Physics, University of Kuopio Slide 14

Cognitive Neuroscience. Questions. Multiple Methods. Electrophysiology. Multiple Methods. Approaches to Thinking about the Mind

Cognitive Neuroscience. Questions. Multiple Methods. Electrophysiology. Multiple Methods. Approaches to Thinking about the Mind Cognitive Neuroscience Approaches to Thinking about the Mind Cognitive Neuroscience Evolutionary Approach Sept 20-22, 2004 Interdisciplinary approach Rapidly changing How does the brain enable cognition?

More information

Documentation Wadsworth BCI Dataset (P300 Evoked Potentials) Data Acquired Using BCI2000's P3 Speller Paradigm (http://www.bci2000.

Documentation Wadsworth BCI Dataset (P300 Evoked Potentials) Data Acquired Using BCI2000's P3 Speller Paradigm (http://www.bci2000. Documentation Wadsworth BCI Dataset (P300 Evoked Potentials) Data Acquired Using BCI2000's P3 Speller Paradigm (http://www.bci2000.org) BCI Competition III Challenge 2004 Organizer: Benjamin Blankertz

More information

Functional neuroimaging. Imaging brain function in real time (not just the structure of the brain).

Functional neuroimaging. Imaging brain function in real time (not just the structure of the brain). Functional neuroimaging Imaging brain function in real time (not just the structure of the brain). The brain is bloody & electric Blood increase in neuronal activity increase in metabolic demand for glucose

More information

Probability and Random Variables. Generation of random variables (r.v.)

Probability and Random Variables. Generation of random variables (r.v.) Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly

More information

Bayesian probability theory

Bayesian probability theory Bayesian probability theory Bruno A. Olshausen arch 1, 2004 Abstract Bayesian probability theory provides a mathematical framework for peforming inference, or reasoning, using probability. The foundations

More information

Classic EEG (ERPs)/ Advanced EEG. Quentin Noirhomme

Classic EEG (ERPs)/ Advanced EEG. Quentin Noirhomme Classic EEG (ERPs)/ Advanced EEG Quentin Noirhomme Outline Origins of MEEG Event related potentials Time frequency decomposition i Source reconstruction Before to start EEGlab Fieldtrip (included in spm)

More information

Overview of Methodology. Human Electrophysiology. Computing and Displaying Difference Waves. Plotting The Averaged ERP

Overview of Methodology. Human Electrophysiology. Computing and Displaying Difference Waves. Plotting The Averaged ERP Human Electrophysiology Overview of Methodology This Week: 1. Displaying ERPs 2. Defining ERP components Analog Filtering Amplification Montage Selection Analog-Digital Conversion Signal-to-Noise Enhancement

More information

Single trial analysis for linking electrophysiology and hemodynamic response. Christian-G. Bénar INSERM U751, Marseille christian.benar@univmed.

Single trial analysis for linking electrophysiology and hemodynamic response. Christian-G. Bénar INSERM U751, Marseille christian.benar@univmed. Single trial analysis for linking electrophysiology and hemodynamic response Christian-G. Bénar INSERM U751, Marseille christian.benar@univmed.fr Neuromath meeting Leuven March 12-13, 29 La Timone MEG

More information

Component Ordering in Independent Component Analysis Based on Data Power

Component Ordering in Independent Component Analysis Based on Data Power Component Ordering in Independent Component Analysis Based on Data Power Anne Hendrikse Raymond Veldhuis University of Twente University of Twente Fac. EEMCS, Signals and Systems Group Fac. EEMCS, Signals

More information

System Identification for Acoustic Comms.:

System Identification for Acoustic Comms.: System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation

More information

CCNY. BME I5100: Biomedical Signal Processing. Linear Discrimination. Lucas C. Parra Biomedical Engineering Department City College of New York

CCNY. BME I5100: Biomedical Signal Processing. Linear Discrimination. Lucas C. Parra Biomedical Engineering Department City College of New York BME I5100: Biomedical Signal Processing Linear Discrimination Lucas C. Parra Biomedical Engineering Department CCNY 1 Schedule Week 1: Introduction Linear, stationary, normal - the stuff biology is not

More information

Kristine L. Bell and Harry L. Van Trees. Center of Excellence in C 3 I George Mason University Fairfax, VA 22030-4444, USA kbell@gmu.edu, hlv@gmu.

Kristine L. Bell and Harry L. Van Trees. Center of Excellence in C 3 I George Mason University Fairfax, VA 22030-4444, USA kbell@gmu.edu, hlv@gmu. POSERIOR CRAMÉR-RAO BOUND FOR RACKING ARGE BEARING Kristine L. Bell and Harry L. Van rees Center of Excellence in C 3 I George Mason University Fairfax, VA 22030-4444, USA bell@gmu.edu, hlv@gmu.edu ABSRAC

More information

Neural Decoding of Cursor Motion Using a Kalman Filter

Neural Decoding of Cursor Motion Using a Kalman Filter Neural Decoding of Cursor Motion Using a Kalman Filter W. Wu M. J. Black Y. Gao E. Bienenstock M. Serruya A. Shaikhouni J. P. Donoghue Division of Applied Mathematics, Dept. of Computer Science, Dept.

More information

11. Time series and dynamic linear models

11. Time series and dynamic linear models 11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

Analysis of Bayesian Dynamic Linear Models

Analysis of Bayesian Dynamic Linear Models Analysis of Bayesian Dynamic Linear Models Emily M. Casleton December 17, 2010 1 Introduction The main purpose of this project is to explore the Bayesian analysis of Dynamic Linear Models (DLMs). The main

More information

Supporting Information

Supporting Information S1 Supporting Information GFT NMR, a New Approach to Rapidly Obtain Precise High Dimensional NMR Spectral Information Seho Kim and Thomas Szyperski * Department of Chemistry, University at Buffalo, The

More information

Data Analysis Methods: Net Station 4.1 By Peter Molfese

Data Analysis Methods: Net Station 4.1 By Peter Molfese Data Analysis Methods: Net Station 4.1 By Peter Molfese Preparing Data for Statistics (preprocessing): 1. Rename your files to correct any typos or formatting issues. a. The General format for naming files

More information

Java Modules for Time Series Analysis

Java Modules for Time Series Analysis Java Modules for Time Series Analysis Agenda Clustering Non-normal distributions Multifactor modeling Implied ratings Time series prediction 1. Clustering + Cluster 1 Synthetic Clustering + Time series

More information

EE 570: Location and Navigation

EE 570: Location and Navigation EE 570: Location and Navigation On-Line Bayesian Tracking Aly El-Osery 1 Stephen Bruder 2 1 Electrical Engineering Department, New Mexico Tech Socorro, New Mexico, USA 2 Electrical and Computer Engineering

More information

Online Chapter 11 A Closer Look at Averaging: Convolution, Latency Variability, and Overlap

Online Chapter 11 A Closer Look at Averaging: Convolution, Latency Variability, and Overlap Overview Online Chapter 11 A Closer Look at Averaging: Convolution, Latency Variability, and Overlap You might think that we discussed everything there is to know about averaging in the chapter on averaging

More information

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA ABSTRACT Random vibration is becoming increasingly recognized as the most realistic method of simulating the dynamic environment of military

More information

Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement

Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement Toshio Sugihara Abstract In this study, an adaptive

More information

Short-time FFT, Multi-taper analysis & Filtering in SPM12

Short-time FFT, Multi-taper analysis & Filtering in SPM12 Short-time FFT, Multi-taper analysis & Filtering in SPM12 Computational Psychiatry Seminar, FS 2015 Daniel Renz, Translational Neuromodeling Unit, ETHZ & UZH 20.03.2015 Overview Refresher Short-time Fourier

More information

2 Neurons. 4 The Brain: Cortex

2 Neurons. 4 The Brain: Cortex 1 Neuroscience 2 Neurons output integration axon cell body, membrane potential Frontal planning control auditory episodes soma motor Temporal Parietal action language objects space vision Occipital inputs

More information

Chapter 10 Introduction to Time Series Analysis

Chapter 10 Introduction to Time Series Analysis Chapter 1 Introduction to Time Series Analysis A time series is a collection of observations made sequentially in time. Examples are daily mortality counts, particulate air pollution measurements, and

More information

An Introduction to ERP Studies of Attention

An Introduction to ERP Studies of Attention An Introduction to ERP Studies of Attention Logan Trujillo, Ph.D. Post-Doctoral Fellow University of Texas at Austin Cognitive Science Course, Fall 2008 What is Attention? Everyone knows what attention

More information

Cortical Source Localization of Human Scalp EEG. Kaushik Majumdar Indian Statistical Institute Bangalore Center

Cortical Source Localization of Human Scalp EEG. Kaushik Majumdar Indian Statistical Institute Bangalore Center Cortical Source Localization of Human Scalp EEG Kaushik Majumdar Indian Statistical Institute Bangalore Center Cortical Basis of Scalp EEG Baillet et al, IEEE Sig Proc Mag, Nov 2001, p 16 Mountcastle,

More information

The Wondrous World of fmri statistics

The Wondrous World of fmri statistics Outline The Wondrous World of fmri statistics FMRI data and Statistics course, Leiden, 11-3-2008 The General Linear Model Overview of fmri data analysis steps fmri timeseries Modeling effects of interest

More information

Obtaining Knowledge. Lecture 7 Methods of Scientific Observation and Analysis in Behavioral Psychology and Neuropsychology.

Obtaining Knowledge. Lecture 7 Methods of Scientific Observation and Analysis in Behavioral Psychology and Neuropsychology. Lecture 7 Methods of Scientific Observation and Analysis in Behavioral Psychology and Neuropsychology 1.Obtaining Knowledge 1. Correlation 2. Causation 2.Hypothesis Generation & Measures 3.Looking into

More information

Brain Computer Interfaces (BCI) Communication Training of brain activity

Brain Computer Interfaces (BCI) Communication Training of brain activity Brain Computer Interfaces (BCI) Communication Training of brain activity Brain Computer Interfaces (BCI) picture rights: Gerwin Schalk, Wadsworth Center, NY Components of a Brain Computer Interface Applications

More information

ERPs in Cognitive Neuroscience

ERPs in Cognitive Neuroscience Center for Neuroscience UNIVERSITY OF CALIFORNIA AT DAVIS ERPs in Cognitive Neuroscience Charan Ranganath Center for Neuroscience and Dept of Psychology, UC Davis EEG and MEG Neuronal activity generates

More information

5 Transforming Time Series

5 Transforming Time Series 5 Transforming Time Series In many situations, it is desirable or necessary to transform a time series data set before using the sophisticated methods we study in this course: 1. Almost all methods assume

More information

Linear regression methods for large n and streaming data

Linear regression methods for large n and streaming data Linear regression methods for large n and streaming data Large n and small or moderate p is a fairly simple problem. The sufficient statistic for β in OLS (and ridge) is: The concept of sufficiency is

More information

EEG COHERENCE AND PHASE DELAYS: COMPARISONS BETWEEN SINGLE REFERENCE, AVERAGE REFERENCE AND CURRENT SOURCE DENSITY

EEG COHERENCE AND PHASE DELAYS: COMPARISONS BETWEEN SINGLE REFERENCE, AVERAGE REFERENCE AND CURRENT SOURCE DENSITY Version 1, June 13, 2004 Rough Draft form We apologize while we prepare the manuscript for publication but the data are valid and the conclusions are fundamental EEG COHERENCE AND PHASE DELAYS: COMPARISONS

More information

MEASURING BRAIN CHANGES IN HEARING LOSS AND ITS REMEDIATION

MEASURING BRAIN CHANGES IN HEARING LOSS AND ITS REMEDIATION MEASURING BRAIN CHANGES IN HEARING LOSS AND ITS REMEDIATION Blake W Johnson 1,3, Stephen Crain 2,3 1 Department of Cognitive Science, Macquarie University 2 Department of Linguistics, Macquarie University

More information

Independence of Visual Awareness from the Scope of Attention: an Electrophysiological Study

Independence of Visual Awareness from the Scope of Attention: an Electrophysiological Study Cerebral Cortex March 2006;16:415-424 doi:10.1093/cercor/bhi121 Advance Access publication June 15, 2005 Independence of Visual Awareness from the Scope of Attention: an Electrophysiological Study Mika

More information

Time Series Analysis

Time Series Analysis Time Series Analysis hm@imm.dtu.dk Informatics and Mathematical Modelling Technical University of Denmark DK-2800 Kgs. Lyngby 1 Outline of the lecture Identification of univariate time series models, cont.:

More information

Complex Network Analysis of Brain Connectivity: An Introduction LABREPORT 5

Complex Network Analysis of Brain Connectivity: An Introduction LABREPORT 5 Complex Network Analysis of Brain Connectivity: An Introduction LABREPORT 5 Fernando Ferreira-Santos 2012 Title: Complex Network Analysis of Brain Connectivity: An Introduction Technical Report Authors:

More information

Lecture 8: Signal Detection and Noise Assumption

Lecture 8: Signal Detection and Noise Assumption ECE 83 Fall Statistical Signal Processing instructor: R. Nowak, scribe: Feng Ju Lecture 8: Signal Detection and Noise Assumption Signal Detection : X = W H : X = S + W where W N(, σ I n n and S = [s, s,...,

More information

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks Chin. J. Astron. Astrophys. Vol. 5 (2005), No. 2, 203 210 (http:/www.chjaa.org) Chinese Journal of Astronomy and Astrophysics Automated Stellar Classification for Large Surveys with EKF and RBF Neural

More information

Basics of Statistical Machine Learning

Basics of Statistical Machine Learning CS761 Spring 2013 Advanced Machine Learning Basics of Statistical Machine Learning Lecturer: Xiaojin Zhu jerryzhu@cs.wisc.edu Modern machine learning is rooted in statistics. You will find many familiar

More information

A Wavelet Based Prediction Method for Time Series

A Wavelet Based Prediction Method for Time Series A Wavelet Based Prediction Method for Time Series Cristina Stolojescu 1,2 Ion Railean 1,3 Sorin Moga 1 Philippe Lenca 1 and Alexandru Isar 2 1 Institut TELECOM; TELECOM Bretagne, UMR CNRS 3192 Lab-STICC;

More information

Solutions to Exam in Speech Signal Processing EN2300

Solutions to Exam in Speech Signal Processing EN2300 Solutions to Exam in Speech Signal Processing EN23 Date: Thursday, Dec 2, 8: 3: Place: Allowed: Grades: Language: Solutions: Q34, Q36 Beta Math Handbook (or corresponding), calculator with empty memory.

More information

Since it is necessary to consider the ability of the lter to predict many data over a period of time a more meaningful metric is the expected value of

Since it is necessary to consider the ability of the lter to predict many data over a period of time a more meaningful metric is the expected value of Chapter 11 Tutorial: The Kalman Filter Tony Lacey. 11.1 Introduction The Kalman lter ë1ë has long been regarded as the optimal solution to many tracing and data prediction tass, ë2ë. Its use in the analysis

More information

ECE 468 / CS 519 Digital Image Processing. Introduction

ECE 468 / CS 519 Digital Image Processing. Introduction ECE 468 / CS 519 Digital Image Processing Introduction Prof. Sinisa Todorovic sinisa@eecs.oregonstate.edu ECE 468: Digital Image Processing Instructor: Sinisa Todorovic sinisa@eecs.oregonstate.edu Office:

More information

CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER

CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER 93 CHAPTER 5 PREDICTIVE MODELING STUDIES TO DETERMINE THE CONVEYING VELOCITY OF PARTS ON VIBRATORY FEEDER 5.1 INTRODUCTION The development of an active trap based feeder for handling brakeliners was discussed

More information

False discovery rate and permutation test: An evaluation in ERP data analysis

False discovery rate and permutation test: An evaluation in ERP data analysis Research Article Received 7 August 2008, Accepted 8 October 2009 Published online 25 November 2009 in Wiley Interscience (www.interscience.wiley.com) DOI: 10.1002/sim.3784 False discovery rate and permutation

More information

Understanding and Applying Kalman Filtering

Understanding and Applying Kalman Filtering Understanding and Applying Kalman Filtering Lindsay Kleeman Department of Electrical and Computer Systems Engineering Monash University, Clayton 1 Introduction Objectives: 1. Provide a basic understanding

More information

An Introduction to the Kalman Filter

An Introduction to the Kalman Filter An Introduction to the Kalman Filter Greg Welch 1 and Gary Bishop 2 TR 95041 Department of Computer Science University of North Carolina at Chapel Hill Chapel Hill, NC 275993175 Updated: Monday, July 24,

More information

MAN-BITES-DOG BUSINESS CYCLES ONLINE APPENDIX

MAN-BITES-DOG BUSINESS CYCLES ONLINE APPENDIX MAN-BITES-DOG BUSINESS CYCLES ONLINE APPENDIX KRISTOFFER P. NIMARK The next section derives the equilibrium expressions for the beauty contest model from Section 3 of the main paper. This is followed by

More information

Least-Squares Intersection of Lines

Least-Squares Intersection of Lines Least-Squares Intersection of Lines Johannes Traa - UIUC 2013 This write-up derives the least-squares solution for the intersection of lines. In the general case, a set of lines will not intersect at a

More information

Probability for Estimation (review)

Probability for Estimation (review) Probability for Estimation (review) In general, we want to develop an estimator for systems of the form: x = f x, u + η(t); y = h x + ω(t); ggggg y, ffff x We will primarily focus on discrete time linear

More information

SPECIAL PERTURBATIONS UNCORRELATED TRACK PROCESSING

SPECIAL PERTURBATIONS UNCORRELATED TRACK PROCESSING AAS 07-228 SPECIAL PERTURBATIONS UNCORRELATED TRACK PROCESSING INTRODUCTION James G. Miller * Two historical uncorrelated track (UCT) processing approaches have been employed using general perturbations

More information

> plot(exp.btgpllm, main = "treed GP LLM,", proj = c(1)) > plot(exp.btgpllm, main = "treed GP LLM,", proj = c(2)) quantile diff (error)

> plot(exp.btgpllm, main = treed GP LLM,, proj = c(1)) > plot(exp.btgpllm, main = treed GP LLM,, proj = c(2)) quantile diff (error) > plot(exp.btgpllm, main = "treed GP LLM,", proj = c(1)) > plot(exp.btgpllm, main = "treed GP LLM,", proj = c(2)) 0.4 0.2 0.0 0.2 0.4 treed GP LLM, mean treed GP LLM, 0.00 0.05 0.10 0.15 0.20 x1 x1 0.4

More information

Signal to Noise Instrumental Excel Assignment

Signal to Noise Instrumental Excel Assignment Signal to Noise Instrumental Excel Assignment Instrumental methods, as all techniques involved in physical measurements, are limited by both the precision and accuracy. The precision and accuracy of a

More information

Extreme Value Modeling for Detection and Attribution of Climate Extremes

Extreme Value Modeling for Detection and Attribution of Climate Extremes Extreme Value Modeling for Detection and Attribution of Climate Extremes Jun Yan, Yujing Jiang Joint work with Zhuo Wang, Xuebin Zhang Department of Statistics, University of Connecticut February 2, 2016

More information

MOVING-WINDOW ICA DECOMPOSITION OF EEG DATA REVEALS EVENT-RELATED CHANGES IN OSCILLATORY BRAIN ACTIVITY

MOVING-WINDOW ICA DECOMPOSITION OF EEG DATA REVEALS EVENT-RELATED CHANGES IN OSCILLATORY BRAIN ACTIVITY MOVING-WINDOW ICA DECOMPOSITION OF EEG DATA REVEALS EVENT-RELATED CHANGES IN OSCILLATORY BRAIN ACTIVITY Scott Makeig*, Sigurd Enghoff (3,4). Tzyy-Ping Jung (3,5,6) and Terrence J. Sejnowski (2,3,5,6) *Naval

More information

Web-based Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni

Web-based Supplementary Materials for Bayesian Effect Estimation. Accounting for Adjustment Uncertainty by Chi Wang, Giovanni 1 Web-based Supplementary Materials for Bayesian Effect Estimation Accounting for Adjustment Uncertainty by Chi Wang, Giovanni Parmigiani, and Francesca Dominici In Web Appendix A, we provide detailed

More information

Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep

Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep Engineering, 23, 5, 88-92 doi:.4236/eng.23.55b8 Published Online May 23 (http://www.scirp.org/journal/eng) Electroencephalography Analysis Using Neural Network and Support Vector Machine during Sleep JeeEun

More information

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm 1 Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm Hani Mehrpouyan, Student Member, IEEE, Department of Electrical and Computer Engineering Queen s University, Kingston, Ontario,

More information

Clarify Some Issues on the Sparse Bayesian Learning for Sparse Signal Recovery

Clarify Some Issues on the Sparse Bayesian Learning for Sparse Signal Recovery Clarify Some Issues on the Sparse Bayesian Learning for Sparse Signal Recovery Zhilin Zhang and Bhaskar D. Rao Technical Report University of California at San Diego September, Abstract Sparse Bayesian

More information

Frequency response: Resonance, Bandwidth, Q factor

Frequency response: Resonance, Bandwidth, Q factor Frequency response: esonance, Bandwidth, Q factor esonance. Let s continue the exploration of the frequency response of circuits by investigating the series circuit shown on Figure. C + V - Figure The

More information

Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques

Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques 1 Sales Rate and Cumulative Sales Forecasting Using Kalman Filtering Techniques Michael Munroe, Intel Corporation Ted Hench, Arizona State University, 480 614 1496, ted.hench@asu.edu Matthew Timmons, Arizona

More information

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac. 4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.uk 1 1 Outline The LMS algorithm Overview of LMS issues

More information

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking 174 IEEE TRANSACTIONS ON SIGNAL PROCESSING, VOL. 50, NO. 2, FEBRUARY 2002 A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking M. Sanjeev Arulampalam, Simon Maskell, Neil

More information

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition)

INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) INDIRECT INFERENCE (prepared for: The New Palgrave Dictionary of Economics, Second Edition) Abstract Indirect inference is a simulation-based method for estimating the parameters of economic models. Its

More information

COMPUTER SIMULATION OF REAL TIME IDENTIFICATION FOR INDUCTION MOTOR DRIVES

COMPUTER SIMULATION OF REAL TIME IDENTIFICATION FOR INDUCTION MOTOR DRIVES Proceedings of the International Conference on Theory and Applications of Mathematics and Informatics - ICTAMI 2004, Thessaloniki, Greece COMPUTER SIMULATION OF REAL TIME IDENTIFICATION FOR INDUCTION MOTOR

More information

2x + y = 3. Since the second equation is precisely the same as the first equation, it is enough to find x and y satisfying the system

2x + y = 3. Since the second equation is precisely the same as the first equation, it is enough to find x and y satisfying the system 1. Systems of linear equations We are interested in the solutions to systems of linear equations. A linear equation is of the form 3x 5y + 2z + w = 3. The key thing is that we don t multiply the variables

More information

POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES

POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES L. Novotny 1, P. Strakos 1, J. Vesely 1, A. Dietmair 2 1 Research Center of Manufacturing Technology, CTU in Prague, Czech Republic 2 SW, Universität

More information

How to compute Random acceleration, velocity, and displacement values from a breakpoint table.

How to compute Random acceleration, velocity, and displacement values from a breakpoint table. How to compute Random acceleration, velocity, and displacement values from a breakpoint table. A random spectrum is defined as a set of frequency and amplitude breakpoints, like these: 0.050 Acceleration

More information

Lecture 9: Introduction to Pattern Analysis

Lecture 9: Introduction to Pattern Analysis Lecture 9: Introduction to Pattern Analysis g Features, patterns and classifiers g Components of a PR system g An example g Probability definitions g Bayes Theorem g Gaussian densities Features, patterns

More information

Course 8. An Introduction to the Kalman Filter

Course 8. An Introduction to the Kalman Filter Course 8 An Introduction to the Kalman Filter Speakers Greg Welch Gary Bishop Kalman Filters in 2 hours? Hah! No magic. Pretty simple to apply. Tolerant of abuse. Notes are a standalone reference. These

More information

1 Teaching notes on GMM 1.

1 Teaching notes on GMM 1. Bent E. Sørensen January 23, 2007 1 Teaching notes on GMM 1. Generalized Method of Moment (GMM) estimation is one of two developments in econometrics in the 80ies that revolutionized empirical work in

More information

Log-Likelihood Ratio-based Relay Selection Algorithm in Wireless Network

Log-Likelihood Ratio-based Relay Selection Algorithm in Wireless Network Recent Advances in Electrical Engineering and Electronic Devices Log-Likelihood Ratio-based Relay Selection Algorithm in Wireless Network Ahmed El-Mahdy and Ahmed Walid Faculty of Information Engineering

More information

DCMS DC MOTOR SYSTEM User Manual

DCMS DC MOTOR SYSTEM User Manual DCMS DC MOTOR SYSTEM User Manual release 1.3 March 3, 2011 Disclaimer The developers of the DC Motor System (hardware and software) have used their best efforts in the development. The developers make

More information

Tutorial on Markov Chain Monte Carlo

Tutorial on Markov Chain Monte Carlo Tutorial on Markov Chain Monte Carlo Kenneth M. Hanson Los Alamos National Laboratory Presented at the 29 th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Technology,

More information

Predict the Popularity of YouTube Videos Using Early View Data

Predict the Popularity of YouTube Videos Using Early View Data 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050

More information

Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers

Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers Sung-won ark and Jose Trevino Texas A&M University-Kingsville, EE/CS Department, MSC 92, Kingsville, TX 78363 TEL (36) 593-2638, FAX

More information

Blind source separation of multichannel neuromagnetic responses

Blind source separation of multichannel neuromagnetic responses Neurocomputing 32}33 (2000) 1115}1120 Blind source separation of multichannel neuromagnetic responses Akaysha C. Tang *, Barak A. Pearlmutter, Michael Zibulevsky, Scott A. Carter Department of Psychology,

More information

Presence research and EEG. Summary

Presence research and EEG. Summary Presence research and EEG Alois Schlögl 1, Mel Slater, Gert Pfurtscheller 1 1 Institute for Biomedical Engineering, University of Technology Graz Inffeldgasse 16a, A-81 Graz, AUSTRIA Department of Computer

More information

Spike-Based Sensing and Processing: What are spikes good for? John G. Harris Electrical and Computer Engineering Dept

Spike-Based Sensing and Processing: What are spikes good for? John G. Harris Electrical and Computer Engineering Dept Spike-Based Sensing and Processing: What are spikes good for? John G. Harris Electrical and Computer Engineering Dept ONR NEURO-SILICON WORKSHOP, AUG 1-2, 2006 Take Home Messages Introduce integrate-and-fire

More information

Deterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking

Deterministic Sampling-based Switching Kalman Filtering for Vehicle Tracking Proceedings of the IEEE ITSC 2006 2006 IEEE Intelligent Transportation Systems Conference Toronto, Canada, September 17-20, 2006 WA4.1 Deterministic Sampling-based Switching Kalman Filtering for Vehicle

More information

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen LECTURE 3: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major

More information

KALMAN Filtering techniques can be used either for

KALMAN Filtering techniques can be used either for , July 6-8,, London, U.K. Fusion of Non-Contacting Sensors and Vital Parameter Extraction Using Kalman Filtering Jérôme Foussier, Daniel Teichmann, Jing Jia, Steffen Leonhar Abstract This paper describes

More information

Author: Dr. Society of Electrophysio. Reference: Electrodes. should include: electrode shape size use. direction.

Author: Dr. Society of Electrophysio. Reference: Electrodes. should include: electrode shape size use. direction. Standards for Reportin ng EMG Data Author: Dr. Roberto Merletti, Politecnico di Torino, Italy The Standards for Reporting EMG Data, written by Dr. Robertoo Merletti, are endorsed by the International Society

More information

Adaptive Notch Filter for EEG Signals Based on the LMS Algorithm with Variable Step-Size Parameter

Adaptive Notch Filter for EEG Signals Based on the LMS Algorithm with Variable Step-Size Parameter 5 Conference on Information Sciences and Systems, The Johns Hopkins University, March 16 18, 5 Adaptive Notch Filter for EEG Signals Based on the LMS Algorithm with Variable Step-Size Parameter Daniel

More information

Background 2. Lecture 2 1. The Least Mean Square (LMS) algorithm 4. The Least Mean Square (LMS) algorithm 3. br(n) = u(n)u H (n) bp(n) = u(n)d (n)

Background 2. Lecture 2 1. The Least Mean Square (LMS) algorithm 4. The Least Mean Square (LMS) algorithm 3. br(n) = u(n)u H (n) bp(n) = u(n)d (n) Lecture 2 1 During this lecture you will learn about The Least Mean Squares algorithm (LMS) Convergence analysis of the LMS Equalizer (Kanalutjämnare) Background 2 The method of the Steepest descent that

More information

Master s thesis tutorial: part III

Master s thesis tutorial: part III for the Autonomous Compliant Research group Tinne De Laet, Wilm Decré, Diederik Verscheure Katholieke Universiteit Leuven, Department of Mechanical Engineering, PMA Division 30 oktober 2006 Outline General

More information

Doppler. Doppler. Doppler shift. Doppler Frequency. Doppler shift. Doppler shift. Chapter 19

Doppler. Doppler. Doppler shift. Doppler Frequency. Doppler shift. Doppler shift. Chapter 19 Doppler Doppler Chapter 19 A moving train with a trumpet player holding the same tone for a very long time travels from your left to your right. The tone changes relative the motion of you (receiver) and

More information

Signal Detection. Outline. Detection Theory. Example Applications of Detection Theory

Signal Detection. Outline. Detection Theory. Example Applications of Detection Theory Outline Signal Detection M. Sami Fadali Professor of lectrical ngineering University of Nevada, Reno Hypothesis testing. Neyman-Pearson (NP) detector for a known signal in white Gaussian noise (WGN). Matched

More information

A Multi-Model Filter for Mobile Terminal Location Tracking

A Multi-Model Filter for Mobile Terminal Location Tracking A Multi-Model Filter for Mobile Terminal Location Tracking M. McGuire, K.N. Plataniotis The Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto, 1 King s College

More information

Medical Image Processing on the GPU. Past, Present and Future. Anders Eklund, PhD Virginia Tech Carilion Research Institute andek@vtc.vt.

Medical Image Processing on the GPU. Past, Present and Future. Anders Eklund, PhD Virginia Tech Carilion Research Institute andek@vtc.vt. Medical Image Processing on the GPU Past, Present and Future Anders Eklund, PhD Virginia Tech Carilion Research Institute andek@vtc.vt.edu Outline Motivation why do we need GPUs? Past - how was GPU programming

More information

Time Series Analysis III

Time Series Analysis III Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis

More information

IN current film media, the increase in areal density has

IN current film media, the increase in areal density has IEEE TRANSACTIONS ON MAGNETICS, VOL. 44, NO. 1, JANUARY 2008 193 A New Read Channel Model for Patterned Media Storage Seyhan Karakulak, Paul H. Siegel, Fellow, IEEE, Jack K. Wolf, Life Fellow, IEEE, and

More information

4F7 Adaptive Filters (and Spectrum Estimation) Kalman Filter. Sumeetpal Singh Email : sss40@eng.cam.ac.uk

4F7 Adaptive Filters (and Spectrum Estimation) Kalman Filter. Sumeetpal Singh Email : sss40@eng.cam.ac.uk 4F7 Adaptive Filters (and Spectrum Estimation) Kalman Filter Sumeetpal Singh Email : sss40@eng.cam.ac.uk 1 1 Outline State space model Kalman filter Examples 2 2 Parameter Estimation We have repeated observations

More information

EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set

EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set EM Clustering Approach for Multi-Dimensional Analysis of Big Data Set Amhmed A. Bhih School of Electrical and Electronic Engineering Princy Johnson School of Electrical and Electronic Engineering Martin

More information

Accurate and robust image superresolution by neural processing of local image representations

Accurate and robust image superresolution by neural processing of local image representations Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica

More information

Discrete Frobenius-Perron Tracking

Discrete Frobenius-Perron Tracking Discrete Frobenius-Perron Tracing Barend J. van Wy and Michaël A. van Wy French South-African Technical Institute in Electronics at the Tshwane University of Technology Staatsartillerie Road, Pretoria,

More information

An introduction to OBJECTIVE ASSESSMENT OF IMAGE QUALITY. Harrison H. Barrett University of Arizona Tucson, AZ

An introduction to OBJECTIVE ASSESSMENT OF IMAGE QUALITY. Harrison H. Barrett University of Arizona Tucson, AZ An introduction to OBJECTIVE ASSESSMENT OF IMAGE QUALITY Harrison H. Barrett University of Arizona Tucson, AZ Outline! Approaches to image quality! Why not fidelity?! Basic premises of the task-based approach!

More information