LEAST-MEAN-SQUARE ADAPTIVE FILTERS

Size: px
Start display at page:

Download "LEAST-MEAN-SQUARE ADAPTIVE FILTERS"

Transcription

1 LEAST-MEAN-SQUARE ADAPTIVE FILTERS

2 LEAST-MEAN-SQUARE ADAPTIVE FILTERS Edited by S. Haykin and B. Widrow A JOHN WILEY & SONS, INC. PUBLICATION

3 This book is printed on acid-free paper. Copyright q 2003 by John Wiley & Sons Inc. All rights reserved. Published simultaneously in Canada. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, (978) , fax (978) Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, New Jersey 07030, (201) , fax (201) , For ordering and customer service, call CALL-WILEY. Library of Congress Cataloging-in-Publication Data: Least-mean-square adaptive filters/edited by S. Haykin and B. Widrow p. cm. Includes bibliographical references and index. ISBN (cloth) 1. Adaptive filters Design and construction Mathematics. 2. Least squares. I. Widrow, Bernard, II. Haykin, Simon, TK7872.F5L dc21 Printed in the United States of America

4 This book is dedicated to Bernard Widrow for inventing the LMS filter and investigating its theory and applications Simon Haykin

5 CONTENTS Contributors Introduction: The LMS Filter (Algorithm) Simon Haykin ix xi 1. On the Efficiency of Adaptive Algorithms 1 Bernard Widrow and Max Kamenetsky 2. Traveling-Wave Model of Long LMS Filters 35 Hans J. Butterweck 3. Energy Conservation and the Learning Ability of LMS Adaptive Filters 79 Ali H. Sayed and V. H. Nascimento 4. On the Robustness of LMS Filters 105 Babak Hassibi 5. Dimension Analysis for Least-Mean-Square Algorithms 145 Iven M. Y. Mareels, John Homer, and Robert R. Bitmead 6. Control of LMS-Type Adaptive Filters 175 Eberhard Hänsler and Gerhard Uwe Schmidt 7. Affine Projection Algorithms 241 Steven L. Gay 8. Proportionate Adaptation: New Paradigms in Adaptive Filters 293 Zhe Chen, Simon Haykin, and Steven L. Gay 9. Steady-State Dynamic Weight Behavior in (N)LMS Adaptive Filters 335 A. A. (Louis) Beex and James R. Zeidler vii

6 viii CONTENTS 10. Error Whitening Wiener Filters: Theory and Algorithms 445 Jose C. Principe, Yadunandana N. Rao, and Deniz Erdogmus Index 491

7 CONTRIBUTORS A. A. (LOUIS) BEEX, Systems Group DSP Research Laboratory, The Bradley Department of Electrical and Computer Engineering, Virginia Tech, Blacksburg, VA Department of Mechanical and Aerospace Engineering, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA ROBERT R. BITMEAD, Technische Universiteit Eindhoven, Faculteit Elektrotechniek, EH 5.29, Postbus 513, 5600 MB Eindhoven, Netherlands HANS BUTTERWECK, ZHE CHEN, Department of Electrical and Computer Engineering, CRL 102, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada L8S 4K1 DENIZ ERDOGMUS, Computational NeuroEngineering Laboratory, EB 451, Building 33, University of Florida, Gainesville, FL Acoustics and Speech Research Department, Bell Labs, Room 2D-531, 600 Mountain Ave., Murray Hill, NJ STEVEN L. GAY, Institute of Communication Technology, Darmstadt University of Technology, Merckstrasse 25, D Darmstadt, Germany PROF. DR.-ING. EBERHARD HÄNSLER, BABAK HASSIBI, Department of Electrical Engineering, 1200 East California Blvd., M/C , California Institute of Technology, Pasadena, CA Department of Electrical and Computer Engineering, McMaster University, 1280 Main Street West, Hamilton, Ontario, Canada L8S 4K1 SIMON HAYKIN, JOHN HOMER, School of Computer Science and Electrical Engineering, The University of Queensland, Brisbane 4072 Stanford University, David Packard Electrical Engineering, 350 Serra Mall, Room 263, Stanford, CA MAX KAMENETSKY, IVEN M. Y. MAREELS, Department of Electrical and Electronic Engineering, The University of Melbourne, Melbourne Vic 3010 ix

8 x CONTRIBUTORS V. H. NASCIMENTO, Department of Electronic Systems Engineering, University of São Paulo, Brazil JOSE C. PRINCIPE, Computational NeuroEngineering Laboratory, EB 451, Building 33, University of Florida, Gainesville, FL YADUNANDANA N. RAO, Computational NeuroEngineering Laboratory, EB 451, Building 33, University of Florida, Gainesville, FL Department of Electrical Engineering, Room A Engineering IV Bldg, University of California, Los Angeles, CA ALI H. SAYED, Institute of Communication Technology, Darmstadt University of Technology, Merckstrasse 25, D Darmstadt, Germany GERHARD UWE SCHMIDT, BERNARD WIDROW, Stanford University, David Packard Electrical Engineering, 350 Serra Mall, Room 273, Stanford, CA JAMES R. ZEIDLER, Department of Electrical and Computer Engineering, University of California, San Diego, La Jolla, CA 92092

9 INTRODUCTION: THE LMS FILTER (ALGORITHM) SIMON HAYKIN The earliest work on adaptive filters may be traced back to the late 1950s, during which time a number of researchers were working independently on theories and applications of such filters. From this early work, the least-mean-square ðlmsþ algorithm emerged as a simple, yet effective, algorithm for the design of adaptive transversal (tapped-delay-line) filters. The LMS algorithm was devised by Widrow and Hoff in 1959 in their study of a pattern-recognition machine known as the adaptive linear element, commonly referred to as the Adaline [1, 2]. The LMS algorithm is a stochastic gradient algorithm in that it iterates each tap weight of the transversal filter in the direction of the instantaneous gradient of the squared error signal with respect to the tap weight in question. Let ^wðnþ denote the tap-weight vector of the LMS filter, computed at iteration (time step) n. The adaptive operation of the filter is completely described by the recursive equation (assuming complex data) ^wðn þ 1Þ ¼ ^wðnþþmuðnþ½dðnþ ^w H ðnþuðnþš*; ð1þ where uðnþ is the tap-input vector, dðnþ is the desired response, and m is the step-size parameter. The quantity enclosed in square brackets is the error signal. The asterisk denotes complex conjugation, and the superscript H denotes Hermitian transposition (i.e., ordinary transposition combined with complex conjugation). Equation (1) is testimony to the simplicity of the LMS filter. This simplicity, coupled with desirable properties of the LMS filter (discussed in the chapters of this book) and practical applications [3, 4], has made the LMS filter and its variants an important part of the adaptive signal processing kit of tools, not just for the past 40 years but for many years to come. Simply put, the LMS filter has withstood the test of time. Although the LMS filter is very simple in computational terms, its mathematical analysis is profoundly complicated because of its stochastic and nonlinear nature. Indeed, despite the extensive effort that has been expended in the literature to xi

10 xii INTRODUCTION: THE LMS FILTER (ALGORITHM) analyze the LMS filter, we still do not have a direct mathematical theory for its stability and steady-state performance, and probably we never will. Nevertheless, we do have a good understanding of its behavior in a stationary as well as a nonstationary environment, as demonstrated in the chapters of this book. The stochastic nature of the LMS filter manifests itself in the fact that in a stationary environment, and under the assumption of a small step-size parameter, the filter executes a form of Brownian motion. Specifically, the small step-size theory of the LMS filter is almost exactly described by the discrete-time version of the Langevin equation 1 [3]: Dn k ðnþ ¼n k ðn þ 1Þ n k ðnþ ¼ ml k n k ðnþþf k ðnþ; k ¼ 1; 2;...; M; ð2þ which is naturally split into two parts: a damping force ml k n k ðnþ and a stochastic force f k ðnþ. The terms used herein are defined as follows: M ¼ order (i.e., number of taps) of the transversal filter around which the LMS filter is built l k ¼ kth eigenvalue of the correlation matrix of the input vector uðnþ, which is denoted by R f k ðnþ ¼kth component of the vector mq H uðnþe* o ðnþ Q ¼ unitary matrix whose M columns constitute an orthogonal set of eigerivectors associated with the eigenvalues of the correlation matrix R e o ðnþ ¼optimum error signal produced by the corresponding Wiener filter driven by the input vector uðnþ and the desired response dðnþ To illustrate the validity of Eq. (2) as the description of small step-size theory of the LMS filter, we present the results of a computer experiment on a classic example of adaptive equalization. The example involves an unknown linear channel whose impulse response is described by the raised cosine [3] 8 1 h n ¼ 2 1 þ cos 2p < ðn 2Þ ; n ¼ 1; 2; 3; W ð3þ : 0; otherwise where the parameter W controls the amount of amplitude distortion produced by the channel, with the distortion increasing with W. Equivalently, the parameter W controls the eigenvalue spread (i.e., the ratio of the largest eigenvaiue to the smallest eigenvalue) of the correlation matrix of the tap inputs of the equalizer, with the eigenvalue spread increasing with W. The equalizer has M ¼ 11 taps. Figure 1 presents the learning curves of the equalizer trained using the LMS algorithm with the step-size parameter m ¼ 0:0075 and varying W. Each learning curve was obtained by averaging the squared value of the error signal eðnþ versus the number of iterations n over an ensemble of 100 independent trials of the experiment. The 1 The Langevin equation is the engineer s version of stochastic differential (difference) equations.

11 INTRODUCTION: THE LMS FILTER (ALGORITHM) xiii Figure 1 Learning curves of the LMS algorithm applied to the adaptive equalization of a communication channel whose impulse response is described by Eq. (3) for varying eigenvalue spreads: Theory is represented by continuous well-defined curves. Experimental results are represented by fluctuating curves. continuous curves shown in Figure 1 are theoretical, obtained by applying Eq. (2). The curves with relatively small fluctuations are the results of experimental work. Figure 1 demonstrates close agreement between theory and experiment. It should, however, be reemphasized that application of Eq. (2) is limited to small values of the step-size parameter m. Chapters in this book deal with cases when m is large. REFERENCES 1. B. Widrow and M. E. Hoff, Jr. (1960). Adaptive Switching Circuits, IRE WESCON Conv. Rec., Part 4, pp B. Widrow (1966). Adaptive Filters I: Fundamentals, Rep. SEL (TR ), Stanford Electronic Laboratories, Stanford, CA. 3. S. Haykin (2002). Adaptive Filter Theory, 4th Edition, Prentice-Hall. 4. B. Widrow and S. D. Stearns (1985). Adaptive Signal Processing, Prentice-Hall.

Statistics for Experimenters

Statistics for Experimenters Statistics for Experimenters Design, Innovation, and Discovery Second Edition GEORGE E. P. BOX J. STUART HUNTER WILLIAM G. HUNTER WILEY- INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION FACHGEBIETSBGCHEREI

More information

Analysis of Financial Time Series

Analysis of Financial Time Series Analysis of Financial Time Series Analysis of Financial Time Series Financial Econometrics RUEY S. TSAY University of Chicago A Wiley-Interscience Publication JOHN WILEY & SONS, INC. This book is printed

More information

Stability of the LMS Adaptive Filter by Means of a State Equation

Stability of the LMS Adaptive Filter by Means of a State Equation Stability of the LMS Adaptive Filter by Means of a State Equation Vítor H. Nascimento and Ali H. Sayed Electrical Engineering Department University of California Los Angeles, CA 90095 Abstract This work

More information

THE NOISY OSCILLATOR. The First Hundred Years, From Einstein Until Now. The Noisy Oscillator Downloaded from

THE NOISY OSCILLATOR. The First Hundred Years, From Einstein Until Now. The Noisy Oscillator Downloaded from THE NOISY OSCILLATOR The First Hundred Years, From Einstein Until Now This page intentionally left blank P 2 THE NOISY OSCILLATOR The First Hundred Years, From Einstein Until Now Moshe Gitterman Bar-llan

More information

ANALYZING QUANTITATIVE DATA

ANALYZING QUANTITATIVE DATA ANALYZING QUANTITATIVE DATA ANALYZING QUANTITATIVE DATA An Introduction for Social Researchers Debra Wetcher-Hendricks Sociology Department Moravian College Bethlehem, Pennsylvania A JOHN WILEY & SONS,

More information

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm 1 Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm Hani Mehrpouyan, Student Member, IEEE, Department of Electrical and Computer Engineering Queen s University, Kingston, Ontario,

More information

Teaching with Classroom Response Systems

Teaching with Classroom Response Systems DEREK BRUFF Teaching with Classroom Response Systems Creating Active Learning Environments Teaching with Classroom Response Systems Teaching with Classroom Response Systems Creating Active Learning Environments

More information

www.wileyglobalfinance.com

www.wileyglobalfinance.com Wiley Global Finance is a market-leading provider of over 400 annual books, mobile applications, elearning products, workflow training tools, newsletters and websites for both professionals and consumers

More information

Adaptive Equalization of binary encoded signals Using LMS Algorithm

Adaptive Equalization of binary encoded signals Using LMS Algorithm SSRG International Journal of Electronics and Communication Engineering (SSRG-IJECE) volume issue7 Sep Adaptive Equalization of binary encoded signals Using LMS Algorithm Dr.K.Nagi Reddy Professor of ECE,NBKR

More information

Rajpreet Singh and Amandeep Singh Sappal University College of Engineering, Punjabi University, Patiala (Pb)-India

Rajpreet Singh and Amandeep Singh Sappal University College of Engineering, Punjabi University, Patiala (Pb)-India Analytical Investigations on Cross-Coupled Passband Adaptive Equalizer for a 16-QAM Software Defined Radio Receiver Rajpreet Singh and Amandeep Singh Sappal University College of Engineering, Punjabi University,

More information

IMPLEMENTING SIX SIGMA

IMPLEMENTING SIX SIGMA IMPLEMENTING SIX SIGMA Smarter Solutions Using Statistical Methods Second Edition FORREST W. BREYFOGLE III Founder and President Smarter Solutions, Inc. www.smartersolutions.com Austin, Texas JOHN WILEY

More information

Qualitative Research

Qualitative Research Qualitative Research A Guide to Design and Implementation Revised and Expanded from Qualitative Research and Case Study Applications in Education Sharan B. Merriam Copyright 2009 by John Wiley & Sons,

More information

ADAPTIVE ALGORITHMS FOR ACOUSTIC ECHO CANCELLATION IN SPEECH PROCESSING

ADAPTIVE ALGORITHMS FOR ACOUSTIC ECHO CANCELLATION IN SPEECH PROCESSING www.arpapress.com/volumes/vol7issue1/ijrras_7_1_05.pdf ADAPTIVE ALGORITHMS FOR ACOUSTIC ECHO CANCELLATION IN SPEECH PROCESSING 1,* Radhika Chinaboina, 1 D.S.Ramkiran, 2 Habibulla Khan, 1 M.Usha, 1 B.T.P.Madhav,

More information

Service-Oriented Architecture Governance for the Services Driven Enterprise

Service-Oriented Architecture Governance for the Services Driven Enterprise Service-Oriented Architecture Governance for the Services Driven Enterprise ERIC A. MARKS John Wiley & Sons, Inc. Service-Oriented Architecture Governance for the Services Driven Enterprise Service-Oriented

More information

Algebra Teacher s Activities Kit, Grades 6-12

Algebra Teacher s Activities Kit, Grades 6-12 JOSSEY-BASS TEACHER Jossey-Bass Teacher provides educators with practical knowledge and tools to create a positive and lifelong impact on student learning. We offer classroom-tested and research-based

More information

Fundamentals of Financial Planning and Management for mall usiness

Fundamentals of Financial Planning and Management for mall usiness E REPRE EUR A F A CE Fundamentals of Financial Planning and Management for mall usiness M.J. Alhabeeb ENTREPRENEURIAL FINANCE The first effective form of investment was realized when the primitive man

More information

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac. 4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.uk 1 1 Outline The LMS algorithm Overview of LMS issues

More information

Echo Cancellation in Audio Signal using LMS Algorithm

Echo Cancellation in Audio Signal using LMS Algorithm Echo Cancellation in Audio Signal using LMS Algorithm Sanjay K. Nagendra Dept of Electronics & Communication Sri Bhagawan Mahaveer Jain College of Engineering, Bangalore (Rural) District, Karnataka (India)

More information

Background 2. Lecture 2 1. The Least Mean Square (LMS) algorithm 4. The Least Mean Square (LMS) algorithm 3. br(n) = u(n)u H (n) bp(n) = u(n)d (n)

Background 2. Lecture 2 1. The Least Mean Square (LMS) algorithm 4. The Least Mean Square (LMS) algorithm 3. br(n) = u(n)u H (n) bp(n) = u(n)d (n) Lecture 2 1 During this lecture you will learn about The Least Mean Squares algorithm (LMS) Convergence analysis of the LMS Equalizer (Kanalutjämnare) Background 2 The method of the Steepest descent that

More information

Analysis of Mean-Square Error and Transient Speed of the LMS Adaptive Algorithm

Analysis of Mean-Square Error and Transient Speed of the LMS Adaptive Algorithm IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 7, JULY 2002 1873 Analysis of Mean-Square Error Transient Speed of the LMS Adaptive Algorithm Onkar Dabeer, Student Member, IEEE, Elias Masry, Fellow,

More information

Managing Global Financial and Foreign Exchange Rate Risk GHASSEM A. HOMAIFAR John Wiley & Sons, Inc. Managing Global Financial and Foreign Exchange Rate Risk John Wiley & Sons Founded in 1807, John Wiley

More information

Lecture 5: Variants of the LMS algorithm

Lecture 5: Variants of the LMS algorithm 1 Standard LMS Algorithm FIR filters: Lecture 5: Variants of the LMS algorithm y(n) = w 0 (n)u(n)+w 1 (n)u(n 1) +...+ w M 1 (n)u(n M +1) = M 1 k=0 w k (n)u(n k) =w(n) T u(n), Error between filter output

More information

CHAPTER 6 LEAST MEAN SQUARE ALGORITHM. 6.1 Introduction

CHAPTER 6 LEAST MEAN SQUARE ALGORITHM. 6.1 Introduction CHAPTER 6 LEAST MEAN SQUARE ALGORITHM 6.1 Introduction The Least Mean Square (LMS) algorithm, introduced by Widrow and Hoff in 1959 [12] is an adaptive algorithm, which uses a gradient-based method of

More information

HUMAN RESOURCES MANAGEMENT FOR PUBLIC AND NONPROFIT ORGANIZATIONS

HUMAN RESOURCES MANAGEMENT FOR PUBLIC AND NONPROFIT ORGANIZATIONS HUMAN RESOURCES MANAGEMENT FOR PUBLIC AND NONPROFIT ORGANIZATIONS Essential Texts for Public and Nonprofit Leadership and Management The Handbook of Nonprofit Governance, by BoardSource Strategic Planning

More information

International Marketing Research

International Marketing Research International Marketing Research Third edition C. SAMUEL CRAIG and SUSAN P. DOUGLAS Leonard N. Stern School of Business, New York University Allie International Marketing Research Third edition Allie International

More information

Islamic Finance and the New Financial System

Islamic Finance and the New Financial System Islamic Finance and the New Financial System The Wiley Finance series contains books written specifically for finance and investment professionals as well as sophisticated individual investors and their

More information

ADVANCED LINEAR ALGEBRA FOR ENGINEERS WITH MATLAB. Sohail A. Dianat. Rochester Institute of Technology, New York, U.S.A. Eli S.

ADVANCED LINEAR ALGEBRA FOR ENGINEERS WITH MATLAB. Sohail A. Dianat. Rochester Institute of Technology, New York, U.S.A. Eli S. ADVANCED LINEAR ALGEBRA FOR ENGINEERS WITH MATLAB Sohail A. Dianat Rochester Institute of Technology, New York, U.S.A. Eli S. Saber Rochester Institute of Technology, New York, U.S.A. (g) CRC Press Taylor

More information

Modeling, Analysis, and Control of Dynamic Systems

Modeling, Analysis, and Control of Dynamic Systems Modeling, Analysis, and Control of Dynamic Systems Second Edition William J. Palm III University of Rhode Island John Wiley Sons, Inc. New York Chichester Weinheim Brisbane Singapore Toronto To Louise.

More information

STUDY GUIDE LINEAR ALGEBRA. David C. Lay University of Maryland College Park AND ITS APPLICATIONS THIRD EDITION UPDATE

STUDY GUIDE LINEAR ALGEBRA. David C. Lay University of Maryland College Park AND ITS APPLICATIONS THIRD EDITION UPDATE STUDY GUIDE LINEAR ALGEBRA AND ITS APPLICATIONS THIRD EDITION UPDATE David C. Lay University of Maryland College Park Copyright 2006 Pearson Addison-Wesley. All rights reserved. Reproduced by Pearson Addison-Wesley

More information

Graph Analysis and Visualization

Graph Analysis and Visualization Graph Analysis and Visualization Graph Analysis and Visualization DISCOVERING BUSINESS OPPORTUNITY IN LINKED DATA Richard Brath David Jonker Graph Analysis and Visualization: Discovering Business Opportunity

More information

Brand Strategist is a boon to anyone in

Brand Strategist is a boon to anyone in Idris has managed to condense years of intense brand thinking, innovation, and practice into this highly digestible and eyeopening book. A pleasure to absorb both visually and intellectually, the 60-Min

More information

Chart Patterns: After the Buy

Chart Patterns: After the Buy Chart Patterns: After the Buy The Wiley Trading series features books by traders who have survived the market s ever changing temperament and have prospered some by reinventing systems, others by getting

More information

Problems and Solutions in Introductory and Advanced Matrix Calculus Downloaded from

Problems and Solutions in Introductory and Advanced Matrix Calculus Downloaded from This page intentionally left blank NEW JERSEY LONDON SINGAPORE BEIJING SHANGHAI HONG KONG TAIPEI CHENNAI TOKYO Published by World Scientific Publishing Co. Pte. Ltd. 5 Toh Tuck Link, Singapore 596224 USA

More information

OD-DE: An Improved Orthogonal Direction Algorithm Based on Direction Error

OD-DE: An Improved Orthogonal Direction Algorithm Based on Direction Error , pp.73-80 http://dx.doi.org/10.14257/ijgdc.2015.8.5.06 OD-DE: An Improved Orthogonal Direction Algorithm Based on Direction Error Junfang Guo Wenzhou University oujiang college, Wenzhou 325035, Zhejiang,

More information

MANAGEMENT OF DATA IN CLINICAL TRIALS

MANAGEMENT OF DATA IN CLINICAL TRIALS MANAGEMENT OF DATA IN CLINICAL TRIALS Second Edition ELEANOR MCFADDEN Frontier Science, Ltd. Kincraig, Inverness-shire, Scotland WILEY-INTERSCIENCE A JOHN WILEY & SONS, INC., PUBLICATION MANAGEMENT OF

More information

Component Ordering in Independent Component Analysis Based on Data Power

Component Ordering in Independent Component Analysis Based on Data Power Component Ordering in Independent Component Analysis Based on Data Power Anne Hendrikse Raymond Veldhuis University of Twente University of Twente Fac. EEMCS, Signals and Systems Group Fac. EEMCS, Signals

More information

Science Research Writing for Non-Native Speakers of English Downloaded from

Science Research Writing for Non-Native Speakers of English Downloaded from This page intentionally left blank Hilary Glasman-Deal Imperial College London, UK ICP Imperial College Press Published by Imperial College Press 57 Shelton Street Covent Garden London WC2H 9HE Distributed

More information

Comparative Performance Analysis of Adaptive Algorithms for Simulation & Hardware Implementation of an ECG Signal

Comparative Performance Analysis of Adaptive Algorithms for Simulation & Hardware Implementation of an ECG Signal International Journal of Electronics and Computer Science Engineering 2184 Available Online at www.ijecse.org ISSN- 2277-1956 Comparative Performance Analysis of Adaptive Algorithms for Simulation & Hardware

More information

Final Year Project Progress Report. Frequency-Domain Adaptive Filtering. Myles Friel. Supervisor: Dr.Edward Jones

Final Year Project Progress Report. Frequency-Domain Adaptive Filtering. Myles Friel. Supervisor: Dr.Edward Jones Final Year Project Progress Report Frequency-Domain Adaptive Filtering Myles Friel 01510401 Supervisor: Dr.Edward Jones Abstract The Final Year Project is an important part of the final year of the Electronic

More information

A STUDY OF ECHO IN VOIP SYSTEMS AND SYNCHRONOUS CONVERGENCE OF

A STUDY OF ECHO IN VOIP SYSTEMS AND SYNCHRONOUS CONVERGENCE OF A STUDY OF ECHO IN VOIP SYSTEMS AND SYNCHRONOUS CONVERGENCE OF THE µ-law PNLMS ALGORITHM Laura Mintandjian and Patrick A. Naylor 2 TSS Departement, Nortel Parc d activites de Chateaufort, 78 Chateaufort-France

More information

QUANTUM MECHANICS USING COMPUTER ALGEBRA

QUANTUM MECHANICS USING COMPUTER ALGEBRA QUANTUM MECHANICS USING COMPUTER ALGEBRA Includes Sample Programs in C++, SymbolicC++, Maxima, Maple, and Mathematica 2nd Edition This page intentionally left blank QUANTUM MECHANICS USING COMPUTER ALGEBRA

More information

HYDRAULIC. ENGINEERING An Introduction to Nonlinear Differential Equations. Applied Mathematics in

HYDRAULIC. ENGINEERING An Introduction to Nonlinear Differential Equations. Applied Mathematics in Applied Mathematics in HYDRAULIC ENGINEERING An Introduction to Nonlinear Differential Equations Kazumasa Mizumura Kanazawa Institute of Technology, Japan Applied Mathematics in HYDRAULIC ENGINEERING An

More information

OPTIMIZATION IN ECONOMICS AND FINANCE

OPTIMIZATION IN ECONOMICS AND FINANCE OPTIMIZATION IN ECONOMICS AND FINANCE Dynamic Modeling and Econometrics in Economics and Finance VOLUME 7 Series Editors Stefan Mittnik, University of Kiel, Germany Willi Semmler, University of Bielefeld,

More information

TEACHING UNDERGRADUATE MATHEMATICS

TEACHING UNDERGRADUATE MATHEMATICS TEACHING UNDERGRADUATE MATHEMATICS This page is intentionally left blank TEACHING UNDERGRADUATE Editors Bob Burn MATHEMATICS Reader in Mathematics Education, Agder College, Norway John Appleby Senior Lecturer

More information

Appendix H: Control System Computational Aids

Appendix H: Control System Computational Aids E1BAPP08 11/02/2010 11:56:59 Page 1 Appendix H: Control System Computational Aids H.1 Step Response of a System Represented in State Space In this section we will discuss how to obtain the step response

More information

Thermodynamic Theory of STRUCTURE, STABILITY AND FLUCTUATIONS

Thermodynamic Theory of STRUCTURE, STABILITY AND FLUCTUATIONS Thermodynamic Theory of STRUCTURE, STABILITY AND FLUCTUATIONS P. GLANSDORFF and I. PRIGOGINE Universite" Libre de Bruxelles, Britssels, Belgium, and University of Texas, Austin, Texas / WILEY - INTERSCIENCE

More information

Master Data Management in Practice

Master Data Management in Practice Master Data Management in Practice Achieving True Customer MDM Dalton Cervo Mark Allen WILEY John Wiley & Sons, Inc. Copyright 2011 by Dalton Cervo and Mark Allen. All rights reserved. Published by John

More information

NEURAL NETWORKS A Comprehensive Foundation

NEURAL NETWORKS A Comprehensive Foundation NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments

More information

ON THE LEARNING BEHAVIOR OF THE DR-LS ALGORITHM. Markus Rupp

ON THE LEARNING BEHAVIOR OF THE DR-LS ALGORITHM. Markus Rupp 1 ON THE LEARNING BEHAVIOR OF THE DR-LS ALGORITHM Markus Rupp Bell-Labs, Lucent Technologies, Wireless Research Lab. Zadelstede 1-10, 3431 JZ Nieuwegein, THE NETHERLANDS Fax: +31 30609 7498, Tel: +31 30609

More information

Facts And Mysteries In Elementary Particle Physics Downloaded from by Dr. Horst Wahl on 08/28/12. For personal use only.

Facts And Mysteries In Elementary Particle Physics Downloaded from  by Dr. Horst Wahl on 08/28/12. For personal use only. Published by World Scientific Publishing Co. Pte. Ltd. 5 Toh Tuck Link, Singapore 596224 USA office: Suite 202, 1060 Main Street, River Edge, NJ 07661 UK office: 57 Shelton Street, Covent Garden, London

More information

Computational Principles of Mobile Robotics

Computational Principles of Mobile Robotics Computational Principles of Mobile Robotics Mobile robotics is a multidisciplinary field involving both computer science and engineering. Addressing the design of automated systems, it lies at the intersection

More information

The Filtered-x LMS Algorithm

The Filtered-x LMS Algorithm The Filtered-x LMS Algorithm L. Håkansson Department of Telecommunications and Signal Processing, University of Karlskrona/Ronneby 372 25 Ronneby Sweden Adaptive filters are normally defined for problems

More information

Excel 2007 VBA Programmer s Reference. Chapter 1 Primer in Excel VBA SKU: 9785CH

Excel 2007 VBA Programmer s Reference. Chapter 1 Primer in Excel VBA SKU: 9785CH Excel 2007 VBA Programmer s Reference John Green Stephen Bullen Rob Bovey Michael Alexander ISBN: 978-0-470-04643-2 Chapter 1 Primer in Excel VBA SKU: 9785CH0000062 Excel 2007 VBA Programmer s Reference

More information

VIRTUAL TEAM SUCCESS VIRTUAL TEAM SUCCESS. Praise for VIRTUAL TEAM SUCCESS. Join Us at Josseybass.com

VIRTUAL TEAM SUCCESS VIRTUAL TEAM SUCCESS. Praise for VIRTUAL TEAM SUCCESS. Join Us at Josseybass.com How to RAMP Up Your Team s Effectiveness introduces a practical research-based model of virtual team effectiveness to improve team performance Profile of Top Performing Virtual Team Leaders identifies the

More information

International Journal of Scientific & Engineering Research, Volume 4, Issue 9, September ISSN

International Journal of Scientific & Engineering Research, Volume 4, Issue 9, September ISSN International Journal of Scientific & Engineering Research, Volume 4, Issue 9, September-2013 1485 A contingent adaptive echo cancellation method by actualizing different algorithms Achintaya Kumar, Kashish

More information

CONCEPTS AND METHODS OF 2D INFRARED SPECTROSCOPY

CONCEPTS AND METHODS OF 2D INFRARED SPECTROSCOPY CONCEPTS AND METHODS OF 2D INFRARED SPECTROSCOPY 2D infrared (IR) spectroscopy is a cutting-edge technique, with applications in subjects as diverse as the energy sciences, biophysics and physical chemistry.

More information

Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: VSSLMSEV

Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: VSSLMSEV Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: VSSLMSEV Ajjaiah H.B.M Research scholar Jyothi institute of Technology Bangalore, 560006, India Prabhakar V Hunagund Dept.of

More information

JAMES M. BARRY Z. KOUZES POSNER EDITORS FOREWORD BY JOHN C. MAXWELL Copyright 2004 by John Wiley & Sons, Inc. All rights reserved. FIRST PAPERBACK EDITION PUBLISHED IN 2006. No part of this publication

More information

VORONOI DIAGRAMS AND DELAUNAY TRIANGULATIONS

VORONOI DIAGRAMS AND DELAUNAY TRIANGULATIONS VORONOI DIAGRAMS AND DELAUNAY TRIANGULATIONS This page intentionally left blank VORONOI DIAGRAMS AND DELAUNAY TRIANGULATIONS Franz Aurenhammer Graz University of Technology, Austria Rolf Klein University

More information

By choosing to view this document, you agree to all provisions of the copyright laws protecting it.

By choosing to view this document, you agree to all provisions of the copyright laws protecting it. This material is posted here with permission of the IEEE Such permission of the IEEE does not in any way imply IEEE endorsement of any of Helsinki University of Technology's products or services Internal

More information

BLACKWELL PHILOSOPHY AND POP CULTURE SERIES

BLACKWELL PHILOSOPHY AND POP CULTURE SERIES S E R I E S E D I T O R : WILLIAM IRWIN E D I T E D B Y RICHARD BRIAN DAVIS BLACKWELL PHILOSOPHY AND POP CULTURE SERIES This book has not been approved, licensed, or sponsored by any entity or person involved

More information

Building the Data Warehouse

Building the Data Warehouse Building the Data Warehouse Third Edition W. H. Inmon Wiley Computer Publishing John Wiley & Sons, Inc. NEW YORK CHICHESTER WEINHEIM BRISBANE SINGAPORE TORONTO Building the Data Warehouse Third Edition

More information

ANTENNA arrays with optimum combining combat multipath

ANTENNA arrays with optimum combining combat multipath IEEE TRANSACTIONS ON COMMUNICATIONS, VOL. 46, NO. 12, DECEMBER 1998 1619 Upper Bounds on the Bit-Error Rate of Optimum Combining in Wireless Systems Jack H. Winters, Fellow, IEEE, and Jack Salz, Member,

More information

Analysis of Filter Coefficient Precision on LMS Algorithm Performance for G.165/G.168 Echo Cancellation

Analysis of Filter Coefficient Precision on LMS Algorithm Performance for G.165/G.168 Echo Cancellation Application Report SPRA561 - February 2 Analysis of Filter Coefficient Precision on LMS Algorithm Performance for G.165/G.168 Echo Cancellation Zhaohong Zhang Gunter Schmer C6 Applications ABSTRACT This

More information

Introduction to Multiple Time Series Analysis

Introduction to Multiple Time Series Analysis Helmut Lütkepohl Introduction to Multiple Time Series Analysis Second Edition With 34 Figures Springer-Verlag Berlin Heidelberg New York London Paris Tokyo Hong Kong Barcelona Budapest Table of Contents

More information

Computational Finance Using C and C#

Computational Finance Using C and C# Computational Finance Using C and C# Quantitative Finance Series Aims and Objectives Books based on the work of financial market practitioners and academics Presenting cutting-edge research to the professional/practitioner

More information

Effective Methods for Software and Systems Integration

Effective Methods for Software and Systems Integration Effective Methods for Software and Systems Integration Boyd L. Summers CRC Press Taylor & Francis Group 6000 Broken Sound Parkway NW, Suite 300 Boca Raton, FL 33487-2742 CRC Press is an imprint of Taylor

More information

Separation of a Mixture of Signals Using Linear Filtering and Second Order Statistics

Separation of a Mixture of Signals Using Linear Filtering and Second Order Statistics ESANN'22 proceedings - European Symposium on Artificial Neural Networks Bruges (Belgium), 24-26 April 22, d-side publi., ISBN 2-9337-2-1, pp. 37-312 Separation of a Mixture of Signals Using Linear Filtering

More information

Interference Cancelation in Ultrasonic Sensor Arrays by Stochastic Coding and Adaptive Filtering

Interference Cancelation in Ultrasonic Sensor Arrays by Stochastic Coding and Adaptive Filtering Interference Cancelation in Ultrasonic Sensor Arrays by Stochastic Coding and Adaptive Filtering Bernhard Wirnitzer FH-Mannheim Institut für Digitale Signalverarbeitung Windeckstr. 11, D-68163 Mannheim,

More information

Improvements in the channel Equalizer Performance Using Modified LMS and BP Algorithms

Improvements in the channel Equalizer Performance Using Modified LMS and BP Algorithms www.ijcsi.org 428 Improvements in the channel Equalizer Performance Using Modified LMS and BP Algorithms Ashraf A.M. Khalaf Electriacal Eng. Dept., Faculty of Eng., ElMinia University, Egypt Abstract This

More information

Effective Methods for Software Testing Third Edition

Effective Methods for Software Testing Third Edition Effective Methods for Software Testing Third Edition William E. Perry Effective Methods for Software Testing Third Edition Effective Methods for Software Testing Third Edition William E. Perry Effective

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

NANOCOMPUTING. Computational Physics for Nanoscience and Nanotechnology

NANOCOMPUTING. Computational Physics for Nanoscience and Nanotechnology NANOCOMPUTING Computational Physics for Nanoscience and Nanotechnology NANOCOMPUTING Computational Physics for Nanoscience and Nanotechnology James J Y Hsu National Cheng Kung University, Taiwan National

More information

DESIGNING TRANSISTOR I.F. AMPLIFIERS

DESIGNING TRANSISTOR I.F. AMPLIFIERS DESIGNING TRANSISTOR I.F. AMPLIFIERS By the same author: TRANSISTOR BANDPASS AMPLIFIERS The theory of analysis and design of selective amplifiers as used in the I.F. parts of radio, television and radar

More information

Configuring SAP ERP Sales and Distribution

Configuring SAP ERP Sales and Distribution KAPIL SHARMA AND ASHUTOSH MUTSADDI Configuring SAP ERP Sales and Distribution SERIOUS SKILLS. Configuring SAP ERP Sales and Distribution Kapil Sharma Ashutosh Mutsaddi Acquisitions Editor: Agatha Kim

More information

Numerical Methods for Engineers

Numerical Methods for Engineers Steven C. Chapra Berger Chair in Computing and Engineering Tufts University RaymondP. Canale Professor Emeritus of Civil Engineering University of Michigan Numerical Methods for Engineers With Software

More information

FM_p.i-xvi.qxd 12/8/11 3:31 PM Page i. Investment. Valuation

FM_p.i-xvi.qxd 12/8/11 3:31 PM Page i. Investment. Valuation FM_p.i-xvi.qxd 12/8/11 3:31 PM Page i Investment Valuation FM_p.i-xvi.qxd 12/8/11 3:31 PM Page ii Founded in 1807, John Wiley & Sons is the oldest independent publishing company in the United States. With

More information

CPAexcel FOCUS NOTES

CPAexcel FOCUS NOTES 2016 Wiley CPAexcel exam review FOCUS NOTES 2016 Wiley CPAexcel exam review FOCUS NOTES Financial Accounting and Reporting Cover Design: Wiley Cover image: turtleteeth/istockphoto Copyright 2016 by John

More information

CANCELLATION OF WHITE AND COLOR NOISE WITH ADAPTIVE FILTER USING LMS ALGORITHM

CANCELLATION OF WHITE AND COLOR NOISE WITH ADAPTIVE FILTER USING LMS ALGORITHM CANCELLATION OF WHITE AND COLOR NOISE WITH ADAPTIVE FILTER USING LMS ALGORITHM 1 Solaiman Ahmed, 2 Farhana Afroz, 1 Ahmad Tawsif and 1 Asadul Huq 1 Department of Electrical and Electronic Engineering,

More information

Acoustic Echo Cancellation For Speech And Random Signal Using Estimated Impulse Responses

Acoustic Echo Cancellation For Speech And Random Signal Using Estimated Impulse Responses Adaptive Filter International Journal of Recent Development in Engineering and Technology Acoustic Echo Cancellation For Speech And Random Signal Using Estimated Impulse Responses S. I. M. M. Raton Mondol

More information

Financial Planning Competency Handbook

Financial Planning Competency Handbook Financial Planning Competency Handbook Founded in 1807, John Wiley & Sons is the oldest independent publishing company in the United States. With offices in North America, Europe, Australia, and Asia,

More information

Art Direction for Film and Video

Art Direction for Film and Video Art Direction for Film and Video This page intentionally left blank Art Direction for Film and Video SECOND EDITION Robert L. Olson Focal Press Taylor & Francis Croup NEW YORK AND LONDON First published

More information

A SURVEY OF NONLINEAR DYNAMICS ("Chaos Theory")

A SURVEY OF NONLINEAR DYNAMICS (Chaos Theory) A Survey of Nonlinear Dynamics (Chaos Theory) Downloaded from www.worldscientific.com A SURVEY OF NONLINEAR DYNAMICS ("Chaos Theory") A Survey of Nonlinear Dynamics (Chaos Theory) Downloaded from www.worldscientific.com

More information

Detailed simulation of mass spectra for quadrupole mass spectrometer systems

Detailed simulation of mass spectra for quadrupole mass spectrometer systems Detailed simulation of mass spectra for quadrupole mass spectrometer systems J. R. Gibson, a) S. Taylor, and J. H. Leck Department of Electrical Engineering and Electronics, The University of Liverpool,

More information

Partial Differential Equation Analysis in Biomedical Engineering

Partial Differential Equation Analysis in Biomedical Engineering Partial Differential Equation Analysis in Biomedical Engineering Case Studies with MATLAB Aimed at graduates and researchers, and requiring only a basic knowledge of multivariable calculus, this introduction

More information

SGN Advanced Signal Processing: Lecture 5 Stochastic gradient based adaptation: Least Mean Square (LMS) Algorithm

SGN Advanced Signal Processing: Lecture 5 Stochastic gradient based adaptation: Least Mean Square (LMS) Algorithm SGN 21006 Advanced Signal Processing: Lecture 5 Stochastic gradient based adaptation: Least Mean Square (LMS) Algorithm Ioan Tabus Department of Signal Processing Tampere University of Technology Finland

More information

Scientific Computing: An Introductory Survey

Scientific Computing: An Introductory Survey Scientific Computing: An Introductory Survey Chapter 10 Boundary Value Problems for Ordinary Differential Equations Prof. Michael T. Heath Department of Computer Science University of Illinois at Urbana-Champaign

More information

COMPUSCIENCE. Subject Coverage. File Type. Features Thesaurus None. Record Content. File Size. Coverage 1972-2002. Updates.

COMPUSCIENCE. Subject Coverage. File Type. Features Thesaurus None. Record Content. File Size. Coverage 1972-2002. Updates. Subject Coverage File Type Algorithms Artificial intelligence Computers and education Computer graphics, image processing, pattern recognition Computer systems organization Information systems Software

More information

COVERS ALL TOPICS IN LEVEL I CFA EXAM REVIEW CFA LEVEL I FORMULA SHEETS

COVERS ALL TOPICS IN LEVEL I CFA EXAM REVIEW CFA LEVEL I FORMULA SHEETS 2016 CFA EXAM REVIEW COVERS ALL TOPICS IN LEVEL I LEVEL I CFA FORMULA SHEETS Copyright 2016 by John Wiley & Sons, Inc. All rights reserved. Published by John Wiley & Sons, Inc., Hoboken, New Jersey. Published

More information

NONLINEAR TIME SERIES ANALYSIS

NONLINEAR TIME SERIES ANALYSIS NONLINEAR TIME SERIES ANALYSIS HOLGER KANTZ AND THOMAS SCHREIBER Max Planck Institute for the Physics of Complex Sy stems, Dresden I CAMBRIDGE UNIVERSITY PRESS Preface to the first edition pug e xi Preface

More information

Engineering Structures

Engineering Structures The Mechanics of Engineering Structures This page intentionally left blank The Mechanics of Engineering Structures David W. A. Rees D. Sc. Brunel University, UK ICP Imperial College Press Published by

More information

Detection and Estimation for Communication and Radar Systems

Detection and Estimation for Communication and Radar Systems Detection and Estimation for Communication and Radar Systems Covering the fundamentals of detection and estimation theory, this systematic guide describes statistical tools that can be used to analyze,

More information

Advanced Organic Chemistry

Advanced Organic Chemistry Advanced Organic Chemistry Reactions, Mechanisms, and Structure FOURTH EDITION Jerry March Professor of Chemistry Adelphi University This text is printed on acid- free paper. Copyright 1992 by John Wiley

More information

AIDS Epidemics and HIV Infections

AIDS Epidemics and HIV Infections Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections with Intervention Downloaded from www.worldscientific.com Deterministic and Stochastic Models of AIDS Epidemics and HIV Infections

More information

Linear Algebra in Action

Linear Algebra in Action 2008 AGI-Information Management Consultants May be used for personal purporses only or by libraries associated to dandelon.com network. Linear Algebra in Action Harry Dym Graduate Studies in Mathematics

More information

AN ITERATIVE EIGENDECOMPOSITION APPROACH TO BLIND SOURCE SEPARATION. Ana Maria Tomé

AN ITERATIVE EIGENDECOMPOSITION APPROACH TO BLIND SOURCE SEPARATION. Ana Maria Tomé AN ITERATIVE EIGENDECOMPOSITION APPROACH TO BLIND SOURCE SEPARATION Ana Maria Tomé Dep. Electrónica e Telecomunicações/IEETA Universidade Aveiro-Aveiro-Portugal e-mail:ana@ieeta.pt ABSTRACT In this work

More information

Impact Of Noise Cancellation Scheme On Performance Enhancement Of MIMO-OFDM Wireless Communication System

Impact Of Noise Cancellation Scheme On Performance Enhancement Of MIMO-OFDM Wireless Communication System Impact Of Noise Cancellation Scheme On Performance Enhancement Of MIMO-OFDM Wireless Communication System Md. Johirul Islam 1 1 Lecturer,Dept. of Computer Science and Engineering, Varendra University,

More information

Part-II Parametric Signal Modeling and Linear Prediction Theory 3. Linear Prediction

Part-II Parametric Signal Modeling and Linear Prediction Theory 3. Linear Prediction Part-II Parametric Signal Modeling and Linear Prediction Theory 3. Linear Prediction Electrical & Computer Engineering University of Maryland, College Park Acknowledgment: ENEE630 slides were based on

More information

System Identification for Acoustic Comms.:

System Identification for Acoustic Comms.: System Identification for Acoustic Comms.: New Insights and Approaches for Tracking Sparse and Rapidly Fluctuating Channels Weichang Li and James Preisig Woods Hole Oceanographic Institution The demodulation

More information

IDENTIFICATION OF COEFFICIENTS IN A QUADRATIC MOVING AVERAGE PROCESS USING THE GENERALIZED METHOD OF MOMENTS

IDENTIFICATION OF COEFFICIENTS IN A QUADRATIC MOVING AVERAGE PROCESS USING THE GENERALIZED METHOD OF MOMENTS {Preliminary please do not quote} IDENTIFICATION OF COEFFICIENTS IN A QUADRATIC MOVING AVERAGE PROCESS USING THE GENERALIZED METHOD OF MOMENTS Richard A. Ashley Department of Economics Virginia Tech Blacksburg,

More information