Kalman Filter Applied to a Active Queue Management Problem



Similar documents
Performance Analysis of AQM Schemes in Wired and Wireless Networks based on TCP flow

Understanding and Applying Kalman Filtering

A Reliability Point and Kalman Filter-based Vehicle Tracking Technique

Master s Thesis. A Study on Active Queue Management Mechanisms for. Internet Routers: Design, Performance Analysis, and.

Kristine L. Bell and Harry L. Van Trees. Center of Excellence in C 3 I George Mason University Fairfax, VA , USA kbell@gmu.edu, hlv@gmu.

An Introduction to the Kalman Filter

Discrete Frobenius-Perron Tracking

EE 570: Location and Navigation

Why Congestion Control. Congestion Control and Active Queue Management. Max-Min Fairness. Fairness

Using median filtering in active queue management for telecommunication networks

Course 8. An Introduction to the Kalman Filter

Mapping an Application to a Control Architecture: Specification of the Problem

Nonlinear Model Predictive Control of Hammerstein and Wiener Models Using Genetic Algorithms

System Identification for Acoustic Comms.:

Comparative Analysis of Congestion Control Algorithms Using ns-2

Applying Active Queue Management to Link Layer Buffers for Real-time Traffic over Third Generation Wireless Networks

Active Queue Management: Comparison of Sliding Mode Controller and Linear Quadratic Regulator

Mathieu St-Pierre. Denis Gingras Dr. Ing.

Introduction to Kalman Filtering

Rate-Based Active Queue Management: A Green Algorithm in Congestion Control

Protagonist International Journal of Management And Technology (PIJMT) Online ISSN Vol 2 No 3 (May-2015) Active Queue Management

Efficient model-based leak detection in boiler steam-water systems

Sensorless Control of a Brushless DC motor using an Extended Kalman estimator.

Network congestion, its control and avoidance

1: B asic S imu lati on Modeling

POTENTIAL OF STATE-FEEDBACK CONTROL FOR MACHINE TOOLS DRIVES

Bandwidth Estimation using Passive Monitoring for WLANs Case Study Report

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAA

Packet Queueing Delay

A REVIEW ON KALMAN FILTER FOR GPS TRACKING

Network Security A Decision and Game-Theoretic Approach

CE801: Intelligent Systems and Robotics Lecture 3: Actuators and Localisation. Prof. Dr. Hani Hagras

Probability and Random Variables. Generation of random variables (r.v.)

Dynamic Process Modeling. Process Dynamics and Control

Content. Professur für Steuerung, Regelung und Systemdynamik. Lecture: Vehicle Dynamics Tutor: T. Wey Date: , 20:11:52

Adaptive Demand-Forecasting Approach based on Principal Components Time-series an application of data-mining technique to detection of market movement

Introduction to Engineering System Dynamics

KALMAN Filtering techniques can be used either for

Image Compression through DCT and Huffman Coding Technique

Adaptive Equalization of binary encoded signals Using LMS Algorithm

Active Queue Management of TCP Flows with Self-scheduled Linear Parameter Varying Controllers

Formulations of Model Predictive Control. Dipartimento di Elettronica e Informazione

Monitoring of Internet traffic and applications

Image Filtering of Colored Noise Based on Kalman Filter

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Quality of Service versus Fairness. Inelastic Applications. QoS Analogy: Surface Mail. How to Provide QoS?

PTE505: Inverse Modeling for Subsurface Flow Data Integration (3 Units)

Pa8ern Recogni6on. and Machine Learning. Chapter 4: Linear Models for Classifica6on

MIMO CHANNEL CAPACITY

An Introduction to the Kalman Filter

Seamless Congestion Control over Wired and Wireless IEEE Networks

ADAPTIVE ALGORITHMS FOR ACOUSTIC ECHO CANCELLATION IN SPEECH PROCESSING

Optimization models for congestion control with multipath routing in TCP/IP networks

Advanced Signal Processing and Digital Noise Reduction

Risk Management for IT Security: When Theory Meets Practice

Router Scheduling Configuration Based on the Maximization of Benefit and Carried Best Effort Traffic

DYNAMIC RANGE IMPROVEMENT THROUGH MULTIPLE EXPOSURES. Mark A. Robertson, Sean Borman, and Robert L. Stevenson

Active Queue Management

17: Queue Management. Queuing. Mark Handley

A Tutorial on Particle Filters for Online Nonlinear/Non-Gaussian Bayesian Tracking

Performance improvement of active queue management with per-flow scheduling

Research Article Average Bandwidth Allocation Model of WFQ

Robotics. Chapter 25. Chapter 25 1

BEHAVIOR BASED CREDIT CARD FRAUD DETECTION USING SUPPORT VECTOR MACHINES

Adaptive Variable Step Size in LMS Algorithm Using Evolutionary Programming: VSSLMSEV

AN IMPROVED SNOOP FOR TCP RENO AND TCP SACK IN WIRED-CUM- WIRELESS NETWORKS

REM: Active Queue Management

CONTROL SYSTEMS, ROBOTICS AND AUTOMATION Vol. XVI - Fault Accomodation Using Model Predictive Methods - Jovan D. Bošković and Raman K.

On Packet Marking Function of Active Queue Management Mechanism: Should It Be Linear, Concave, or Convex?

Congestion Control of Active Queue Management Routers Based on LQ-Servo Control

Least Squares Estimation

How To Use Neural Networks In Data Mining

Observingtheeffectof TCP congestion controlon networktraffic

Real-Time Monitoring of Complex Industrial Processes with Particle Filters

Solutions to Exam in Speech Signal Processing EN2300

An Empirical Approach - Distributed Mobility Management for Target Tracking in MANETs

Sizing Internet Router Buffers, Active Queue Management, and the Lur e Problem

Performance Evaluation of Linux Bridge

On Correlating Performance Metrics

The CUSUM algorithm a small review. Pierre Granjon

Design of Active Queue Management System for Scalable TCP in High Speed Networks

BRAESS-LIKE PARADOXES FOR NON-COOPERATIVE DYNAMIC LOAD BALANCING IN DISTRIBUTED COMPUTER SYSTEMS

Tracking in flussi video 3D. Ing. Samuele Salti

Comparison of Real-time Network Traffic Estimator Models in Gain Scheduler Middleware by Unmanned Ground Vehicle Network-Based Controller

Master s thesis tutorial: part III

Probability Hypothesis Density filter versus Multiple Hypothesis Tracking

Active Queue Management A router based control mechanism

Broadband Networks. Prof. Dr. Abhay Karandikar. Electrical Engineering Department. Indian Institute of Technology, Bombay. Lecture - 29.

An Overview of Knowledge Discovery Database and Data mining Techniques

Transcription:

IOSR Journal of Electrical and Electronics Engineering (IOSR-JEEE) e-issn: 2278-1676,p-ISSN: 2320-3331, Volume 9, Issue 4 Ver. III (Jul Aug. 2014), PP 23-27 Jyoti Pandey 1 and Prof. Aashih Hiradhar 2 Department Of Electronics And Telecommunication, 12, C.V.Raman University, Bilaspur (C.G.), Abstract: The Kalman Filter (KF) is used to optimally estimate system states from the sequential noisy measurements of the outputs. On the other hand, real-time systems are often modeled with uncertainties and time-delays. Developing KF algorithms for such systems is an important problem to obtain optimal state estimates by utilizing the information on uncertainties and time-delays. First, designing of KF for nominal discrete-time systems is studied. Considering the covariance of the error in the estimation the KF algorithm is derived which is further tested on a numerical example. A designed KF is tested on a real-time problem i.e. Active Queue Management (AQM) problem.in Internet routers, Active Queue Management (AQM) is a technique that consists in dropping or Explicit Congestion Notification (ECN) maring pacets before a router's queue is full. Keywords: Active Queue Management,Explicit Congestion Notification, discrete time system, time-delay. I. Introduction Basically the KF is an estimator which estimate the future state from the series of noisy measurement for the given system state. The KF provides a method for constructing an optimal estimate of the system state. KF is an efficient recursive filter that estimates the state of a linear dynamic system from series of noisy measurement. The KF is a recursive estimator means that only the estimated state from the previous step and the current measurement are needed to compute the estimate for the current state. The KF operates by propagating the mean and covariance of the state through time. Basically the KF has two distinct phase time update & measurement update. The time update uses the state estimates from the previous time step to produce an estimate of the state at the current time step. The measurement update information at the current time step is used to refine this prediction at new.the Kalman filter is a tool that can estimate the variables of a wide range of processes. In mathematical terms we would say that a Kalman filter estimates the states of a linear system. The Kalman filter not only wors well in practice, but it is theoretically attractive because it can be shown that of all possible filters, it is the one that minimizes the variance of the estimation error. Kalman filters are often implemented in embedded control systems because in order to control a process, you first need an accurate estimate of the process variables. The Kalman filter is a mathematical power tool that is playing an increasingly important role in computer graphics as we include sensing of the real world in our systems. The good news is you don t have to be a mathematical genius to understand and effectively use Kalman flters. This tutorial is designed to provide developers of graphical systems with a basic understanding of this important mathematical tool. The process of finding the best estimate from noisy data amounts to filtering out the noise. However a Kalman filter also doesn t just clean up the data measurements, but also projects these measurements onto the state estimate. II. Kalman Filtering For Linear Discrete Time System Kalman Filter (KF) is a numerical method used to trac a time-varying signal in the presence of noise. It is the problem of estimating the instantaneous state of a linear system from a measurement of outputs that are linear combinations of the states but corrupted with Gaussian white noise. The resulting estimator is statically optimal with respect to a quadratic function of estimation error. From the mathematical point view, the KF is a set of equations that provides an efficientrecursive computational solution of the linear estimation problem. The filter is very powerful in several aspects. It can be suitably used to either of smoothening, estimating or predicting respectively the past, the present and the future states. This may be achieved even when precise characteristics of the modeled system are unnown, i.e., the case of uncertain systems. The KF is an extremely effective and versatile procedure for combining noisy sensor outputs to estimate the state of the system with uncertain dynamics. When applied to a physical system, the observer or filter will be under the influence of two noise sources: (i) Process noise, (ii) Measurement noise.the estimate of the state is specified by its conditional probability density function. The purpose of a filter is to compute the state estimate, while an optimal filter minimizes the spread of the estimation error probability density. A recursive optimal filter propagates the conditional probability density function from one sampling instant to the next, eeping in view the system 23 Page

dynamics and inputs, and it incorporates measurements and measurement error statistics in the estimate. Therefore, the recursive generation of the mean and covariance in finite time can be expressed as the following five steps: (i) State estimate extrapolation (Propagation), (ii) Covariance estimation extrapolation (Propagation), (iii) Filter gain computation, (iv) State estimate update, (v) Covariance estimate update. n x We use a KF to estimate the state of a discrete time controlled system. The system is described by a linear stochastic difference equation. x 1 Ax Bw (2.1) y Cx v (2.2) n m q x where, is the system state, y is the measured output, w is the process noise, p v is the measurement noise. In the following v and w will be regarded as zero mean, uncorrelated white noise sequence with covariance v N 0, R w N 0, Q. (2.3) R and Q. (2.4) nn The matrix A in the difference Equation (2.1) is the dynamics matrix which relates the sate at time step n1 mm to the sate at time step 1. The matrix B called noise matrix. The matrix C in the y measurement Equation (2.2) relates the state measurement.when the measurement error covariance R K f approaches zero, the weighting by lets the actual measurement y be trusted more and more, while the Cxˆ predicted measurement y is trusted less and less. On the other hand, the actual measurement is trusted less and less as the a priori estimate error covariance approaches zero, and the predicted measurement Cxˆ is trusted more and more. The KF algorithm can be seen as a form of feedbac estimation. The set of the KF equation can be separated in two groups: 1. Time update equations 2. Measurement update equation The time update equations project the current state and the error covariance estimates forward in the time to obtain a priori estimates for the next time step. The measurement update equations handle the feedbac. In other words, it incorporates a new measurement into the a priori estimate to obtain a corrected a posterior estimate. Therefore the time update equations are predicator equations, and the measurement update equations are corrector equations. That is, the KF is a predictor-corrector algorithm to provide a recursive solution to the discrete time linear system, as shown in Fig. 2.1. P Figure 2.1: Discrete Klaman Filter Cycle The time and measurement update equations are presented below: The time updates equations: xˆ ˆ 1 Ax Bu (2.5) T P 1 AP A Q (2.6) The measurements update equations: 24 Page

Y 1 K P C C P C R (2.7) T f xˆ xˆ K y C xˆ (2.8) f P I K C P (2.9) f The time-update equation projects the state estimate and covariance from time step to step 1. To compute the Kalman Gain (KG) K is the first job in the measurement update equations. Then f is obtained by actual measurement of the system. Incorporating the actual measurement and the estimated one in equation(2.7), we generate a posterior estimate. The last step is to compute a posterior error covariance. This is the recursive operation of the KF. A complete picture of the operation of the KF is illustrated in Fig. 2.2, after each time and measurement update pair, the recursive algorithm is repeated with the previous a posterior estimates to predict the new a priori estimates. This recursive nature is the biggest advantage of the KF. This maes the practical implementation of the KF much easier and feasible then the implementation of the Wiener filter, because the Weiner filter obtains its estimates by using all of the precedent data directly. In contrast, the KF only uses the immediately previous data to predict the current states [10]. The standard KF algorithm is shown in Fig. 2.2. y Figure 2.2: Kalman Filter Algorithm III. Active Queue Management Problem In Internet routers, Active Queue Management (AQM) is a technique that consists in dropping or Explicit Congestion Notification (ECN) maring pacets before a router's queue is full [8]. An Internet router typically maintains a set of queues, one per interface, that hold pacets scheduled to go out on that interface. Historically, such queues use a drop-tail discipline: a pacet is put onto the queue if the queue is shorter than its maximum size (measured in pacets are in bytes), and dropped otherwise. Active queue disciplines drop or mar pacets before the queue is full. Typically, they operate by maintaining one or more drop/mar probabilities, and probabilistically dropping or maring pacets even when the queue is short. The uniqueness of our approach comes from the use of a recently developed dynamic model of the transmission control protocol (TCP) which enables application of control principles to address the basic feedbac nature of AQM [6]. Figure 3.1: A Sender Receiver Connection 25 Page

IV. Results & Simulations 4.1 Simulation Result of Kalman Filter Consider the following discrete time system, 0 0.5 6 x 1 x w 1 1 1 y 100 10 x v Note that the above system is of the form of system with 1 0 P S, W 1, V 1 0 1 Figure 4.1: No. of Iteration vs. True State and Estimated State Figure 4.2: No. of Iteration vs. Eigen Value of Covariance Matrix Fig.4.1 shows the estimated states by KF and true state of a system which is considered. And we observe from the figure that estimated state is nearly equal to true state with some error. Fig.4.2 shows when the number of iteration increases the estimation error decreases and becomes steady after a finite interval of time. The value of covariance of estimation error is shown below 76.2930 53.0900 Cov( e ) 53.0900 75.6653 4.2 State Estimation using Kalman Filter in active queue management problem Figure 4.3: Number of iteration and true state & estimated state 26 Page

Figure 4.4: Number of iteration Eigen values of covariance matrix V. Applications Of Kalman Filter Kalman filter is used in Inertial navigation and guidance, Global positioning system, Target tracing, Communication, signal processing,. Fault diagnosis, Channelequalization, Economics, Navigation, Many computer vision application and Feature tracing. VI. Limitations Of Kalman Filter One of the problem with the Kalman filter is that they may not robust against modeling uncertainties. The Kalman filter algorithm is the optimal filter for a system without uncertainties. The performance of a KF may be significantly degraded if the actual system model does not match the model on which the KF was based. VII. Conclusion KF is a powerful tool to estimate states of a system under noisy output measurements. In this chapter, a formulation has been presented for the design of KF for linear systems without considering the time-delay and some basic ideas on KF. For estimation, prediction & reduction of error the KF performance is satisfactory. The KF is the most widely used filter for its better performance. It is a very simple and intuitive concept with good computational efficiency. But when uncertainty and time delay is included then the performance of KF may degraded, so RKF is considered which is robust against large parameter uncertainty and time delay. In coming chapter a performance comparison between RKF and KF is obtained for linear discrete-time uncertain system.secondary, a real time problem i.e. AQM is considered. Initially the system was in continuous time domain then it is converted to discrete time domain. And the discritized form is transformed to another model for easy implementation of KF. From the Fig. 4.3 and 4.4 we see that the estimated state is approximate to the true state and with the increases of number of iteration the error will be reduce. References [1]. Antonis Papachristodouluo and Ali Jadbaaie, Delay Robustness of Nonlinear Internet Congection Control Schemes, IEEE Transaction on aytomatic control, Volume 55, pp- 1421-1427,(2010). [2]. Mital A Gandhi, and Lamine Mili, Roust Kalman Filter based on a Generalized Maximum- Liegood-Type Estimator, IEEE Transaction on Signal Processing, Volume 58, pp-2509-2520,(2010). [3]. Rodrigo Fontes Souto and Joao Yoshiyui Ishihara, Robust Kalman Filter for Discrete-Time Systems With Correlated Noise, Ajaccio, France, 2008. [4]. Ashvin Lashmiantha, Carolyn L. Bec, and R. Sriant, Robustness of Real and Virtual Queue- Based Active Queue Management Schemes, IEEE/ACM Transaction on networing, Volume 13, pp- 81-93,(2005). [5]. X.Lu, H.Zhang and W.Wang, Kalman Filtering for Multiple Time Delay System, Automatica, Volume 41, pp- 1455-1461 (2005). [6]. Tansu Alpcan, and Tamer Basar, A Gloally Stable Adaptive Congestion Control Scheme for Internet-Style Networs With Delay, IEEE/ACM Transaction on networing, Volume 13, pp-1261-1274,(2005). [7]. Z.Wang, J.Lam and X.Liu, Robust Kalman filtering for Discrete-Timr Marovian Jump Delay Sustem, IEEE Signal Processing Letters, Volume 11, pp- 659-662 (2004). [8]. C.V.Hollot, V.Mishra, D.Towsley, and W.Gong Analysis and Design of Controllers for AQM Routers Supporting TCP Flows, IEEE Transactions on Automatic Control, Volume 47, pp- 954-959, (2002). [9]. V.Mishra, W.Gong, and D.Towsley, Fluid based analysis of a networ of AQM routers supporting TCP flows with an application to RED, Proceeding ACM/SIGCOMM, (2000). [10]. V.Mishra, W.Gong, and D.Towsley, Fluid based analysis of a networ of AQM routers supporting TCP flows with an application to RED, Proceeding ACM/SIGCOMM, (2000). 27 Page