Study of full waveform inversion based on L-BFGS algorithm

Size: px
Start display at page:

Download "Study of full waveform inversion based on L-BFGS algorithm"

Transcription

1 Global Geology doi /j. issn Article ID Study of full waveform inversion based on L-BFGS algorithm DENG Wubing HAN Liguo ZHANG Bo HUANG Fei and HAN Miao College of Geo-Exploration Science and Technology Jilin University Changchun China Abstract Full waveform inversion is mainly used to obtain high resolution velocity models of subsurface. The size of full waveform inversion will lead to a gigantic computation cost. Under the available computer resource and the limitation of full waveform inversion the authors propose L-BFGS algorithm as the optimization method to solve this problem. In order to demonstrate the flexibility of the method three different numerical experiments have been done to analyze the properties of full waveform inversion based on L-BFGS. Key words L-BFGS numerical optimization acoustic wave equation initial model full waveform inversion 1 Introduction Although FWI was already introduced in 1980s Tarantola 1984 seismology geophysicists put gigantic efforts into FWI to get higher resolution images of the subsurface's structure due to the huge size of the inversion problem and the limitation of the computer technology. In order to gain a good inversion result and reduce the computation cost lots of strategies such as multi-scale grids Zhang 2011 and different optimization algorithm have been applied to FWI. In this paper we introduce L-BFGS optimization algorithm to full waveform inversion. In order to testify the flexibility of our method numerical experiments are processed on Marmousi model. BP model and noise contained seismic data. BFGS is named after Broyden-Fletcher-Goldfarb- Shanno who first introduced this algorithm to numerical optimization methods Nocedal 1980 Liu & Nocedal 1989 Brdy et al BFGS was regarded as the most efficient algorithm among the quasi- Newton algorithms. However it has a high requirement on memory. Thus L-BFGS was introduced to save the memory which makes BFGS more efficient to perform. L-BFGS not only inherits the advantages of BFGS it overcomes the problem of high requirement on storage and improves the calculation speed as well. Different from BFGS L-BFGS only needs to store a few implicit vector pairs last m iteration results rather than store the whole vector pairs Nocedal Therefore it is always used to solve the inverse problem such as inverse spectral decomposition or combine with other algorithm Deng et al Unlike BFGS i-1 former iteration results are needed L-BFGS can perform very well using only m former iteration results and smaller memory is required. In order to cut the computation cost without reducing the resolution L-BFGS was applied to full waveform inversion. 2 The theory of full waveform inversion based on L-BFGS Generally seismic inversion is aim to get the information about subsurface structure or underground physical properties via processing the data gathered by the acquisition system. Different from other inversion Received 8 January 2012 accepted 10 February 2012

2 162 Deng W. B. Han L. G. Zhang B. et al. methods full waveform inversion method gets an accurate subsurface model by minimizing the differences between the synthetic wavefield and observed wavefield without any other processing strategies if the forward method can match the real acquisition system perfectly Virieux & Operto The forward modeling is based on frequency domain acoustic wave equation in this paper 2 + k 2 W r = - f r 1 where 2 is the Laplace operator k 2 is the wavenumber W r and f r are the wavefield and seismic source at position r respectively. Equation 1 can be simplified as follow Ax = b 2 with A = 2 + k 2 which is solved by two dimensional nine points 2D-9P finite difference scheme Jo 1996 x = W r b = - f r. According to equation 2 the objective function of the inverse problem here can be described as min 1 2 b - Ax λ x 1 3 with λ the regularization parameter. It is a tradeoff between L1-norm and L2-norm Brossier et al We can summarize the procedure of FWI briefly as Fig. 1 As clearly showed in Fig. 1 there are 7 major steps in FWI and step1 to step6 is the iterative part. The iteration only stops when the stopping criterions satisfied. Among these 7 steps we are here to focus our efforts on dealing with step 3 calculating the gradient of the objective function. There are numerous ways to solve step3 such as CG conjugate gradient PCG preconditioned CG and LSQR least square QR decomposition. However quasi-newton algorithms are chosen instead of Newton methods because equation 3 is a nonlinear optimization problem. And L-BFGS is the best among all the quasi- Newton algorithms. Thus L-BFGS algorithm is utilized to calculate the gradient g k through formula 4. B k d k = - g k 4 where B k and d k refer to the approximate Hessian matrix and research direction respectively. Fig. 1 Brief outline of procedure of FWI L-BFGS is a kind of iterative algorithm. It has some good properties which Newton algorithms haven't. Such as quadratic termination fast local convergence rate and low computation cost. More importantly it is little affected by inexact line searches which are obtained from step 4. The L-BFGS update formula is B k +1 = B k + y k +1y T k +1 y T k +1s k +1 + g kg T k g T k d k 5 s k = x k - x k -1 y k = g k - g k -1 6 k denotes the k-th iteration. The demonstrations of these two equations are omitted here. 3 Numerical examples The subsurface structure of the Earth is so complex that we can only get an approximation model of it. However the quality of the inversion result suffers from many aspects such as the accuracy of the initial model the noise level in real seismic data. But we believe that these two aspects can be overcome if a suit-

3 Study of L-BFGS algorithm based full waveform inversion 163 able optimization method is chosen. In order to demonstrate this opinion we have done a series of numerical experiments on Marmousi model and BP model Inversion result obtained by different optimization methods In this section two different algorithms L-BFGS and LSQR are applied to full waveform inversion on BP model. The BP model is discretized on grids with grid spacing 25 m. Acquisition geometry consists of 300 shots distributed in a line near the surface of the model and 300 geophones as well. The inversion results showed in Fig. 2 are obtained under the same computation situation except that different numerical optimization methods are used. Fig. 2a is the hard BP model Fig. 2b is the initial model which is obtained by low wavenumber pass filter. The position encircled by the ellipse is so steep that it is hard to get a high - resolution result through inversion or migration. However this part has been successfully reconstructed by FWI based on L-BFGS which can be seen from the inversion result showed in Fig. 2c. Unfortunately LSQR algorithm failed to recover the region showed in Fig. 2d. So this experiment demonstrates that L-BFGS is much better than LSQR algorithm towards the application in FWI Inversion starts from different initial models The quality of an initial model is of crucial importance to full waveform inversion. In this secttion we have used different initial model to test how FWI based on L-BFGS affected by initial model. Fig. 3a is the same as Fig. 2b which is a low wavenumber passed initial model and its inversion result is showed in Fig. 3c while Fig. 3b is a linear initial model and its inversion result is showed in Fig. 3d. Although the low wavenumber passed initial model has a less difference to the hard model than the linear initial model the inversion results between the two are alomost the same. From Fig. 3e we can see that the difference between the two inversion results below 300 m /s and even approximate to zero in most area except the bright area. So L-BFGS algorithm can reconstruct the subsurface very well with simple structure that the affection caused by the initial model can be neglected. Unfortunately L-BFGS still cannot overcome the affection caused by initial model in the situation of high complexity structures. Fig. 2 Comparison between L-BFGS algorithm and LSQR algorithm on BP model

4 164 Deng W. B. Han L. G. Zhang B. et al. Fig. 3 Comparison of inversion results from different initial models 3. 3 Property of anti-noise of L-BFGS Noise cannot be avoided in the real case. And some of the noise even cannot be eliminated. Thus lots of work has been done to deal with the inherent noise. In this part numerical experiment is processed on Marmousi model to test how L-BFGS performed with noise contained seismic data. The Marmousi model is discretized on grids with grid spacing 25 m. The acquisition consists of 384 shots distributed in a line near the surface of the model and 384 geophones as well. Fig. 4a and Fig. 4b are the hard model and initial model respectively. Two different kinds of noise were added to the seismic records. We group these two noise and related results into two groups. In the first group noise of average equals zero covariance equals is added to the seismic data showed in Fig. 4c which is the seismic wavefield snap at 5Hz in frequency domain so as Fig. 4d. We got the inversion result in this group is showed in Fig. 4e. The reservoir encircled by an ellipse in the model has been successfully inverted. We increase the noise level to covariance equals 0. 5 in group two. We can see from Fig. 4d the seismic data is badly damaged by the noise but the reservoir still can be reconstructed successfully which is showed in Fig. 4f. This experiment successfully demonstrates that FWI based on L-BFGS has a strong ability to deal with noise. However the inversion result becomes blurry as the noise level increased.

5 Study of L-BFGS algorithm based full waveform inversion Fig Inversion results obtained from two different noise contained seismic data Conclusions Through the study of L-BFGS based full waveform inversion with three different numerical examples we get some conclusion as following 1 It is valid and efficient to apply L-BFGS algorithm to full waveform inversion as it can help us to get an accurate solution than some other algorithm small storage is needed 2 Initial model has less affection on L-BFGS based full waveform inversion This is because the way to calculate the gradient of the objective function using by L-BFGS is much more efficient than other algorithm In the next step we are looking forward to modify the L-BFGS's update formula equation 5 and 6 to improve L-BFGS's stability and convergence rate etc References Brossier R Operto S Virieux J 2009 Robust elastic frequency-domain full-waveform inversion using the L1 norm Geophyscial Research Letter L20310 Byrd R H Lu P H Nocedal J et al 1994 A limited memory algorithm for bound constrained optimization SIAM J Sci Comput Deng W B Han L G Li X et al 2011 Apply the combination of L-BFGS and SPGL1 to full waveform inversion / / The 27th Chinese Geophysical Society Symposium 2011 Hefei University of Science and Technology of China Press 714 in Chinese Jo C H Shin C Suh J H 1996 An optimal 9-point finitedifference frequency-space 2-D scalar wave extrapolator Geophysics

W009 Application of VTI Waveform Inversion with Regularization and Preconditioning to Real 3D Data

W009 Application of VTI Waveform Inversion with Regularization and Preconditioning to Real 3D Data W009 Application of VTI Waveform Inversion with Regularization and Preconditioning to Real 3D Data C. Wang* (ION Geophysical), D. Yingst (ION Geophysical), R. Bloor (ION Geophysical) & J. Leveille (ION

More information

P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition

P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition K. Osypov* (WesternGeco), D. Nichols (WesternGeco), M. Woodward (WesternGeco) & C.E. Yarman (WesternGeco) SUMMARY Tomographic

More information

Th-07-03 Salt Exit Velocity Retrieval Using Full-waveform Inversion

Th-07-03 Salt Exit Velocity Retrieval Using Full-waveform Inversion Th-07-03 Salt Exit Velocity Retrieval Using Full-waveform Inversion W. Huang (WesternGeco), K. Jiao (westerngeco), D. Vigh (westerngeco), J. Kapoor* (westerngeco), H. Ma (westerngeco), X. Cheng (westerngeco)

More information

Converted-waves imaging condition for elastic reverse-time migration Yuting Duan and Paul Sava, Center for Wave Phenomena, Colorado School of Mines

Converted-waves imaging condition for elastic reverse-time migration Yuting Duan and Paul Sava, Center for Wave Phenomena, Colorado School of Mines Converted-waves imaging condition for elastic reverse-time migration Yuting Duan and Paul Sava, Center for Wave Phenomena, Colorado School of Mines SUMMARY Polarity changes in converted-wave images constructed

More information

Which physics for full-wavefield seismic inversion?

Which physics for full-wavefield seismic inversion? Which physics for full-wavefield seismic inversion? M. Warner* (Imperial College London), J. Morgan (Imperial College London), A. Umpleby (Imperial College London), I. Stekl (Imperial College London) &

More information

AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS

AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS Revised Edition James Epperson Mathematical Reviews BICENTENNIAL 0, 1 8 0 7 z ewiley wu 2007 r71 BICENTENNIAL WILEY-INTERSCIENCE A John Wiley & Sons, Inc.,

More information

(Quasi-)Newton methods

(Quasi-)Newton methods (Quasi-)Newton methods 1 Introduction 1.1 Newton method Newton method is a method to find the zeros of a differentiable non-linear function g, x such that g(x) = 0, where g : R n R n. Given a starting

More information

GPR Polarization Simulation with 3D HO FDTD

GPR Polarization Simulation with 3D HO FDTD Progress In Electromagnetics Research Symposium Proceedings, Xi an, China, March 6, 00 999 GPR Polarization Simulation with 3D HO FDTD Jing Li, Zhao-Fa Zeng,, Ling Huang, and Fengshan Liu College of Geoexploration

More information

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical

More information

P013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE

P013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE 1 P013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE JEAN-MARC GRATIEN, JEAN-FRANÇOIS MAGRAS, PHILIPPE QUANDALLE, OLIVIER RICOIS 1&4, av. Bois-Préau. 92852 Rueil Malmaison Cedex. France

More information

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model

Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written

More information

General Framework for an Iterative Solution of Ax b. Jacobi s Method

General Framework for an Iterative Solution of Ax b. Jacobi s Method 2.6 Iterative Solutions of Linear Systems 143 2.6 Iterative Solutions of Linear Systems Consistent linear systems in real life are solved in one of two ways: by direct calculation (using a matrix factorization,

More information

An efficient frequency-domain full waveform inversion. method using simultaneous encoded sources

An efficient frequency-domain full waveform inversion. method using simultaneous encoded sources An efficient frequency-domain full waveform inversion method using simultaneous encoded sources Hafedh Ben-Hadj-Ali, Stéphane Operto and Jean Virieux Géoazur, Université de Nice Sophia-Antipolis, CNRS,

More information

A Time b). Redatuming Direct with Ghost by Correlation T AB + T BC

A Time b). Redatuming Direct with Ghost by Correlation T AB + T BC STRT Monitoring oilfield reservoirs by downhole seismic arrays typically consists of picking traveltimes of direct arrivals and locating the hypocenter of the fracturing rock. The 3-component array typically

More information

A Parallel Evolution Strategy for an Earth Imaging Problem in Geophysics

A Parallel Evolution Strategy for an Earth Imaging Problem in Geophysics A Parallel Evolution Strategy for an Earth Imaging Problem in Geophysics Y. Diouane S. Gratton X. Vasseur L. N. Vicente H. Calandra October 13, 2015 Abstract In this paper we propose a new way to compute

More information

Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems

Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001,

More information

Waveform inversion of shallow seismic refraction data using hybrid heuristic search method

Waveform inversion of shallow seismic refraction data using hybrid heuristic search method CSIRO PUBLISHING www.publish.csiro.au/journals/eg Copublished paper, please cite all three: Exploration Geophysics, 2009, 40, 99 104; Butsuri-Tansa, 2009, 62, 99 104; Mulli-Tamsa, 2009, 12, 99 104 Waveform

More information

GeoEast-Tomo 3D Prestack Tomographic Velocity Inversion System

GeoEast-Tomo 3D Prestack Tomographic Velocity Inversion System GeoEast-Tomo 3D Prestack Tomographic Velocity Inversion System Science & Technology Management Department, CNPC 2015 China national Petroleum CorPoration GeoEast-Tomo : Accurate Imaging of Complex Exploration

More information

An Iterative Image Registration Technique with an Application to Stereo Vision

An Iterative Image Registration Technique with an Application to Stereo Vision An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract

More information

TESLA Report 2003-03

TESLA Report 2003-03 TESLA Report 23-3 A multigrid based 3D space-charge routine in the tracking code GPT Gisela Pöplau, Ursula van Rienen, Marieke de Loos and Bas van der Geer Institute of General Electrical Engineering,

More information

Introduction to the Finite Element Method

Introduction to the Finite Element Method Introduction to the Finite Element Method 09.06.2009 Outline Motivation Partial Differential Equations (PDEs) Finite Difference Method (FDM) Finite Element Method (FEM) References Motivation Figure: cross

More information

Limited Memory Solution of Complementarity Problems arising in Video Games

Limited Memory Solution of Complementarity Problems arising in Video Games Laboratoire d Arithmétique, Calcul formel et d Optimisation UMR CNRS 69 Limited Memory Solution of Complementarity Problems arising in Video Games Michael C. Ferris Andrew J. Wathen Paul Armand Rapport

More information

Numerical Methods I Eigenvalue Problems

Numerical Methods I Eigenvalue Problems Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 September 30th, 2010 A. Donev (Courant Institute)

More information

Nonlinear Optimization: Algorithms 3: Interior-point methods

Nonlinear Optimization: Algorithms 3: Interior-point methods Nonlinear Optimization: Algorithms 3: Interior-point methods INSEAD, Spring 2006 Jean-Philippe Vert Ecole des Mines de Paris Jean-Philippe.Vert@mines.org Nonlinear optimization c 2006 Jean-Philippe Vert,

More information

Section 1.7 22 Continued

Section 1.7 22 Continued Section 1.5 23 A homogeneous equation is always consistent. TRUE - The trivial solution is always a solution. The equation Ax = 0 gives an explicit descriptions of its solution set. FALSE - The equation

More information

NOTES ON LINEAR TRANSFORMATIONS

NOTES ON LINEAR TRANSFORMATIONS NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all

More information

Computational Optical Imaging - Optique Numerique. -- Deconvolution --

Computational Optical Imaging - Optique Numerique. -- Deconvolution -- Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method

More information

Understanding and Applying Kalman Filtering

Understanding and Applying Kalman Filtering Understanding and Applying Kalman Filtering Lindsay Kleeman Department of Electrical and Computer Systems Engineering Monash University, Clayton 1 Introduction Objectives: 1. Provide a basic understanding

More information

Mean value theorem, Taylors Theorem, Maxima and Minima.

Mean value theorem, Taylors Theorem, Maxima and Minima. MA 001 Preparatory Mathematics I. Complex numbers as ordered pairs. Argand s diagram. Triangle inequality. De Moivre s Theorem. Algebra: Quadratic equations and express-ions. Permutations and Combinations.

More information

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm

Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm 1 Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm Hani Mehrpouyan, Student Member, IEEE, Department of Electrical and Computer Engineering Queen s University, Kingston, Ontario,

More information

IPTC 16881. Copyright 2013, International Petroleum Technology Conference

IPTC 16881. Copyright 2013, International Petroleum Technology Conference IPTC 16881 Performances of 3D Frequency-Domain Full-Waveform Inversion Based on Frequency-Domain Direct-Solver and Time-Domain Modeling: Application to 3D OBC Data from the Valhall Field Romain Brossier(1),

More information

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.

Epipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R. Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).

More information

Sparsity-promoting recovery from simultaneous data: a compressive sensing approach

Sparsity-promoting recovery from simultaneous data: a compressive sensing approach SEG 2011 San Antonio Sparsity-promoting recovery from simultaneous data: a compressive sensing approach Haneet Wason*, Tim T. Y. Lin, and Felix J. Herrmann September 19, 2011 SLIM University of British

More information

Mechanics 1: Conservation of Energy and Momentum

Mechanics 1: Conservation of Energy and Momentum Mechanics : Conservation of Energy and Momentum If a certain quantity associated with a system does not change in time. We say that it is conserved, and the system possesses a conservation law. Conservation

More information

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication

Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Thomas Reilly Data Physics Corporation 1741 Technology Drive, Suite 260 San Jose, CA 95110 (408) 216-8440 This paper

More information

5 Homogeneous systems

5 Homogeneous systems 5 Homogeneous systems Definition: A homogeneous (ho-mo-jeen -i-us) system of linear algebraic equations is one in which all the numbers on the right hand side are equal to : a x +... + a n x n =.. a m

More information

Roots of Equations (Chapters 5 and 6)

Roots of Equations (Chapters 5 and 6) Roots of Equations (Chapters 5 and 6) Problem: given f() = 0, find. In general, f() can be any function. For some forms of f(), analytical solutions are available. However, for other functions, we have

More information

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks

Automated Stellar Classification for Large Surveys with EKF and RBF Neural Networks Chin. J. Astron. Astrophys. Vol. 5 (2005), No. 2, 203 210 (http:/www.chjaa.org) Chinese Journal of Astronomy and Astrophysics Automated Stellar Classification for Large Surveys with EKF and RBF Neural

More information

A Strategy for Teaching Finite Element Analysis to Undergraduate Students

A Strategy for Teaching Finite Element Analysis to Undergraduate Students A Strategy for Teaching Finite Element Analysis to Undergraduate Students Gordon Smyrell, School of Computing and Mathematics, University of Teesside The analytical power and design flexibility offered

More information

The Steepest Descent Algorithm for Unconstrained Optimization and a Bisection Line-search Method

The Steepest Descent Algorithm for Unconstrained Optimization and a Bisection Line-search Method The Steepest Descent Algorithm for Unconstrained Optimization and a Bisection Line-search Method Robert M. Freund February, 004 004 Massachusetts Institute of Technology. 1 1 The Algorithm The problem

More information

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.

Algebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions. Chapter 1 Vocabulary identity - A statement that equates two equivalent expressions. verbal model- A word equation that represents a real-life problem. algebraic expression - An expression with variables.

More information

Review Jeopardy. Blue vs. Orange. Review Jeopardy

Review Jeopardy. Blue vs. Orange. Review Jeopardy Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?

More information

OpenFOAM Optimization Tools

OpenFOAM Optimization Tools OpenFOAM Optimization Tools Henrik Rusche and Aleks Jemcov h.rusche@wikki-gmbh.de and a.jemcov@wikki.co.uk Wikki, Germany and United Kingdom OpenFOAM Optimization Tools p. 1 Agenda Objective Review optimisation

More information

Fast Iterative Solvers for Integral Equation Based Techniques in Electromagnetics

Fast Iterative Solvers for Integral Equation Based Techniques in Electromagnetics Fast Iterative Solvers for Integral Equation Based Techniques in Electromagnetics Mario Echeverri, PhD. Student (2 nd year, presently doing a research period abroad) ID:30360 Tutor: Prof. Francesca Vipiana,

More information

Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections

Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Maximilian Hung, Bohyun B. Kim, Xiling Zhang August 17, 2013 Abstract While current systems already provide

More information

How I won the Chess Ratings: Elo vs the rest of the world Competition

How I won the Chess Ratings: Elo vs the rest of the world Competition How I won the Chess Ratings: Elo vs the rest of the world Competition Yannis Sismanis November 2010 Abstract This article discusses in detail the rating system that won the kaggle competition Chess Ratings:

More information

Elementary Gradient-Based Parameter Estimation

Elementary Gradient-Based Parameter Estimation Elementary Gradient-Based Parameter Estimation Julius O. Smith III Center for Computer Research in Music and Acoustics (CCRMA Department of Music, Stanford University, Stanford, California 94305 USA Abstract

More information

Palmprint Recognition. By Sree Rama Murthy kora Praveen Verma Yashwant Kashyap

Palmprint Recognition. By Sree Rama Murthy kora Praveen Verma Yashwant Kashyap Palmprint Recognition By Sree Rama Murthy kora Praveen Verma Yashwant Kashyap Palm print Palm Patterns are utilized in many applications: 1. To correlate palm patterns with medical disorders, e.g. genetic

More information

Continued Fractions and the Euclidean Algorithm

Continued Fractions and the Euclidean Algorithm Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction

More information

TWO-DIMENSIONAL FINITE ELEMENT ANALYSIS OF FORCED CONVECTION FLOW AND HEAT TRANSFER IN A LAMINAR CHANNEL FLOW

TWO-DIMENSIONAL FINITE ELEMENT ANALYSIS OF FORCED CONVECTION FLOW AND HEAT TRANSFER IN A LAMINAR CHANNEL FLOW TWO-DIMENSIONAL FINITE ELEMENT ANALYSIS OF FORCED CONVECTION FLOW AND HEAT TRANSFER IN A LAMINAR CHANNEL FLOW Rajesh Khatri 1, 1 M.Tech Scholar, Department of Mechanical Engineering, S.A.T.I., vidisha

More information

Pricing and calibration in local volatility models via fast quantization

Pricing and calibration in local volatility models via fast quantization Pricing and calibration in local volatility models via fast quantization Parma, 29 th January 2015. Joint work with Giorgia Callegaro and Martino Grasselli Quantization: a brief history Birth: back to

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

Linear Threshold Units

Linear Threshold Units Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear

More information

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 10

Lecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 10 Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 10 Boundary Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction

More information

Applications to Data Smoothing and Image Processing I

Applications to Data Smoothing and Image Processing I Applications to Data Smoothing and Image Processing I MA 348 Kurt Bryan Signals and Images Let t denote time and consider a signal a(t) on some time interval, say t. We ll assume that the signal a(t) is

More information

10. Proximal point method

10. Proximal point method L. Vandenberghe EE236C Spring 2013-14) 10. Proximal point method proximal point method augmented Lagrangian method Moreau-Yosida smoothing 10-1 Proximal point method a conceptual algorithm for minimizing

More information

Numerical Methods For Image Restoration

Numerical Methods For Image Restoration Numerical Methods For Image Restoration CIRAM Alessandro Lanza University of Bologna, Italy Faculty of Engineering CIRAM Outline 1. Image Restoration as an inverse problem 2. Image degradation models:

More information

The successful integration of 3D seismic into the mining process: Practical examples from Bowen Basin underground coal mines

The successful integration of 3D seismic into the mining process: Practical examples from Bowen Basin underground coal mines Geophysics 165 Troy Peters The successful integration of 3D seismic into the mining process: Practical examples from Bowen Basin underground coal mines This paper discusses how mine staff from a number

More information

17. Inner product spaces Definition 17.1. Let V be a real vector space. An inner product on V is a function

17. Inner product spaces Definition 17.1. Let V be a real vector space. An inner product on V is a function 17. Inner product spaces Definition 17.1. Let V be a real vector space. An inner product on V is a function, : V V R, which is symmetric, that is u, v = v, u. bilinear, that is linear (in both factors):

More information

PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY

PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY V. Knyaz a, *, Yu. Visilter, S. Zheltov a State Research Institute for Aviation System (GosNIIAS), 7, Victorenko str., Moscow, Russia

More information

Fourth-Order Compact Schemes of a Heat Conduction Problem with Neumann Boundary Conditions

Fourth-Order Compact Schemes of a Heat Conduction Problem with Neumann Boundary Conditions Fourth-Order Compact Schemes of a Heat Conduction Problem with Neumann Boundary Conditions Jennifer Zhao, 1 Weizhong Dai, Tianchan Niu 1 Department of Mathematics and Statistics, University of Michigan-Dearborn,

More information

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network

Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Qian Wu, Yahui Wang, Long Zhang and Li Shen Abstract Building electrical system fault diagnosis is the

More information

Zeros of a Polynomial Function

Zeros of a Polynomial Function Zeros of a Polynomial Function An important consequence of the Factor Theorem is that finding the zeros of a polynomial is really the same thing as factoring it into linear factors. In this section we

More information

Introduction to the Finite Element Method (FEM)

Introduction to the Finite Element Method (FEM) Introduction to the Finite Element Method (FEM) ecture First and Second Order One Dimensional Shape Functions Dr. J. Dean Discretisation Consider the temperature distribution along the one-dimensional

More information

Yousef Saad University of Minnesota Computer Science and Engineering. CRM Montreal - April 30, 2008

Yousef Saad University of Minnesota Computer Science and Engineering. CRM Montreal - April 30, 2008 A tutorial on: Iterative methods for Sparse Matrix Problems Yousef Saad University of Minnesota Computer Science and Engineering CRM Montreal - April 30, 2008 Outline Part 1 Sparse matrices and sparsity

More information

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =

MAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A = MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the

More information

Probability and Random Variables. Generation of random variables (r.v.)

Probability and Random Variables. Generation of random variables (r.v.) Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly

More information

Nonlinear Programming Methods.S2 Quadratic Programming

Nonlinear Programming Methods.S2 Quadratic Programming Nonlinear Programming Methods.S2 Quadratic Programming Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard A linearly constrained optimization problem with a quadratic objective

More information

Subsalt Interferometric Imaging using Walkaway VSP and Offset Free Cable geometry: A Modeling Study

Subsalt Interferometric Imaging using Walkaway VSP and Offset Free Cable geometry: A Modeling Study Subsalt Interferometric Imaging using Walkaway VSP and Offset Free Cable geometry: A Modeling Study Cemal Erdemir *, Ashwani Dev, Ion Geophysical Corporation, Houston, TX. Summary This study suggests that

More information

Full azimuth angle domain decomposition and imaging: A comprehensive solution for anisotropic velocity model determination and fracture detection

Full azimuth angle domain decomposition and imaging: A comprehensive solution for anisotropic velocity model determination and fracture detection P-403 Full azimuth angle domain decomposition and imaging: A comprehensive solution for anisotropic velocity model determination and fracture detection Summary Zvi Koren, Paradigm A new subsurface angle

More information

By choosing to view this document, you agree to all provisions of the copyright laws protecting it.

By choosing to view this document, you agree to all provisions of the copyright laws protecting it. This material is posted here with permission of the IEEE Such permission of the IEEE does not in any way imply IEEE endorsement of any of Helsinki University of Technology's products or services Internal

More information

Accurate and robust image superresolution by neural processing of local image representations

Accurate and robust image superresolution by neural processing of local image representations Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica

More information

Marine Technology Society

Marine Technology Society Marine Technology Society Dynamic Positioning Conference 21-22 October, 1997 Session 9 Control Systems Improved DP Performance in Deep Water Operations Through Advanced Reference System Processing and

More information

AP PHYSICS C Mechanics - SUMMER ASSIGNMENT FOR 2016-2017

AP PHYSICS C Mechanics - SUMMER ASSIGNMENT FOR 2016-2017 AP PHYSICS C Mechanics - SUMMER ASSIGNMENT FOR 2016-2017 Dear Student: The AP physics course you have signed up for is designed to prepare you for a superior performance on the AP test. To complete material

More information

GLM, insurance pricing & big data: paying attention to convergence issues.

GLM, insurance pricing & big data: paying attention to convergence issues. GLM, insurance pricing & big data: paying attention to convergence issues. Michaël NOACK - michael.noack@addactis.com Senior consultant & Manager of ADDACTIS Pricing Copyright 2014 ADDACTIS Worldwide.

More information

Equations, Inequalities & Partial Fractions

Equations, Inequalities & Partial Fractions Contents Equations, Inequalities & Partial Fractions.1 Solving Linear Equations 2.2 Solving Quadratic Equations 1. Solving Polynomial Equations 1.4 Solving Simultaneous Linear Equations 42.5 Solving Inequalities

More information

Mobile Robot FastSLAM with Xbox Kinect

Mobile Robot FastSLAM with Xbox Kinect Mobile Robot FastSLAM with Xbox Kinect Design Team Taylor Apgar, Sean Suri, Xiangdong Xi Design Advisor Prof. Greg Kowalski Abstract Mapping is an interesting and difficult problem in robotics. In order

More information

Simultaneous Gamma Correction and Registration in the Frequency Domain

Simultaneous Gamma Correction and Registration in the Frequency Domain Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University

More information

i=1 In practice, the natural logarithm of the likelihood function, called the log-likelihood function and denoted by

i=1 In practice, the natural logarithm of the likelihood function, called the log-likelihood function and denoted by Statistics 580 Maximum Likelihood Estimation Introduction Let y (y 1, y 2,..., y n be a vector of iid, random variables from one of a family of distributions on R n and indexed by a p-dimensional parameter

More information

STA 4273H: Statistical Machine Learning

STA 4273H: Statistical Machine Learning STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct

More information

An Introduction to Applied Mathematics: An Iterative Process

An Introduction to Applied Mathematics: An Iterative Process An Introduction to Applied Mathematics: An Iterative Process Applied mathematics seeks to make predictions about some topic such as weather prediction, future value of an investment, the speed of a falling

More information

How do we understand and visualize uncertainty?

How do we understand and visualize uncertainty? How do we understand and visualize uncertainty? MALCOLM SAMBRIDGE, Australian National University, Canberra CAROLINE BEGHEIN, Arizona State University, Tempe, USA FREDERIK J. SIMONS, University College,

More information

Dispersion diagrams of a water-loaded cylindrical shell obtained from the structural and acoustic responses of the sensor array along the shell

Dispersion diagrams of a water-loaded cylindrical shell obtained from the structural and acoustic responses of the sensor array along the shell Dispersion diagrams of a water-loaded cylindrical shell obtained from the structural and acoustic responses of the sensor array along the shell B.K. Jung ; J. Ryue ; C.S. Hong 3 ; W.B. Jeong ; K.K. Shin

More information

Auto-Tuning Using Fourier Coefficients

Auto-Tuning Using Fourier Coefficients Auto-Tuning Using Fourier Coefficients Math 56 Tom Whalen May 20, 2013 The Fourier transform is an integral part of signal processing of any kind. To be able to analyze an input signal as a superposition

More information

MUSIC-like Processing of Pulsed Continuous Wave Signals in Active Sonar Experiments

MUSIC-like Processing of Pulsed Continuous Wave Signals in Active Sonar Experiments 23rd European Signal Processing Conference EUSIPCO) MUSIC-like Processing of Pulsed Continuous Wave Signals in Active Sonar Experiments Hock Siong LIM hales Research and echnology, Singapore hales Solutions

More information

Principles of Big Data Algorithms and Application for Unconventional Oil and Gas Resources

Principles of Big Data Algorithms and Application for Unconventional Oil and Gas Resources SPE-172982-MS Principles of Big Data Algorithms and Application for Unconventional Oil and Gas Resources Avi Lin, Halliburton Copyright 2014, Society of Petroleum Engineers This paper was prepared for

More information

JPEG compression of monochrome 2D-barcode images using DCT coefficient distributions

JPEG compression of monochrome 2D-barcode images using DCT coefficient distributions Edith Cowan University Research Online ECU Publications Pre. JPEG compression of monochrome D-barcode images using DCT coefficient distributions Keng Teong Tan Hong Kong Baptist University Douglas Chai

More information

Wii Remote Calibration Using the Sensor Bar

Wii Remote Calibration Using the Sensor Bar Wii Remote Calibration Using the Sensor Bar Alparslan Yildiz Abdullah Akay Yusuf Sinan Akgul GIT Vision Lab - http://vision.gyte.edu.tr Gebze Institute of Technology Kocaeli, Turkey {yildiz, akay, akgul}@bilmuh.gyte.edu.tr

More information

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac. 4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.uk 1 1 Outline The LMS algorithm Overview of LMS issues

More information

Imaging the earth using seismic diffractions

Imaging the earth using seismic diffractions Imaging the earth using seismic diffractions Rongfeng Zhang Abstract Diffractions in seismic data indicate discontinuities of the subsurface, although they are often obscured by and difficult to separate

More information

Agilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox. Application Note

Agilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox. Application Note Agilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox Application Note Introduction Of all the signal engines in the N7509A, the most complex is the multi-tone engine. This application

More information

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1

IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1 IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1 Active-Set Newton Algorithm for Overcomplete Non-Negative Representations of Audio Tuomas Virtanen, Member,

More information

Creating a NL Texas Hold em Bot

Creating a NL Texas Hold em Bot Creating a NL Texas Hold em Bot Introduction Poker is an easy game to learn by very tough to master. One of the things that is hard to do is controlling emotions. Due to frustration, many have made the

More information

Exact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure

Exact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure Exact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure Belyaev Mikhail 1,2,3, Burnaev Evgeny 1,2,3, Kapushev Yermek 1,2 1 Institute for Information Transmission

More information

14TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF

14TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF 14 TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF August 3 6, 2015 I Rio de Janeiro, RJ Sulamérica Convention Center, Booth #49 Solving challenges. Theatre Schedule: Booth #49

More information

Numerical Analysis Introduction. Student Audience. Prerequisites. Technology.

Numerical Analysis Introduction. Student Audience. Prerequisites. Technology. Numerical Analysis Douglas Faires, Youngstown State University, (Chair, 2012-2013) Elizabeth Yanik, Emporia State University, (Chair, 2013-2015) Graeme Fairweather, Executive Editor, Mathematical Reviews,

More information

Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers

Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers Sung-won ark and Jose Trevino Texas A&M University-Kingsville, EE/CS Department, MSC 92, Kingsville, TX 78363 TEL (36) 593-2638, FAX

More information

A Negative Result Concerning Explicit Matrices With The Restricted Isometry Property

A Negative Result Concerning Explicit Matrices With The Restricted Isometry Property A Negative Result Concerning Explicit Matrices With The Restricted Isometry Property Venkat Chandar March 1, 2008 Abstract In this note, we prove that matrices whose entries are all 0 or 1 cannot achieve

More information