Study of full waveform inversion based on L-BFGS algorithm
|
|
- Alyson Ross
- 7 years ago
- Views:
Transcription
1 Global Geology doi /j. issn Article ID Study of full waveform inversion based on L-BFGS algorithm DENG Wubing HAN Liguo ZHANG Bo HUANG Fei and HAN Miao College of Geo-Exploration Science and Technology Jilin University Changchun China Abstract Full waveform inversion is mainly used to obtain high resolution velocity models of subsurface. The size of full waveform inversion will lead to a gigantic computation cost. Under the available computer resource and the limitation of full waveform inversion the authors propose L-BFGS algorithm as the optimization method to solve this problem. In order to demonstrate the flexibility of the method three different numerical experiments have been done to analyze the properties of full waveform inversion based on L-BFGS. Key words L-BFGS numerical optimization acoustic wave equation initial model full waveform inversion 1 Introduction Although FWI was already introduced in 1980s Tarantola 1984 seismology geophysicists put gigantic efforts into FWI to get higher resolution images of the subsurface's structure due to the huge size of the inversion problem and the limitation of the computer technology. In order to gain a good inversion result and reduce the computation cost lots of strategies such as multi-scale grids Zhang 2011 and different optimization algorithm have been applied to FWI. In this paper we introduce L-BFGS optimization algorithm to full waveform inversion. In order to testify the flexibility of our method numerical experiments are processed on Marmousi model. BP model and noise contained seismic data. BFGS is named after Broyden-Fletcher-Goldfarb- Shanno who first introduced this algorithm to numerical optimization methods Nocedal 1980 Liu & Nocedal 1989 Brdy et al BFGS was regarded as the most efficient algorithm among the quasi- Newton algorithms. However it has a high requirement on memory. Thus L-BFGS was introduced to save the memory which makes BFGS more efficient to perform. L-BFGS not only inherits the advantages of BFGS it overcomes the problem of high requirement on storage and improves the calculation speed as well. Different from BFGS L-BFGS only needs to store a few implicit vector pairs last m iteration results rather than store the whole vector pairs Nocedal Therefore it is always used to solve the inverse problem such as inverse spectral decomposition or combine with other algorithm Deng et al Unlike BFGS i-1 former iteration results are needed L-BFGS can perform very well using only m former iteration results and smaller memory is required. In order to cut the computation cost without reducing the resolution L-BFGS was applied to full waveform inversion. 2 The theory of full waveform inversion based on L-BFGS Generally seismic inversion is aim to get the information about subsurface structure or underground physical properties via processing the data gathered by the acquisition system. Different from other inversion Received 8 January 2012 accepted 10 February 2012
2 162 Deng W. B. Han L. G. Zhang B. et al. methods full waveform inversion method gets an accurate subsurface model by minimizing the differences between the synthetic wavefield and observed wavefield without any other processing strategies if the forward method can match the real acquisition system perfectly Virieux & Operto The forward modeling is based on frequency domain acoustic wave equation in this paper 2 + k 2 W r = - f r 1 where 2 is the Laplace operator k 2 is the wavenumber W r and f r are the wavefield and seismic source at position r respectively. Equation 1 can be simplified as follow Ax = b 2 with A = 2 + k 2 which is solved by two dimensional nine points 2D-9P finite difference scheme Jo 1996 x = W r b = - f r. According to equation 2 the objective function of the inverse problem here can be described as min 1 2 b - Ax λ x 1 3 with λ the regularization parameter. It is a tradeoff between L1-norm and L2-norm Brossier et al We can summarize the procedure of FWI briefly as Fig. 1 As clearly showed in Fig. 1 there are 7 major steps in FWI and step1 to step6 is the iterative part. The iteration only stops when the stopping criterions satisfied. Among these 7 steps we are here to focus our efforts on dealing with step 3 calculating the gradient of the objective function. There are numerous ways to solve step3 such as CG conjugate gradient PCG preconditioned CG and LSQR least square QR decomposition. However quasi-newton algorithms are chosen instead of Newton methods because equation 3 is a nonlinear optimization problem. And L-BFGS is the best among all the quasi- Newton algorithms. Thus L-BFGS algorithm is utilized to calculate the gradient g k through formula 4. B k d k = - g k 4 where B k and d k refer to the approximate Hessian matrix and research direction respectively. Fig. 1 Brief outline of procedure of FWI L-BFGS is a kind of iterative algorithm. It has some good properties which Newton algorithms haven't. Such as quadratic termination fast local convergence rate and low computation cost. More importantly it is little affected by inexact line searches which are obtained from step 4. The L-BFGS update formula is B k +1 = B k + y k +1y T k +1 y T k +1s k +1 + g kg T k g T k d k 5 s k = x k - x k -1 y k = g k - g k -1 6 k denotes the k-th iteration. The demonstrations of these two equations are omitted here. 3 Numerical examples The subsurface structure of the Earth is so complex that we can only get an approximation model of it. However the quality of the inversion result suffers from many aspects such as the accuracy of the initial model the noise level in real seismic data. But we believe that these two aspects can be overcome if a suit-
3 Study of L-BFGS algorithm based full waveform inversion 163 able optimization method is chosen. In order to demonstrate this opinion we have done a series of numerical experiments on Marmousi model and BP model Inversion result obtained by different optimization methods In this section two different algorithms L-BFGS and LSQR are applied to full waveform inversion on BP model. The BP model is discretized on grids with grid spacing 25 m. Acquisition geometry consists of 300 shots distributed in a line near the surface of the model and 300 geophones as well. The inversion results showed in Fig. 2 are obtained under the same computation situation except that different numerical optimization methods are used. Fig. 2a is the hard BP model Fig. 2b is the initial model which is obtained by low wavenumber pass filter. The position encircled by the ellipse is so steep that it is hard to get a high - resolution result through inversion or migration. However this part has been successfully reconstructed by FWI based on L-BFGS which can be seen from the inversion result showed in Fig. 2c. Unfortunately LSQR algorithm failed to recover the region showed in Fig. 2d. So this experiment demonstrates that L-BFGS is much better than LSQR algorithm towards the application in FWI Inversion starts from different initial models The quality of an initial model is of crucial importance to full waveform inversion. In this secttion we have used different initial model to test how FWI based on L-BFGS affected by initial model. Fig. 3a is the same as Fig. 2b which is a low wavenumber passed initial model and its inversion result is showed in Fig. 3c while Fig. 3b is a linear initial model and its inversion result is showed in Fig. 3d. Although the low wavenumber passed initial model has a less difference to the hard model than the linear initial model the inversion results between the two are alomost the same. From Fig. 3e we can see that the difference between the two inversion results below 300 m /s and even approximate to zero in most area except the bright area. So L-BFGS algorithm can reconstruct the subsurface very well with simple structure that the affection caused by the initial model can be neglected. Unfortunately L-BFGS still cannot overcome the affection caused by initial model in the situation of high complexity structures. Fig. 2 Comparison between L-BFGS algorithm and LSQR algorithm on BP model
4 164 Deng W. B. Han L. G. Zhang B. et al. Fig. 3 Comparison of inversion results from different initial models 3. 3 Property of anti-noise of L-BFGS Noise cannot be avoided in the real case. And some of the noise even cannot be eliminated. Thus lots of work has been done to deal with the inherent noise. In this part numerical experiment is processed on Marmousi model to test how L-BFGS performed with noise contained seismic data. The Marmousi model is discretized on grids with grid spacing 25 m. The acquisition consists of 384 shots distributed in a line near the surface of the model and 384 geophones as well. Fig. 4a and Fig. 4b are the hard model and initial model respectively. Two different kinds of noise were added to the seismic records. We group these two noise and related results into two groups. In the first group noise of average equals zero covariance equals is added to the seismic data showed in Fig. 4c which is the seismic wavefield snap at 5Hz in frequency domain so as Fig. 4d. We got the inversion result in this group is showed in Fig. 4e. The reservoir encircled by an ellipse in the model has been successfully inverted. We increase the noise level to covariance equals 0. 5 in group two. We can see from Fig. 4d the seismic data is badly damaged by the noise but the reservoir still can be reconstructed successfully which is showed in Fig. 4f. This experiment successfully demonstrates that FWI based on L-BFGS has a strong ability to deal with noise. However the inversion result becomes blurry as the noise level increased.
5 Study of L-BFGS algorithm based full waveform inversion Fig Inversion results obtained from two different noise contained seismic data Conclusions Through the study of L-BFGS based full waveform inversion with three different numerical examples we get some conclusion as following 1 It is valid and efficient to apply L-BFGS algorithm to full waveform inversion as it can help us to get an accurate solution than some other algorithm small storage is needed 2 Initial model has less affection on L-BFGS based full waveform inversion This is because the way to calculate the gradient of the objective function using by L-BFGS is much more efficient than other algorithm In the next step we are looking forward to modify the L-BFGS's update formula equation 5 and 6 to improve L-BFGS's stability and convergence rate etc References Brossier R Operto S Virieux J 2009 Robust elastic frequency-domain full-waveform inversion using the L1 norm Geophyscial Research Letter L20310 Byrd R H Lu P H Nocedal J et al 1994 A limited memory algorithm for bound constrained optimization SIAM J Sci Comput Deng W B Han L G Li X et al 2011 Apply the combination of L-BFGS and SPGL1 to full waveform inversion / / The 27th Chinese Geophysical Society Symposium 2011 Hefei University of Science and Technology of China Press 714 in Chinese Jo C H Shin C Suh J H 1996 An optimal 9-point finitedifference frequency-space 2-D scalar wave extrapolator Geophysics
W009 Application of VTI Waveform Inversion with Regularization and Preconditioning to Real 3D Data
W009 Application of VTI Waveform Inversion with Regularization and Preconditioning to Real 3D Data C. Wang* (ION Geophysical), D. Yingst (ION Geophysical), R. Bloor (ION Geophysical) & J. Leveille (ION
More informationP164 Tomographic Velocity Model Building Using Iterative Eigendecomposition
P164 Tomographic Velocity Model Building Using Iterative Eigendecomposition K. Osypov* (WesternGeco), D. Nichols (WesternGeco), M. Woodward (WesternGeco) & C.E. Yarman (WesternGeco) SUMMARY Tomographic
More informationTh-07-03 Salt Exit Velocity Retrieval Using Full-waveform Inversion
Th-07-03 Salt Exit Velocity Retrieval Using Full-waveform Inversion W. Huang (WesternGeco), K. Jiao (westerngeco), D. Vigh (westerngeco), J. Kapoor* (westerngeco), H. Ma (westerngeco), X. Cheng (westerngeco)
More informationConverted-waves imaging condition for elastic reverse-time migration Yuting Duan and Paul Sava, Center for Wave Phenomena, Colorado School of Mines
Converted-waves imaging condition for elastic reverse-time migration Yuting Duan and Paul Sava, Center for Wave Phenomena, Colorado School of Mines SUMMARY Polarity changes in converted-wave images constructed
More informationWhich physics for full-wavefield seismic inversion?
Which physics for full-wavefield seismic inversion? M. Warner* (Imperial College London), J. Morgan (Imperial College London), A. Umpleby (Imperial College London), I. Stekl (Imperial College London) &
More informationAN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS
AN INTRODUCTION TO NUMERICAL METHODS AND ANALYSIS Revised Edition James Epperson Mathematical Reviews BICENTENNIAL 0, 1 8 0 7 z ewiley wu 2007 r71 BICENTENNIAL WILEY-INTERSCIENCE A John Wiley & Sons, Inc.,
More information(Quasi-)Newton methods
(Quasi-)Newton methods 1 Introduction 1.1 Newton method Newton method is a method to find the zeros of a differentiable non-linear function g, x such that g(x) = 0, where g : R n R n. Given a starting
More informationGPR Polarization Simulation with 3D HO FDTD
Progress In Electromagnetics Research Symposium Proceedings, Xi an, China, March 6, 00 999 GPR Polarization Simulation with 3D HO FDTD Jing Li, Zhao-Fa Zeng,, Ling Huang, and Fengshan Liu College of Geoexploration
More informationPATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 4: LINEAR MODELS FOR CLASSIFICATION Introduction In the previous chapter, we explored a class of regression models having particularly simple analytical
More informationP013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE
1 P013 INTRODUCING A NEW GENERATION OF RESERVOIR SIMULATION SOFTWARE JEAN-MARC GRATIEN, JEAN-FRANÇOIS MAGRAS, PHILIPPE QUANDALLE, OLIVIER RICOIS 1&4, av. Bois-Préau. 92852 Rueil Malmaison Cedex. France
More informationOverview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model
Overview of Violations of the Basic Assumptions in the Classical Normal Linear Regression Model 1 September 004 A. Introduction and assumptions The classical normal linear regression model can be written
More informationGeneral Framework for an Iterative Solution of Ax b. Jacobi s Method
2.6 Iterative Solutions of Linear Systems 143 2.6 Iterative Solutions of Linear Systems Consistent linear systems in real life are solved in one of two ways: by direct calculation (using a matrix factorization,
More informationAn efficient frequency-domain full waveform inversion. method using simultaneous encoded sources
An efficient frequency-domain full waveform inversion method using simultaneous encoded sources Hafedh Ben-Hadj-Ali, Stéphane Operto and Jean Virieux Géoazur, Université de Nice Sophia-Antipolis, CNRS,
More informationA Time b). Redatuming Direct with Ghost by Correlation T AB + T BC
STRT Monitoring oilfield reservoirs by downhole seismic arrays typically consists of picking traveltimes of direct arrivals and locating the hypocenter of the fracturing rock. The 3-component array typically
More informationA Parallel Evolution Strategy for an Earth Imaging Problem in Geophysics
A Parallel Evolution Strategy for an Earth Imaging Problem in Geophysics Y. Diouane S. Gratton X. Vasseur L. N. Vicente H. Calandra October 13, 2015 Abstract In this paper we propose a new way to compute
More informationNumerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems
Numerical Methods I Solving Linear Systems: Sparse Matrices, Iterative Methods and Non-Square Systems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001,
More informationWaveform inversion of shallow seismic refraction data using hybrid heuristic search method
CSIRO PUBLISHING www.publish.csiro.au/journals/eg Copublished paper, please cite all three: Exploration Geophysics, 2009, 40, 99 104; Butsuri-Tansa, 2009, 62, 99 104; Mulli-Tamsa, 2009, 12, 99 104 Waveform
More informationGeoEast-Tomo 3D Prestack Tomographic Velocity Inversion System
GeoEast-Tomo 3D Prestack Tomographic Velocity Inversion System Science & Technology Management Department, CNPC 2015 China national Petroleum CorPoration GeoEast-Tomo : Accurate Imaging of Complex Exploration
More informationAn Iterative Image Registration Technique with an Application to Stereo Vision
An Iterative Image Registration Technique with an Application to Stereo Vision Bruce D. Lucas Takeo Kanade Computer Science Department Carnegie-Mellon University Pittsburgh, Pennsylvania 15213 Abstract
More informationTESLA Report 2003-03
TESLA Report 23-3 A multigrid based 3D space-charge routine in the tracking code GPT Gisela Pöplau, Ursula van Rienen, Marieke de Loos and Bas van der Geer Institute of General Electrical Engineering,
More informationIntroduction to the Finite Element Method
Introduction to the Finite Element Method 09.06.2009 Outline Motivation Partial Differential Equations (PDEs) Finite Difference Method (FDM) Finite Element Method (FEM) References Motivation Figure: cross
More informationLimited Memory Solution of Complementarity Problems arising in Video Games
Laboratoire d Arithmétique, Calcul formel et d Optimisation UMR CNRS 69 Limited Memory Solution of Complementarity Problems arising in Video Games Michael C. Ferris Andrew J. Wathen Paul Armand Rapport
More informationNumerical Methods I Eigenvalue Problems
Numerical Methods I Eigenvalue Problems Aleksandar Donev Courant Institute, NYU 1 donev@courant.nyu.edu 1 Course G63.2010.001 / G22.2420-001, Fall 2010 September 30th, 2010 A. Donev (Courant Institute)
More informationNonlinear Optimization: Algorithms 3: Interior-point methods
Nonlinear Optimization: Algorithms 3: Interior-point methods INSEAD, Spring 2006 Jean-Philippe Vert Ecole des Mines de Paris Jean-Philippe.Vert@mines.org Nonlinear optimization c 2006 Jean-Philippe Vert,
More informationSection 1.7 22 Continued
Section 1.5 23 A homogeneous equation is always consistent. TRUE - The trivial solution is always a solution. The equation Ax = 0 gives an explicit descriptions of its solution set. FALSE - The equation
More informationNOTES ON LINEAR TRANSFORMATIONS
NOTES ON LINEAR TRANSFORMATIONS Definition 1. Let V and W be vector spaces. A function T : V W is a linear transformation from V to W if the following two properties hold. i T v + v = T v + T v for all
More informationComputational Optical Imaging - Optique Numerique. -- Deconvolution --
Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method
More informationUnderstanding and Applying Kalman Filtering
Understanding and Applying Kalman Filtering Lindsay Kleeman Department of Electrical and Computer Systems Engineering Monash University, Clayton 1 Introduction Objectives: 1. Provide a basic understanding
More informationMean value theorem, Taylors Theorem, Maxima and Minima.
MA 001 Preparatory Mathematics I. Complex numbers as ordered pairs. Argand s diagram. Triangle inequality. De Moivre s Theorem. Algebra: Quadratic equations and express-ions. Permutations and Combinations.
More informationEnhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm
1 Enhancing the SNR of the Fiber Optic Rotation Sensor using the LMS Algorithm Hani Mehrpouyan, Student Member, IEEE, Department of Electrical and Computer Engineering Queen s University, Kingston, Ontario,
More informationIPTC 16881. Copyright 2013, International Petroleum Technology Conference
IPTC 16881 Performances of 3D Frequency-Domain Full-Waveform Inversion Based on Frequency-Domain Direct-Solver and Time-Domain Modeling: Application to 3D OBC Data from the Valhall Field Romain Brossier(1),
More informationEpipolar Geometry. Readings: See Sections 10.1 and 15.6 of Forsyth and Ponce. Right Image. Left Image. e(p ) Epipolar Lines. e(q ) q R.
Epipolar Geometry We consider two perspective images of a scene as taken from a stereo pair of cameras (or equivalently, assume the scene is rigid and imaged with a single camera from two different locations).
More informationSparsity-promoting recovery from simultaneous data: a compressive sensing approach
SEG 2011 San Antonio Sparsity-promoting recovery from simultaneous data: a compressive sensing approach Haneet Wason*, Tim T. Y. Lin, and Felix J. Herrmann September 19, 2011 SLIM University of British
More informationMechanics 1: Conservation of Energy and Momentum
Mechanics : Conservation of Energy and Momentum If a certain quantity associated with a system does not change in time. We say that it is conserved, and the system possesses a conservation law. Conservation
More informationTime Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication
Time Domain and Frequency Domain Techniques For Multi Shaker Time Waveform Replication Thomas Reilly Data Physics Corporation 1741 Technology Drive, Suite 260 San Jose, CA 95110 (408) 216-8440 This paper
More information5 Homogeneous systems
5 Homogeneous systems Definition: A homogeneous (ho-mo-jeen -i-us) system of linear algebraic equations is one in which all the numbers on the right hand side are equal to : a x +... + a n x n =.. a m
More informationRoots of Equations (Chapters 5 and 6)
Roots of Equations (Chapters 5 and 6) Problem: given f() = 0, find. In general, f() can be any function. For some forms of f(), analytical solutions are available. However, for other functions, we have
More informationAutomated Stellar Classification for Large Surveys with EKF and RBF Neural Networks
Chin. J. Astron. Astrophys. Vol. 5 (2005), No. 2, 203 210 (http:/www.chjaa.org) Chinese Journal of Astronomy and Astrophysics Automated Stellar Classification for Large Surveys with EKF and RBF Neural
More informationA Strategy for Teaching Finite Element Analysis to Undergraduate Students
A Strategy for Teaching Finite Element Analysis to Undergraduate Students Gordon Smyrell, School of Computing and Mathematics, University of Teesside The analytical power and design flexibility offered
More informationThe Steepest Descent Algorithm for Unconstrained Optimization and a Bisection Line-search Method
The Steepest Descent Algorithm for Unconstrained Optimization and a Bisection Line-search Method Robert M. Freund February, 004 004 Massachusetts Institute of Technology. 1 1 The Algorithm The problem
More informationAlgebra 2 Chapter 1 Vocabulary. identity - A statement that equates two equivalent expressions.
Chapter 1 Vocabulary identity - A statement that equates two equivalent expressions. verbal model- A word equation that represents a real-life problem. algebraic expression - An expression with variables.
More informationReview Jeopardy. Blue vs. Orange. Review Jeopardy
Review Jeopardy Blue vs. Orange Review Jeopardy Jeopardy Round Lectures 0-3 Jeopardy Round $200 How could I measure how far apart (i.e. how different) two observations, y 1 and y 2, are from each other?
More informationOpenFOAM Optimization Tools
OpenFOAM Optimization Tools Henrik Rusche and Aleks Jemcov h.rusche@wikki-gmbh.de and a.jemcov@wikki.co.uk Wikki, Germany and United Kingdom OpenFOAM Optimization Tools p. 1 Agenda Objective Review optimisation
More informationFast Iterative Solvers for Integral Equation Based Techniques in Electromagnetics
Fast Iterative Solvers for Integral Equation Based Techniques in Electromagnetics Mario Echeverri, PhD. Student (2 nd year, presently doing a research period abroad) ID:30360 Tutor: Prof. Francesca Vipiana,
More informationBlind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections
Blind Deconvolution of Barcodes via Dictionary Analysis and Wiener Filter of Barcode Subsections Maximilian Hung, Bohyun B. Kim, Xiling Zhang August 17, 2013 Abstract While current systems already provide
More informationHow I won the Chess Ratings: Elo vs the rest of the world Competition
How I won the Chess Ratings: Elo vs the rest of the world Competition Yannis Sismanis November 2010 Abstract This article discusses in detail the rating system that won the kaggle competition Chess Ratings:
More informationElementary Gradient-Based Parameter Estimation
Elementary Gradient-Based Parameter Estimation Julius O. Smith III Center for Computer Research in Music and Acoustics (CCRMA Department of Music, Stanford University, Stanford, California 94305 USA Abstract
More informationPalmprint Recognition. By Sree Rama Murthy kora Praveen Verma Yashwant Kashyap
Palmprint Recognition By Sree Rama Murthy kora Praveen Verma Yashwant Kashyap Palm print Palm Patterns are utilized in many applications: 1. To correlate palm patterns with medical disorders, e.g. genetic
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More informationTWO-DIMENSIONAL FINITE ELEMENT ANALYSIS OF FORCED CONVECTION FLOW AND HEAT TRANSFER IN A LAMINAR CHANNEL FLOW
TWO-DIMENSIONAL FINITE ELEMENT ANALYSIS OF FORCED CONVECTION FLOW AND HEAT TRANSFER IN A LAMINAR CHANNEL FLOW Rajesh Khatri 1, 1 M.Tech Scholar, Department of Mechanical Engineering, S.A.T.I., vidisha
More informationPricing and calibration in local volatility models via fast quantization
Pricing and calibration in local volatility models via fast quantization Parma, 29 th January 2015. Joint work with Giorgia Callegaro and Martino Grasselli Quantization: a brief history Birth: back to
More informationAdvanced Signal Processing and Digital Noise Reduction
Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New
More informationLinear Threshold Units
Linear Threshold Units w x hx (... w n x n w We assume that each feature x j and each weight w j is a real number (we will relax this later) We will study three different algorithms for learning linear
More informationLecture Notes to Accompany. Scientific Computing An Introductory Survey. by Michael T. Heath. Chapter 10
Lecture Notes to Accompany Scientific Computing An Introductory Survey Second Edition by Michael T. Heath Chapter 10 Boundary Value Problems for Ordinary Differential Equations Copyright c 2001. Reproduction
More informationApplications to Data Smoothing and Image Processing I
Applications to Data Smoothing and Image Processing I MA 348 Kurt Bryan Signals and Images Let t denote time and consider a signal a(t) on some time interval, say t. We ll assume that the signal a(t) is
More information10. Proximal point method
L. Vandenberghe EE236C Spring 2013-14) 10. Proximal point method proximal point method augmented Lagrangian method Moreau-Yosida smoothing 10-1 Proximal point method a conceptual algorithm for minimizing
More informationNumerical Methods For Image Restoration
Numerical Methods For Image Restoration CIRAM Alessandro Lanza University of Bologna, Italy Faculty of Engineering CIRAM Outline 1. Image Restoration as an inverse problem 2. Image degradation models:
More informationThe successful integration of 3D seismic into the mining process: Practical examples from Bowen Basin underground coal mines
Geophysics 165 Troy Peters The successful integration of 3D seismic into the mining process: Practical examples from Bowen Basin underground coal mines This paper discusses how mine staff from a number
More information17. Inner product spaces Definition 17.1. Let V be a real vector space. An inner product on V is a function
17. Inner product spaces Definition 17.1. Let V be a real vector space. An inner product on V is a function, : V V R, which is symmetric, that is u, v = v, u. bilinear, that is linear (in both factors):
More informationPHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY
PHOTOGRAMMETRIC TECHNIQUES FOR MEASUREMENTS IN WOODWORKING INDUSTRY V. Knyaz a, *, Yu. Visilter, S. Zheltov a State Research Institute for Aviation System (GosNIIAS), 7, Victorenko str., Moscow, Russia
More informationFourth-Order Compact Schemes of a Heat Conduction Problem with Neumann Boundary Conditions
Fourth-Order Compact Schemes of a Heat Conduction Problem with Neumann Boundary Conditions Jennifer Zhao, 1 Weizhong Dai, Tianchan Niu 1 Department of Mathematics and Statistics, University of Michigan-Dearborn,
More informationChapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network
Chapter 2 The Research on Fault Diagnosis of Building Electrical System Based on RBF Neural Network Qian Wu, Yahui Wang, Long Zhang and Li Shen Abstract Building electrical system fault diagnosis is the
More informationZeros of a Polynomial Function
Zeros of a Polynomial Function An important consequence of the Factor Theorem is that finding the zeros of a polynomial is really the same thing as factoring it into linear factors. In this section we
More informationIntroduction to the Finite Element Method (FEM)
Introduction to the Finite Element Method (FEM) ecture First and Second Order One Dimensional Shape Functions Dr. J. Dean Discretisation Consider the temperature distribution along the one-dimensional
More informationYousef Saad University of Minnesota Computer Science and Engineering. CRM Montreal - April 30, 2008
A tutorial on: Iterative methods for Sparse Matrix Problems Yousef Saad University of Minnesota Computer Science and Engineering CRM Montreal - April 30, 2008 Outline Part 1 Sparse matrices and sparsity
More informationMAT 200, Midterm Exam Solution. a. (5 points) Compute the determinant of the matrix A =
MAT 200, Midterm Exam Solution. (0 points total) a. (5 points) Compute the determinant of the matrix 2 2 0 A = 0 3 0 3 0 Answer: det A = 3. The most efficient way is to develop the determinant along the
More informationProbability and Random Variables. Generation of random variables (r.v.)
Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly
More informationNonlinear Programming Methods.S2 Quadratic Programming
Nonlinear Programming Methods.S2 Quadratic Programming Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard A linearly constrained optimization problem with a quadratic objective
More informationSubsalt Interferometric Imaging using Walkaway VSP and Offset Free Cable geometry: A Modeling Study
Subsalt Interferometric Imaging using Walkaway VSP and Offset Free Cable geometry: A Modeling Study Cemal Erdemir *, Ashwani Dev, Ion Geophysical Corporation, Houston, TX. Summary This study suggests that
More informationFull azimuth angle domain decomposition and imaging: A comprehensive solution for anisotropic velocity model determination and fracture detection
P-403 Full azimuth angle domain decomposition and imaging: A comprehensive solution for anisotropic velocity model determination and fracture detection Summary Zvi Koren, Paradigm A new subsurface angle
More informationBy choosing to view this document, you agree to all provisions of the copyright laws protecting it.
This material is posted here with permission of the IEEE Such permission of the IEEE does not in any way imply IEEE endorsement of any of Helsinki University of Technology's products or services Internal
More informationAccurate and robust image superresolution by neural processing of local image representations
Accurate and robust image superresolution by neural processing of local image representations Carlos Miravet 1,2 and Francisco B. Rodríguez 1 1 Grupo de Neurocomputación Biológica (GNB), Escuela Politécnica
More informationMarine Technology Society
Marine Technology Society Dynamic Positioning Conference 21-22 October, 1997 Session 9 Control Systems Improved DP Performance in Deep Water Operations Through Advanced Reference System Processing and
More informationAP PHYSICS C Mechanics - SUMMER ASSIGNMENT FOR 2016-2017
AP PHYSICS C Mechanics - SUMMER ASSIGNMENT FOR 2016-2017 Dear Student: The AP physics course you have signed up for is designed to prepare you for a superior performance on the AP test. To complete material
More informationGLM, insurance pricing & big data: paying attention to convergence issues.
GLM, insurance pricing & big data: paying attention to convergence issues. Michaël NOACK - michael.noack@addactis.com Senior consultant & Manager of ADDACTIS Pricing Copyright 2014 ADDACTIS Worldwide.
More informationEquations, Inequalities & Partial Fractions
Contents Equations, Inequalities & Partial Fractions.1 Solving Linear Equations 2.2 Solving Quadratic Equations 1. Solving Polynomial Equations 1.4 Solving Simultaneous Linear Equations 42.5 Solving Inequalities
More informationMobile Robot FastSLAM with Xbox Kinect
Mobile Robot FastSLAM with Xbox Kinect Design Team Taylor Apgar, Sean Suri, Xiangdong Xi Design Advisor Prof. Greg Kowalski Abstract Mapping is an interesting and difficult problem in robotics. In order
More informationSimultaneous Gamma Correction and Registration in the Frequency Domain
Simultaneous Gamma Correction and Registration in the Frequency Domain Alexander Wong a28wong@uwaterloo.ca William Bishop wdbishop@uwaterloo.ca Department of Electrical and Computer Engineering University
More informationi=1 In practice, the natural logarithm of the likelihood function, called the log-likelihood function and denoted by
Statistics 580 Maximum Likelihood Estimation Introduction Let y (y 1, y 2,..., y n be a vector of iid, random variables from one of a family of distributions on R n and indexed by a p-dimensional parameter
More informationSTA 4273H: Statistical Machine Learning
STA 4273H: Statistical Machine Learning Russ Salakhutdinov Department of Statistics! rsalakhu@utstat.toronto.edu! http://www.cs.toronto.edu/~rsalakhu/ Lecture 6 Three Approaches to Classification Construct
More informationAn Introduction to Applied Mathematics: An Iterative Process
An Introduction to Applied Mathematics: An Iterative Process Applied mathematics seeks to make predictions about some topic such as weather prediction, future value of an investment, the speed of a falling
More informationHow do we understand and visualize uncertainty?
How do we understand and visualize uncertainty? MALCOLM SAMBRIDGE, Australian National University, Canberra CAROLINE BEGHEIN, Arizona State University, Tempe, USA FREDERIK J. SIMONS, University College,
More informationDispersion diagrams of a water-loaded cylindrical shell obtained from the structural and acoustic responses of the sensor array along the shell
Dispersion diagrams of a water-loaded cylindrical shell obtained from the structural and acoustic responses of the sensor array along the shell B.K. Jung ; J. Ryue ; C.S. Hong 3 ; W.B. Jeong ; K.K. Shin
More informationAuto-Tuning Using Fourier Coefficients
Auto-Tuning Using Fourier Coefficients Math 56 Tom Whalen May 20, 2013 The Fourier transform is an integral part of signal processing of any kind. To be able to analyze an input signal as a superposition
More informationMUSIC-like Processing of Pulsed Continuous Wave Signals in Active Sonar Experiments
23rd European Signal Processing Conference EUSIPCO) MUSIC-like Processing of Pulsed Continuous Wave Signals in Active Sonar Experiments Hock Siong LIM hales Research and echnology, Singapore hales Solutions
More informationPrinciples of Big Data Algorithms and Application for Unconventional Oil and Gas Resources
SPE-172982-MS Principles of Big Data Algorithms and Application for Unconventional Oil and Gas Resources Avi Lin, Halliburton Copyright 2014, Society of Petroleum Engineers This paper was prepared for
More informationJPEG compression of monochrome 2D-barcode images using DCT coefficient distributions
Edith Cowan University Research Online ECU Publications Pre. JPEG compression of monochrome D-barcode images using DCT coefficient distributions Keng Teong Tan Hong Kong Baptist University Douglas Chai
More informationWii Remote Calibration Using the Sensor Bar
Wii Remote Calibration Using the Sensor Bar Alparslan Yildiz Abdullah Akay Yusuf Sinan Akgul GIT Vision Lab - http://vision.gyte.edu.tr Gebze Institute of Technology Kocaeli, Turkey {yildiz, akay, akgul}@bilmuh.gyte.edu.tr
More information4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.
4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.uk 1 1 Outline The LMS algorithm Overview of LMS issues
More informationImaging the earth using seismic diffractions
Imaging the earth using seismic diffractions Rongfeng Zhang Abstract Diffractions in seismic data indicate discontinuities of the subsurface, although they are often obscured by and difficult to separate
More informationAgilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox. Application Note
Agilent Creating Multi-tone Signals With the N7509A Waveform Generation Toolbox Application Note Introduction Of all the signal engines in the N7509A, the most complex is the multi-tone engine. This application
More informationIEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1 Active-Set Newton Algorithm for Overcomplete Non-Negative Representations of Audio Tuomas Virtanen, Member,
More informationCreating a NL Texas Hold em Bot
Creating a NL Texas Hold em Bot Introduction Poker is an easy game to learn by very tough to master. One of the things that is hard to do is controlling emotions. Due to frustration, many have made the
More informationExact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure
Exact Inference for Gaussian Process Regression in case of Big Data with the Cartesian Product Structure Belyaev Mikhail 1,2,3, Burnaev Evgeny 1,2,3, Kapushev Yermek 1,2 1 Institute for Information Transmission
More information14TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF
14 TH INTERNATIONAL CONGRESS OF THE BRAZILIAN GEOPHYSICAL SOCIETY AND EXPOGEF August 3 6, 2015 I Rio de Janeiro, RJ Sulamérica Convention Center, Booth #49 Solving challenges. Theatre Schedule: Booth #49
More informationNumerical Analysis Introduction. Student Audience. Prerequisites. Technology.
Numerical Analysis Douglas Faires, Youngstown State University, (Chair, 2012-2013) Elizabeth Yanik, Emporia State University, (Chair, 2013-2015) Graeme Fairweather, Executive Editor, Mathematical Reviews,
More informationAutomatic Detection of Emergency Vehicles for Hearing Impaired Drivers
Automatic Detection of Emergency Vehicles for Hearing Impaired Drivers Sung-won ark and Jose Trevino Texas A&M University-Kingsville, EE/CS Department, MSC 92, Kingsville, TX 78363 TEL (36) 593-2638, FAX
More informationA Negative Result Concerning Explicit Matrices With The Restricted Isometry Property
A Negative Result Concerning Explicit Matrices With The Restricted Isometry Property Venkat Chandar March 1, 2008 Abstract In this note, we prove that matrices whose entries are all 0 or 1 cannot achieve
More information