Group Invariant Scattering


 Chastity Harrington
 3 years ago
 Views:
Transcription
1 Group Invariant Scattering STÉPHANE MALLAT Centre de Mathématiques Appliquées de l École Polytechnique (CMAP) Institut des Hautes Études Scientifiques (IHÉS) Abstract This paper constructs translationinvariant operators on L 2.R d /, which are Lipschitzcontinuous to the action of diffeomorphisms. A scattering propagator is a pathordered product of nonlinear and noncommuting operators, each of which computes the modulus of a wavelet transform. A local integration defines a windowed scattering transform, which is proved to be Lipschitzcontinuous to the action of C 2 diffeomorphisms. As the window size increases, it converges to a wavelet scattering transform that is translation invariant. Scattering coefficients also provide representations of stationary processes. Expected values depend upon highorder moments and can discriminate processes having the same power spectrum. Scattering operators are extended on L 2.G/, where G is a compact Lie group, and are invariant under the action of G. Combining a scattering on L 2.R d / and on L 2.SO.d// defines a translation and rotationinvariant scattering on L 2.R d /. 22 Wiley Periodicals, Inc. Introduction Symmetry and invariants, which play a major role in physics [6], are making their way into signal information processing. The information content of sounds or images is typically not affected under the action of finite groups such as translations or rotations, and it is stable to the action of small diffeomorphisms that deform signals [2]. This motivates the study of translationinvariant representations of L 2.R d / functions, which are Lipschitzcontinuous to the action of diffeomorphisms and which keep highfrequency information to discriminate different types of signals. We then study invariance to the action of compact Lie groups and rotations. We first concentrate on translation invariance. Let L c f.x/ D f.x c/ denote the translation of f 2 L 2.R d / by c 2 R d. An operator ˆ from L 2.R d / to a Hilbert space H is translationinvariant if ˆ.L c f / D ˆ.f / for all f 2 L 2.R d / and c 2 R d. Canonical translationinvariant operators satisfy ˆ.f / D L a f for some a 2 R d that depends upon f [5]. The modulus of the Fourier transform of f is an example of a noncanonical translationinvariant operator. However, these translationinvariant operators are not Lipschitzcontinuous to the action of diffeomorphisms. Instabilities to deformations are wellknown to appear at high Communications on Pure and Applied Mathematics, Vol. LV, (22) 22 Wiley Periodicals, Inc.
2 332 STÉPHANE MALLAT frequencies []. The major difficulty is to maintain the Lipschitz continuity over high frequencies. To preserve stability in L 2.R d / we want ˆ to be nonexpansive: 8.f; h/ 2 L 2.R d / 2 kˆ.f / ˆ.h/k H kf hk: It is then sufficient to verify its Lipschitz continuity relative to the action of small diffeomorphisms close to translations. Such a diffeomorphism transforms x 2 R d into x.x/, where.x/ 2 R d is the displacement field. Let L f.x/ D f.x.x// denote the action of the diffeomorphism on f. Lipschitz stability means that kˆ.f / ˆ.L f /k is bounded by the size of the diffeomorphism and hence by the distance between the and, up to a multiplicative constant multiplied by kf k. Let j.x/j denote the euclidean norm in R d, jr.x/j the sup norm of the matrix r.x/, and jh.x/j the sup norm of the Hessian tensor. The weak topology on C 2 diffeomorphisms defines a distance between and over any compact subset of R d by (.) d.; / D sup j.x/j C sup jr.x/j C sup jh.x/j: x2 x2 x2 A translationinvariant operator ˆ is said to be Lipschitzcontinuous to the action of C 2 diffeomorphisms if for any compact R d there exists C such that for all f 2 L 2.R d / supported in and all 2 C 2.R d / (.2) kˆ.f / ˆ.L f /k H C kf k sup x2r d jr.x/j C sup x2r d jh.x/j : Since ˆ is translation invariant, the Lipschitz upper bound does not depend upon the maximum translation amplitude sup x j.x/j of the diffeomorphism metric (.). The Lipschitz continuity (.2) implies that ˆ is invariant to global translations, but it is much stronger. ˆ is almost invariant to local translations by.x/, up to the first and secondorder deformation terms. Highfrequency instabilities to deformations can be avoided by grouping frequencies into dyadic packets in R d with a wavelet transform. However, a wavelet transform is not translation invariant. A translationinvariant operator is constructed with a scattering procedure along multiple paths, which preserves the Lipschitz stability of wavelets to the action of diffeomorphisms. A scattering propagator is first defined as a pathordered product of nonlinear and noncommuting operators, each of which computes the modulus of a wavelet transform [3]. This cascade of convolutions and modulus can also be interpreted as a convolutional neural network []. A windowed scattering transform is a nonexpansive operator that locally integrates the scattering propagator output. For appropriate wavelets, the main theorem in Section 2 proves that a windowed scattering preserves the norm: kˆ.f /k H D kf k for all f 2 L 2.R d /, and it is Lipschitzcontinuous to C 2 diffeomorphisms. When the window size increases, windowed scattering transforms converge to a translationinvariant scattering transform defined on a path set xp that is not
3 GROUP INVARIANT SCATTERING 333 countable. Section 3 introduces a measure and a metric on xp and proves that scattering transforms of functions in L 2.R d / belong to L 2. xp ; d/. A scattering transform has striking similarities with a Fourier transform modulus but a different behavior relative to the action of diffeomorphisms. Numerical examples are shown. An open conjecture remains on conditions for strong convergence in L 2.R d /. The representation of stationary processes with the Fourier power spectrum results from the translation invariance of the Fourier modulus. Similarly, Section 4 defines an expected scattering transform that maps stationary processes to an l 2 space. Scattering coefficients depend upon highorder moments of stationary processes and thus can discriminate processes having the same secondorder moments. As opposed to the Fourier spectrum, a scattering representation is Lipschitzcontinuous to random deformations up to a log term. For large classes of ergodic processes, it is numerically observed that the scattering transform of a single realization provides a meansquare consistent estimator of the expected scattering transform. Section 5 extends scattering operators to build invariants to actions of compact Lie groups G. The left action of g 2 G on f 2 L 2.G/ is denoted L g f.r/ D f.g r/. An operator ˆ on L 2.G/ is invariant to the action of G if ˆ.L g f / D ˆ.f / for all f 2 L 2.G/ and all g 2 G. Invariant scattering operators are constructed on L 2.G/ with a scattering propagator that iterates on a wavelet transform defined on L 2.G/, and a modulus operator that removes complex phases. A translation and rotationinvariant scattering on L 2.R d / is obtained by combining a scattering on L 2.R d / and a scattering on L 2.SO.d//. Available at is a package of software to reproduce numerical experiments. Applications to audio and image classification can be found in [, 3, 4, 8]. NOTATION. kk WD sup x2r d j.x/j, k k WD sup.x;u/2r 2d j.x/.u/j, krk WD sup x2r d jr.x/j, and khk WD sup x2r d jh.x/j where jh.x/j is the norm of the Hessian tensor. The inner product of.x; y/ 2 R 2d is x y. The norm of f in a Hilbert space is kf k and in L 2.R d / kf k 2 D R jf.x/j 2 dx. The norm in L.R d / is kf k D R jf.x/jdx. We denote the Fourier transform of f by f y.!/ WD R f.x/e ix! d!. We denote by g ı f.x/ D f.gx/ the action of a group element g 2 G. An operator R parametrized by p is denoted by RŒp and RŒ D frœp g p2. The sup norm of a linear operator A in L 2.R d / is denoted by kak, and the commutator of two operators is ŒA; B D AB BA. 2 Finite Path Scattering To avoid highfrequency instabilities under the action of diffeomorphisms, Section 2.2 introduces scattering operators that iteratively apply wavelet transforms and remove complex phases with a modulus. Section 2.3 proves that a scattering is nonexpansive and preserves L 2.R d / norms. Translation invariance and Lipschitz continuity to deformations are proved in Sections 2.4 and 2.5.
4 334 STÉPHANE MALLAT 2. From Fourier to LittlewoodPaley Wavelets The Fourier transform modulus ˆ.f / D jf y j is translation invariant. Indeed, for c 2 R d, the translation L c f.x/ D f.x c/ satisfies Lc bf.!/ D e ic! f y.!/ and hence j Lc bf j D jf y j. However, deformations lead to wellknown instabilities at high frequencies []. This is illustrated with a small scaling operator, L f.x/ D f.x.x// D f.. s/x/ for.x/ D sx and krk D jsj <. If f.x/ D e ix.x/, then scaling by s translates the central frequency to. s/. If is regular with a fast decay, then (2.) kj b L f j j b f jk jsj jj kk D krk jj kf k: Since jj can be arbitrarily large, ˆ.f / D jf y j does not satisfy the Lipschitz continuity condition (.2) when scaling high frequencies. The frequency displacement from to. s/ has a small impact if sinusoidal waves are replaced by localized functions having a Fourier support that is wider at high frequencies. This is achieved by a wavelet transform [7, 4] whose properties are briefly reviewed in this section. A wavelet transform is constructed by dilating a wavelet 2 L 2.R d / with a scale sequence fa j g j 2 for a >. For image processing, usually a D 2 [3, 4]. Audio processing requires a better frequency resolution with typically a 2 =8 []. To simplify notation, we normalize a D 2, with no loss of generality. Dilated wavelets are also rotated with elements of a finite rotation group G, which also includes the reflection with respect to : x D x. If d is even, then G is a subgroup of SO.d/; if d is odd, then G is a finite subgroup of O.d/. A mother wavelet is dilated by 2 j and rotated by r 2 G, (2.2) 2 j r.x/ D 2dj.2 j r x/: Its Fourier transform is y 2 j r.!/ D y.2 j r!/. A scattering transform is computed with wavelets that can be written (2.3).x/ D e ix.x/ and hence y.!/ D y.! /; where.!/ y is a real function concentrated in a lowfrequency ball centered at! D whose radius is of the order of. As a result, y.!/ is real and concentrated in a frequency ball of the same radius but centered at! D. To simplify notation, we denote D 2 j r 2 2 G, with jj D 2 j. After dilation and rotation, y.!/ D. y! / covers a ball centered at with a radius proportional to jj D 2 j. The index thus specifies the frequency localization and spread of y. As opposed to wavelet bases, a LittlewoodPaley wavelet transform [7, 4] is a redundant representation that computes convolution values at all x 2 R d without subsampling: (2.4) 8x 2 R d W Œ f.x/ D f?.x/ D f.u/.x u/du:
5 Its Fourier transform is GROUP INVARIANT SCATTERING 335 2W Œ f.!/ D y f.!/ y.!/ D y f.!/ y.!/: If f is real then f y.!/ D f y.!/, and if y.!/ is real then W Œ f D W Œ f. Let G C denote the quotient of G with f ; g, where two rotations r and r are equivalent. It is sufficient to compute W Œ2 j r f for positive rotations r 2 G C. If f is complex, then W Œ2 j r f must be computed for all r 2 G D G C f ; g. A wavelet transform at a scale 2 only keeps wavelets of frequencies 2 j > 2. The low frequencies that are not covered by these wavelets are provided by an averaging over a spatial domain proportional to 2 : (2.5) A f D f? 2 with 2.x/ D 2 d.2 x/: If f is real, then the wavelet transform W f D fa f;.w Œ f / 2ƒ g is indexed by ƒ D f D 2 j r W r 2 G C ; 2 j > 2 g. Its norm is (2.6) kw f k 2 D ka f k 2 C 2ƒ kw Œ f k 2 : If D then W f D fw Œ f g 2ƒ with ƒ D 2 G C. Its norm is kw f k 2 D P 2ƒ kw Œ f k 2. For complexvalued functions f, all rotations in G are included by defining W f D fa f;.w Œ f / ; 2ƒ g and W f D fw Œ f g ; 2ƒ.The following proposition gives a standard LittlewoodPaley condition [7] so that W is unitary. PROPOSITION 2.. For any 2 or D, W is unitary in the spaces of realvalued or complexvalued functions in L 2.R d / if and only if for almost all! 2 R d (2.7) ˇ j D r2g j y.2 j r!/j 2 D and jy.!/j 2 D ˇ j D r2g where ˇ D for complex functions and ˇ D 2 for real functions. j y.2 j r!/j 2 ; PROOF. If f is complex, ˇ D, and one can verify that (2.7) is equivalent to (2.8) 8 2 jy.2!/j 2 C j y.2 j r!/j 2 D : j > ;r2g Since W 3 Œ2 j r f.!/ D f y.!/ y 2 j r.!/, multiplying (2.8) by jf y.!/j 2 and applying the Plancherel formula proves that kw f k 2 D kf k 2. For D the same result is obtained by letting go to.
6 336 STÉPHANE MALLAT Conversely, if kw f k 2 D kf k 2, then (2.8) is satisfied for almost all!. Otherwise, one can construct a function f where f y has a support in the domain of! where (2.8) is not valid. With the Plancherel formula we verify that kw f k 2 kf k 2, which contradicts the hypothesis. If f is real then jf y.!/j D jf y.!/j so kw Œ2 j r f k D kw Œ 2 j r f k. Hence kw f k remains the same if r is restricted to G C and is multiplied by p 2, which yields condition (2.7) with ˇ D 2. In all the following, y is a real function that satisfies the unitary condition (2.7). It implies that y./ D R.x/dx D and jy.r!/j D jy.!/j for all r 2 G. We choose y.!/ to be real and symmetric so that is also real and symmetric and.rx/ D.x/ for all r 2 G. We also suppose that and are twice differentiable and that their decay as well as the decay of their partial derivatives of order and 2 is O.. C jxj/ d 2 /. A change of variable in the wavelet transform integral shows that if f is scaled and rotated, 2 l g ı f D f.2 l gx/ with 2 l g 2 2 G, then the wavelet transform is scaled and rotated according to (2.9) W Œ.2 l g ı f / D 2 l g ı W Œ2 l g f: Since is invariant to rotations in G, we verify that A commutes with rotations in G: A.g ı f / D g ı A f for all g 2 G. In dimension d D, G D f ; g. To build a complex wavelet concentrated on a single frequency band according to (2.3), we set y.!/ D for! <. Following (2.7), W is unitary if and only if (2.) ˇ j y.2 j j!j/j 2 D and jy.!/j 2 D ˇ j 2 j D j y.2 j j!j/j 2 : If z is a real wavelet that generates a dyadic orthonormal basis of L 2.R/ [4], then y D 2 y z!> satisfies (2.7). Numerical examples in the paper are computed with a complex wavelet calculated from a cubicspline orthogonal BattleLemarié wavelet z [4]. In any dimension d 2, y 2 L 2.R d / can be defined as a separable product in frequency polar coordinates! D j!j, with in the unit sphere S d of R d : 8.j!j; / 2 R C S d y.j!j/ D y.j!j/./: The onedimensional function y.j!j/ is chosen to satisfy (2.). The Littlewood Paley condition (2.7) is then equivalent to 8 2 S d j.r /j 2 D : r2g
7 2.2 PathOrdered Scattering GROUP INVARIANT SCATTERING 337 Convolutions with wavelets define operators that are Lipschitzcontinuous under the action of diffeomorphisms, because wavelets are regular and localized functions. However, a wavelet transform is not invariant to translations, and W Œ f D f? translates when f is translated. The main difficulty is to compute translationinvariant coefficients, which remain stable under the action of diffeomorphisms and retain highfrequency information provided by wavelets. A scattering operator computes such a translationinvariant representation. We first explain how to build translationinvariant coefficients from a wavelet transform, while maintaining stability under the action of diffeomorphisms. Scattering operators are then defined, and their main properties are summarized. If U Œ is an operator defined on L 2.R d /, not necessarily linear but which commutes with translations, then R U Œ f.x/dx is translation invariant if finite. W Œ f D f? commutes with translations but R R W Œ f.x/dx D because.x/dx D. More generally, one can verify that any linear transformation of W Œ f, which is translation invariant, is necessarily. To get a nonzero invariant, we set U Œ f D M Œ W Œ f where M Œ is a nonlinear demodulation that maps W Œ f to a lowerfrequency function having a nonzero integral. The choice of M Œ must also preserve the Lipschitz continuity to diffeomorphism actions. If.x/ D e ix.x/, then.x/ D e ix.x/, and hence (2.) W Œ f.x/ D e ix.f?.x// with f.x/ D e ix f.x/: The convolution f? is a lowfrequency filtering because y.!/ D y.!/ covers a frequency ball centered at! D, of radius proportional to jj. A nonzero invariant can thus be obtained by canceling the modulation term e ix with M Œ. A simple example is (2.2) M Œ h.x/ D e ix e iˆ.y h.// h.x/ where ˆ. h.// y is the complex phase of h./. y This nonlinear phase registration guarantees that M Œ commutes with translations. From (2.) we have that R M Œ W Œ f.x/dx D jf y./j j./j. y It recovers the Fourier modulus representation, which is translation invariant but not Lipschitzcontinuous to diffeomorphisms as shown in (2.). Indeed, the demodulation operator M Œ in (2.2) commutes with translations but does not commute with the action of diffeomorphisms and in particular with dilations. The commutator norm of M Œ with a dilation is equal to 2, even for arbitrarily small dilations, which explains the resulting instabilities. Lipschitz continuity under the action of diffeomorphisms is preserved if M Œ commutes with the action of diffeomorphisms. For L 2.R d / stability, we also impose that M Œ is nonexpansive. One can prove [4] that M Œ is then necessarily a pointwise operator, which means that M Œ h.x/ depends only on the value of h at x. We further impose that km Œ hk D khk for all h 2 L 2.R d /, which
8 338 STÉPHANE MALLAT then implies that jm Œ hj D jhj. The most regular functions are obtained with M Œ h D jhj, which eliminates all phase variations. We derive from (2.) that this modulus maps W Œ f into a lowerfrequency envelope: M Œ W Œ f D jw Œ f j D jf? j: Lower frequencies created by a modulus result from interferences. For example, if f.x/ D cos. x/ C a cos. 2 x/ where and 2 are in the frequency band covered by y, then jf?.x/j D 2 j y. / C a y. 2 /e i. 2 /x j oscillates at the interference frequency j 2 j, which is smaller than j j and j 2 j. The integration R U Œ f.x/dx D R jf?.x/jdx is translation invariant but it removes all the high frequencies of jf?.x/j. To recover these high frequencies, a scattering also computes the wavelet coefficients of each U Œ f : fu Œ f? g. Translationinvariant coefficients are again obtained with a modulus U Œ U Œ f D ju Œ f? j and an integration R U Œ U Œ f.x/dx. If f.x/ D cos. x/ca cos. 2 x/ with a <, and if j 2 j jj with j 2 j in the support of y, then U Œ U Œ f is proportional to aj. /j j.j 2 j/j. The second wavelet y captures the interferences created by the modulus, between the frequency components of f in the support of y. We now introduce the scattering propagator, which extends these decompositions. DEFINITION 2.2. An ordered sequence p D. ; 2 ; : : : ; m / with k 2 ƒ D 2 G C is called a path. The empty path is denoted p D. Let U Œ f D jf? j for f 2 L 2.R d /. A scattering propagator is a pathordered product of noncommutative operators defined by (2.3) U Œp D U Œ m U Œ 2 U Œ ; with U Œ D Id. The operator U Œp is welldefined on L 2.R d / because ku Œ f k k k kf k for all 2 ƒ. The scattering propagator is a cascade of convolutions and modulus: (2.4) U Œp f D ˇˇjf? j? 2ˇˇ j? m j: Each U Œ filters the frequency component in the band covered by y and maps it to lower frequencies with the modulus. The index sequence p D. ; 2 ; : : : ; m / is thus a frequency path variable. The scaling and rotation by 2 l g 2 2 G of a path p is written 2 l gp D.2 l g ; 2 l g 2 ; : : : ; 2 l g m /. The concatenation of two paths is denoted p C p D. ; 2 ; : : : ; m ; ; 2 ; : : : ; m /; in particular, p C D. ; 2 ; : : : ; m ; /. It results from (2.3) that (2.5) U Œp C p D U Œp U Œp : Section 2. explains that if f is complex valued then its wavelet transform is W f D fw Œ f g ; 2ƒ, whereas if f is real then W f D fw Œ f g 2ƒ. If f is complex then at the next iteration U Œ f D jw Œ f j is real, so nextstage
9 GROUP INVARIANT SCATTERING 339 wavelet transforms are computed only for k 2 ƒ. The scattering propagator of a complex function is thus defined over positive paths p D. ; 2 ; : : : ; m / 2 ƒ m and negative paths denoted p D. ; 2 ; : : : ; m /. This is analogous to the positive and negative frequencies of a Fourier transform. If f is real, then W Œ f D W Œ f so U Œ f D U Œ f and hence U Œ p f D U Œp f. To simplify explanations, all results are proved on real functions with scattering propagators restricted to positive paths. These results apply to complex functions by including negative paths. DEFINITION 2.3. Let P be the set of all finite paths. The scattering transform of f 2 L.R d / is defined for any p 2 P by (2.6) xsf.p/ D U Œp f.x/dx with p D U Œp ı.x/dx: p A scattering is a translationinvariant operator that transforms f 2 L.R d / into a function of the frequency path variable p. The normalization factor p results from a path measure introduced in Section 3. Conditions are given so that p does not vanish. This transform is then welldefined for any f 2 L.R d / and any p of finite length m. Indeed, k k D k k so (2.4) implies that ku Œp f k kf k k k m. We shall see that a scattering transform shares similarities with the Fourier transform modulus, where the path p plays the role of a frequency variable. However, as opposed to a Fourier modulus, a scattering transform is stable under the action of diffeomorphisms, because it is computed by iterating on wavelet transforms and modulus operators, which are stable. For complexvalued functions, xsf is also defined on negative paths, and xsf. p/ D xsf.p/ if f is real. If p then xsf.p/ is nonlinear but it preserves amplitude factors: (2.7) 8 2 R xs.f /.p/ D jj xsf.p/: A scattering has similar scaling and rotation covariance properties as a Fourier transform. If f is scaled and rotated, 2 l g ı f.x/ D f.2 l gx/, then (2.9) implies that U Œ.2 l g ı f / D 2 l g ı U Œ2 l g f, and cascading this result shows that (2.8) 8p 2 P U Œp.2 l g ı f / D 2 l g ı U Œ2 l gp f: Inserting this result in the definition (2.6) proves that (2.9) xs.2 l g ı f /.p/ D 2 dl xsf.2 l gp/: Rotating f thus rotates identically its scattering, whereas if f is scaled by 2 l, then the frequency paths p are scaled by 2 l. The extension of the scattering transform in L 2.R d / is done as a limit of windowed scattering transforms, which we now introduce. DEFINITION 2.4. Let 2 and P be a set of finite paths p D. ; 2 ; : : : ; m / with k 2 ƒ and hence j k j D 2 j k > 2. A windowed scattering transform is
10 34 STÉPHANE MALLAT defined for all p 2 P by (2.2) S Œp f.x/ D U Œp f? 2.x/ D U Œp f.u/ 2.x u/du: The convolution with 2.x/ D 2 d.2 x/ localizes the scattering transform over spatial domains of size proportional to 2 : S Œp f.x/ D ˇˇjf? j? 2ˇˇ j? m j? 2.x/: It defines an infinite family of functions indexed by P, denoted by S ŒP f WD fs Œp f g p2p : For complexvalued functions, negative paths are also included in P, and if f is real, S Œ p f D S Œp f. Section 2.3 proves that for appropriate wavelets, kf k 2 D P p2p ks Œp f k 2. However, the signal energy is mostly concentrated on a much smaller set of frequencydecreasing paths p D. k / km for which j kc j j k j. Indeed, the propagator U Œ progressively pushes the energy towards lower frequencies. The main theorem of Section 2.5 proves that a windowed scattering is Lipschitzcontinuous under the action of diffeomorphisms. Since.x/ is continuous at, if f 2 L.R d / then its windowed scattering transform converges pointwise to its scattering transform when the scale 2 goes to : 8x 2 R d lim! 2d S Œp f.x/ D./ U Œp f.u/du (2.2) D./ p xs.p/: However, when increases, the path set P also increases. Section 3 shows that fp g 2 defines a multiresolution path approximation of a much larger set xp including paths of infinite length. This path set is not countable as opposed to each P, and Section 3 introduces a measure and a metric on xp. Section 3.2 extends the scattering transform xsf.p/ to all f 2 L 2.R d / and to all p 2 xp, and proves that xsf 2 L 2. xp ; d/. A sufficient condition is given to guarantee a strong convergence of S f to xsf, and it is conjectured that it is valid on L 2.R d /. Numerical examples illustrate this convergence and show that a scattering transform has strong similarities to a Fourier transforms modulus when mapping the path p to a frequency variable! 2 R d. 2.3 Scattering Propagation and Norm Preservation We prove that a windowed scattering S is nonexpansive and preserves the L 2.R d / norm. We denote by S Œ WD fs Œp g p2 and U Œ WD fu Œp g p2 a family of operators indexed by a path set. A windowed scattering can be computed by iterating on the onestep propagator defined by U f D fa f;.u Œ f / 2ƒ g;
11 GROUP INVARIANT SCATTERING 34 FIGURE 2.. A scattering propagator U applied to f computes each U Œ f D jf? j and outputs S Œ f D f? 2. Applying U to each U Œ f computes all U Œ ; 2 f and outputs S Œ D U Œ? 2. Applying iteratively U to each U Œp f outputs S Œp f D U Œp f? 2 and computes the next path layer. with A f D f? 2 and U Œ f D jf? j. After calculating U f, applying again U to each U Œ f yields a larger infinite family of functions. The decomposition is further iterated by recursively applying U to each U Œp f. Since U Œ U Œp D U Œp C and A U Œp D S Œp, it holds that (2.22) U U Œp f D fs Œp f;.u Œp C f / 2ƒ g: Let ƒ m be the set of paths of length m with ƒ D f g. It is propagated into (2.23) U U Œƒ m f D fs Œƒ m f; U ŒƒmC f g: Since P D S m2n ƒm, one can compute S ŒP f from f D U Œ f by iteratively computing U U Œƒ m f for m going from to, as illustrated in Figure 2.. Scattering calculations follow the general architecture of convolution neural networks introduced by LeCun []. Convolution networks cascade convolutions and a pooling nonlinearity, which is here the modulus of a complex number. Convolution networks typically use kernels that are not predefined functions such as wavelets but which are learned with backpropagation algorithms. Convolution network architectures have been successfully applied to a number of recognition tasks [] and are studied as models for visual perception [2, 7]. Relations between scattering operators and path formulations of quantum field physics are also studied in [9]. The propagator U f D fa f;.jw Œ f j/ 2ƒ g is nonexpansive because the wavelet transform W is unitary and a modulus is nonexpansive in the sense that jjaj jbjj ja bj for any.a; b/ 2 C 2. This is valid whether f is real or complex.
12 342 STÉPHANE MALLAT As a consequence, (2.24) ku f U hk 2 D ka f A hk 2 C kw f W hk 2 kf hk 2 : 2ƒ kjw Œ f j jw Œ hjk 2 Since W is unitary, setting h D also proves that ku f k D kf k, so U preserves the norm. For any path set the norms of S Œ f and U Œ f are ks Œ f k 2 D p2 ks Œp f k 2 and ku Œ f k 2 D p2 ku Œp f k 2 : Since S ŒP iterates on U, which is nonexpansive, the following proposition proves that S ŒP is also nonexpansive [2]. PROPOSITION 2.5. The scattering transform is nonexpansive: (2.25) 8.f; h/ 2 L 2.R d / 2 ks ŒP f S ŒP hk kf hk: PROOF. Since U is nonexpansive, it results from (2.23) that ku Œƒ m f U Œƒm hk2 ku U Œƒ m f D ks Œƒ m f U U Œƒ m hk2 S Œƒ m hk2 C ku Œƒ mc f U Œƒ mc hk 2 : Summing these equations for m going from to proves that (2.26) ks ŒP f S ŒP hk 2 D ks Œƒ m f S Œƒ m hk2 md kf hk 2 : Section 2.2 explains that each U Œ f D jf? j captures the frequency energy of f over a frequency band covered by y and propagates this energy towards lower frequencies. The following theorem proves this result by showing that the whole scattering energy ultimately reaches the minimum frequency 2 and is trapped by the lowpass filter 2. The propagated scattering energy thus goes to as the path length increases, and the theorem implies that ks ŒP f k D kf k. This result also applies to complexvalued functions by incorporating negative paths. ; 2 ; : : : ; m / in P. THEOREM 2.6. A scattering wavelet is said to be admissible if there exists 2 R d and, with jy.!/j jy.2!/j and y./ D, such that the function C (2.27) y.!/ D jy.! /j 2 k. jy.2 k.! //j 2 / kd
13 satisfies (2.28) D inf GROUP INVARIANT SCATTERING 343 C j!j2 j D r2g y.2 j r!/j y.2 j r!/j 2 > : If the wavelet is admissible, then for all f 2 L 2.R d / (2.29) lim ku m! Œƒm f k2 D lim ks Œƒ n m! f k2 D and ndm (2.3) ks ŒP f k D kf k: PROOF. We first prove that lim m! ku Œƒ m f k D is equivalent to having P lim m! ndm ks Œƒ n f k2 D and to ks ŒP f k D kf k. Since ku hk D khk for any h 2 L 2.R d / and U U Œƒ n f D fs Œƒ n f; U ŒƒnC g, (2.3) ku Œƒ n f k2 D ku U Œƒ n f k2 D ks Œƒ n f k2 C ku Œƒ nc f k 2 : Summing for m n < proves that lim m! ku Œƒ m f k D is equivalent P to lim m! ndm ks Œƒ n f k2 D. Since f D U Œƒ f, summing (2.3) for n < m also proves that (2.32) kf k 2 D so m nd ks ŒP f k 2 D ks Œƒ n f k2 C ku Œƒ m f k2 ; ks Œƒ n f k2 D kf k 2 nd if and only if lim m! ku Œƒ m k D. We now prove that condition (2.27) implies that lim m! ku Œƒ m f k2 D. It relies on the following lemma, which gives a lower bound of jf? j convolved with a positive function. LEMMA 2.7. If h then for any f 2 L 2.R d / (2.33) jf? j? h sup 2R d jf?? h j with h.x/ D h.x/e ix : The lemma is proved by computing ˇˇˇˇ jf? j? h.x/ D f.v/.u v/dvˇ ˇh.x u/du ˇˇˇˇ D f.v/.u v/e i.x u/ h.x u/dvˇ ˇdu ˇ f.v/.u v/h.x u/e i.x u/ dv du ˇ D
14 344 STÉPHANE MALLAT D ˇ D ˇ f.v/.x v u /h.u /e iu du dv ˇ f.v/? h.x v/dv ˇ D jf?? h j; which finishes the lemma s proof. Appendix A uses this lemma to show that the scattering energy propagates progressively towards lower frequencies and proves the following lemma: LEMMA 2.8. If (2.28) is satisfied and (2.34) kf k 2 w D then (2.35) j D r2g C j kw Œ2 j r f k 2 < 2 ku ŒP f k 2 max. C ; /kf k 2 C kf k 2 w : PROOF. The class of functions for which kf k w < is a logarithmic Sobolev class corresponding to functions that have an average modulus of continuity in L 2.R d /. Since ku ŒP f k 2 D C md ku Œƒ m f k2 ; if kf k w < then (2.35) implies that lim m! ku Œƒ m f k D. This result is extended in L 2.R d / by density. Since 2 L.R d / and y./ D, any f 2 L 2.R d / satisfies lim n! kf f n k D, where f n D f? 2 n and 2 n.x/ D 2 nd.2 n x/. We prove that lim m! ku Œƒ m f nk 2 D by showing that kf n k w <. Indeed, kw Œ2 j r f n k 2 D jf y.!/j 2 jy.2 n!/j 2 j y.2 j r!/j 2 d! C 2 2n 2j jf y.!/j 2 d!; because has a vanishing moment so j y.!/j D O.j!j/, and the derivatives of are in L.R d / so j!j jy.!/j is bounded. Thus we have that kf n k w <. Since U Œƒ m is nonexpansive, ku Œƒ m f U Œƒm f nk kf f n k, so ku Œƒ m f k kf f nk C ku Œƒ m f nk: Since lim n! kf f n k D and lim m! ku Œƒ m f nk D, we have lim ku m! Œƒm f k2 D for any f 2 L 2.R d /.
Course 221: Analysis Academic year , First Semester
Course 221: Analysis Academic year 200708, First Semester David R. Wilkins Copyright c David R. Wilkins 1989 2007 Contents 1 Basic Theorems of Real Analysis 1 1.1 The Least Upper Bound Principle................
More information6. Metric spaces. In this section we review the basic facts about metric spaces. d : X X [0, )
6. Metric spaces In this section we review the basic facts about metric spaces. Definitions. A metric on a nonempty set X is a map with the following properties: d : X X [0, ) (i) If x, y X are points
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 19967 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More information) + ˆf (n) sin( 2πnt. = 2 u x 2, t > 0, 0 < x < 1. u(0, t) = u(1, t) = 0, t 0. (x, 0) = 0 0 < x < 1.
Introduction to Fourier analysis This semester, we re going to study various aspects of Fourier analysis. In particular, we ll spend some time reviewing and strengthening the results from Math 425 on Fourier
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More informationMA651 Topology. Lecture 6. Separation Axioms.
MA651 Topology. Lecture 6. Separation Axioms. This text is based on the following books: Fundamental concepts of topology by Peter O Neil Elements of Mathematics: General Topology by Nicolas Bourbaki Counterexamples
More informationCourse 421: Algebraic Topology Section 1: Topological Spaces
Course 421: Algebraic Topology Section 1: Topological Spaces David R. Wilkins Copyright c David R. Wilkins 1988 2008 Contents 1 Topological Spaces 1 1.1 Continuity and Topological Spaces...............
More informationMetric Spaces. Chapter 1
Chapter 1 Metric Spaces Many of the arguments you have seen in several variable calculus are almost identical to the corresponding arguments in one variable calculus, especially arguments concerning convergence
More informationInfinite product spaces
Chapter 7 Infinite product spaces So far we have talked a lot about infinite sequences of independent random variables but we have never shown how to construct such sequences within the framework of probability/measure
More informationProblem Set. Problem Set #2. Math 5322, Fall December 3, 2001 ANSWERS
Problem Set Problem Set #2 Math 5322, Fall 2001 December 3, 2001 ANSWERS i Problem 1. [Problem 18, page 32] Let A P(X) be an algebra, A σ the collection of countable unions of sets in A, and A σδ the collection
More informationThe Dirichlet Unit Theorem
Chapter 6 The Dirichlet Unit Theorem As usual, we will be working in the ring B of algebraic integers of a number field L. Two factorizations of an element of B are regarded as essentially the same if
More informationThe Ideal Class Group
Chapter 5 The Ideal Class Group We will use Minkowski theory, which belongs to the general area of geometry of numbers, to gain insight into the ideal class group of a number field. We have already mentioned
More informationBANACH AND HILBERT SPACE REVIEW
BANACH AND HILBET SPACE EVIEW CHISTOPHE HEIL These notes will briefly review some basic concepts related to the theory of Banach and Hilbert spaces. We are not trying to give a complete development, but
More informationLimits and convergence.
Chapter 2 Limits and convergence. 2.1 Limit points of a set of real numbers 2.1.1 Limit points of a set. DEFINITION: A point x R is a limit point of a set E R if for all ε > 0 the set (x ε,x + ε) E is
More informationDISTRIBUTIONS AND FOURIER TRANSFORM
DISTRIBUTIONS AND FOURIER TRANSFORM MIKKO SALO Introduction. The theory of distributions, or generalized functions, provides a unified framework for performing standard calculus operations on nonsmooth
More informationx = (x 1,..., x d ), y = (y 1,..., y d ) x + y = (x 1 + y 1,..., x d + y d ), x = (x 1,..., x d ), t R tx = (tx 1,..., tx d ).
1. Lebesgue Measure 2. Outer Measure 3. Radon Measures on R 4. Measurable Functions 5. Integration 6. CoinTossing Measure 7. Product Measures 8. Change of Coordinates 1. Lebesgue Measure Throughout R
More informationREAL ANALYSIS I HOMEWORK 2
REAL ANALYSIS I HOMEWORK 2 CİHAN BAHRAN The questions are from Stein and Shakarchi s text, Chapter 1. 1. Prove that the Cantor set C constructed in the text is totally disconnected and perfect. In other
More informationFactorization Theorems
Chapter 7 Factorization Theorems This chapter highlights a few of the many factorization theorems for matrices While some factorization results are relatively direct, others are iterative While some factorization
More informationCylinder Maps and the Schwarzian
Cylinder Maps and the Schwarzian John Milnor Stony Brook University (www.math.sunysb.edu) Bremen June 16, 2008 Cylinder Maps 1 work with Araceli Bonifant Let C denote the cylinder (R/Z) I. (.5, 1) fixed
More informationThis chapter describes set theory, a mathematical theory that underlies all of modern mathematics.
Appendix A Set Theory This chapter describes set theory, a mathematical theory that underlies all of modern mathematics. A.1 Basic Definitions Definition A.1.1. A set is an unordered collection of elements.
More information1. Periodic Fourier series. The Fourier expansion of a 2πperiodic function f is:
CONVERGENCE OF FOURIER SERIES 1. Periodic Fourier series. The Fourier expansion of a 2πperiodic function f is: with coefficients given by: a n = 1 π f(x) a 0 2 + a n cos(nx) + b n sin(nx), n 1 f(x) cos(nx)dx
More informationChapter 1. Metric Spaces. Metric Spaces. Examples. Normed linear spaces
Chapter 1. Metric Spaces Metric Spaces MA222 David Preiss d.preiss@warwick.ac.uk Warwick University, Spring 2008/2009 Definitions. A metric on a set M is a function d : M M R such that for all x, y, z
More informationModule MA1S11 (Calculus) Michaelmas Term 2016 Section 3: Functions
Module MA1S11 (Calculus) Michaelmas Term 2016 Section 3: Functions D. R. Wilkins Copyright c David R. Wilkins 2016 Contents 3 Functions 43 3.1 Functions between Sets...................... 43 3.2 Injective
More informationCompactness in metric spaces
MATHEMATICS 3103 (Functional Analysis) YEAR 2012 2013, TERM 2 HANDOUT #2: COMPACTNESS OF METRIC SPACES Compactness in metric spaces The closed intervals [a, b] of the real line, and more generally the
More informationMath 5311 Gateaux differentials and Frechet derivatives
Math 5311 Gateaux differentials and Frechet derivatives Kevin Long January 26, 2009 1 Differentiation in vector spaces Thus far, we ve developed the theory of minimization without reference to derivatives.
More informationBasic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011
Basic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011 A. Miller 1. Introduction. The definitions of metric space and topological space were developed in the early 1900 s, largely
More informationINDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS
INDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS STEVEN P. LALLEY AND ANDREW NOBEL Abstract. It is shown that there are no consistent decision rules for the hypothesis testing problem
More informationWavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)
Wavelet analysis In the case of Fourier series, the orthonormal basis is generated by integral dilation of a single function e jx Every 2πperiodic squareintegrable function is generated by a superposition
More informationMathematical Methods of Engineering Analysis
Mathematical Methods of Engineering Analysis Erhan Çinlar Robert J. Vanderbei February 2, 2000 Contents Sets and Functions 1 1 Sets................................... 1 Subsets.............................
More informationTHE FUNDAMENTAL THEOREM OF ALGEBRA VIA PROPER MAPS
THE FUNDAMENTAL THEOREM OF ALGEBRA VIA PROPER MAPS KEITH CONRAD 1. Introduction The Fundamental Theorem of Algebra says every nonconstant polynomial with complex coefficients can be factored into linear
More informationk=1 k2, and therefore f(m + 1) = f(m) + (m + 1) 2 =
Math 104: Introduction to Analysis SOLUTIONS Alexander Givental HOMEWORK 1 1.1. Prove that 1 2 +2 2 + +n 2 = 1 n(n+1)(2n+1) for all n N. 6 Put f(n) = n(n + 1)(2n + 1)/6. Then f(1) = 1, i.e the theorem
More information1. Prove that the empty set is a subset of every set.
1. Prove that the empty set is a subset of every set. Basic Topology Written by MenGen Tsai email: b89902089@ntu.edu.tw Proof: For any element x of the empty set, x is also an element of every set since
More informationFUNCTIONAL ANALYSIS LECTURE NOTES: QUOTIENT SPACES
FUNCTIONAL ANALYSIS LECTURE NOTES: QUOTIENT SPACES CHRISTOPHER HEIL 1. Cosets and the Quotient Space Any vector space is an abelian group under the operation of vector addition. So, if you are have studied
More information2.3 Convex Constrained Optimization Problems
42 CHAPTER 2. FUNDAMENTAL CONCEPTS IN CONVEX OPTIMIZATION Theorem 15 Let f : R n R and h : R R. Consider g(x) = h(f(x)) for all x R n. The function g is convex if either of the following two conditions
More informationMath 563 Measure Theory Project 1 (Funky Functions Group) Luis Zerón, Sergey Dyachenko
Math 563 Measure Theory Project (Funky Functions Group) Luis Zerón, Sergey Dyachenko 34 Let C and C be any two Cantor sets (constructed in Exercise 3) Show that there exists a function F: [,] [,] with
More informationMetric Spaces. Chapter 7. 7.1. Metrics
Chapter 7 Metric Spaces A metric space is a set X that has a notion of the distance d(x, y) between every pair of points x, y X. The purpose of this chapter is to introduce metric spaces and give some
More informationINTRODUCTORY SET THEORY
M.Sc. program in mathematics INTRODUCTORY SET THEORY Katalin Károlyi Department of Applied Analysis, Eötvös Loránd University H1088 Budapest, Múzeum krt. 68. CONTENTS 1. SETS Set, equal sets, subset,
More informationPUTNAM TRAINING POLYNOMIALS. Exercises 1. Find a polynomial with integral coefficients whose zeros include 2 + 5.
PUTNAM TRAINING POLYNOMIALS (Last updated: November 17, 2015) Remark. This is a list of exercises on polynomials. Miguel A. Lerma Exercises 1. Find a polynomial with integral coefficients whose zeros include
More informationChap2: The Real Number System (See Royden pp40)
Chap2: The Real Number System (See Royden pp40) 1 Open and Closed Sets of Real Numbers The simplest sets of real numbers are the intervals. We define the open interval (a, b) to be the set (a, b) = {x
More informationFunction Sequences and Series
Chapter 7 Function Sequences and Series 7.1 Complex Numbers This is not meant to be a thourogh and completely rigorous construction of complex numbers but rather a quick brush up of things assumed to be
More informationIntroduction to Flocking {Stochastic Matrices}
Supelec EECI Graduate School in Control Introduction to Flocking {Stochastic Matrices} A. S. Morse Yale University Gif sur  Yvette May 21, 2012 CRAIG REYNOLDS  1987 BOIDS The Lion King CRAIG REYNOLDS
More informationMAT2400 Analysis I. A brief introduction to proofs, sets, and functions
MAT2400 Analysis I A brief introduction to proofs, sets, and functions In Analysis I there is a lot of manipulations with sets and functions. It is probably also the first course where you have to take
More information1 Limiting distribution for a Markov chain
Copyright c 2009 by Karl Sigman Limiting distribution for a Markov chain In these Lecture Notes, we shall study the limiting behavior of Markov chains as time n In particular, under suitable easytocheck
More informationChapter 4, Arithmetic in F [x] Polynomial arithmetic and the division algorithm.
Chapter 4, Arithmetic in F [x] Polynomial arithmetic and the division algorithm. We begin by defining the ring of polynomials with coefficients in a ring R. After some preliminary results, we specialize
More informationFourier series. Jan Philip Solovej. English summary of notes for Analysis 1. May 8, 2012
Fourier series Jan Philip Solovej English summary of notes for Analysis 1 May 8, 2012 1 JPS, Fourier series 2 Contents 1 Introduction 2 2 Fourier series 3 2.1 Periodic functions, trigonometric polynomials
More informationx if x 0, x if x < 0.
Chapter 3 Sequences In this chapter, we discuss sequences. We say what it means for a sequence to converge, and define the limit of a convergent sequence. We begin with some preliminary results about the
More informationContinued Fractions and the Euclidean Algorithm
Continued Fractions and the Euclidean Algorithm Lecture notes prepared for MATH 326, Spring 997 Department of Mathematics and Statistics University at Albany William F Hammond Table of Contents Introduction
More informationMathematics for Econometrics, Fourth Edition
Mathematics for Econometrics, Fourth Edition Phoebus J. Dhrymes 1 July 2012 1 c Phoebus J. Dhrymes, 2012. Preliminary material; not to be cited or disseminated without the author s permission. 2 Contents
More informationSOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties
SOLUTIONS TO EXERCISES FOR MATHEMATICS 205A Part 3 Fall 2008 III. Spaces with special properties III.1 : Compact spaces I Problems from Munkres, 26, pp. 170 172 3. Show that a finite union of compact subspaces
More informationMetric Spaces Joseph Muscat 2003 (Last revised May 2009)
1 Distance J Muscat 1 Metric Spaces Joseph Muscat 2003 (Last revised May 2009) (A revised and expanded version of these notes are now published by Springer.) 1 Distance A metric space can be thought of
More information9 More on differentiation
Tel Aviv University, 2013 Measure and category 75 9 More on differentiation 9a Finite Taylor expansion............... 75 9b Continuous and nowhere differentiable..... 78 9c Differentiable and nowhere monotone......
More informationCHAPTER II THE LIMIT OF A SEQUENCE OF NUMBERS DEFINITION OF THE NUMBER e.
CHAPTER II THE LIMIT OF A SEQUENCE OF NUMBERS DEFINITION OF THE NUMBER e. This chapter contains the beginnings of the most important, and probably the most subtle, notion in mathematical analysis, i.e.,
More informationPolish spaces and standard Borel spaces
APPENDIX A Polish spaces and standard Borel spaces We present here the basic theory of Polish spaces and standard Borel spaces. Standard references for this material are the books [143, 231]. A.1. Polish
More informationSequences and Convergence in Metric Spaces
Sequences and Convergence in Metric Spaces Definition: A sequence in a set X (a sequence of elements of X) is a function s : N X. We usually denote s(n) by s n, called the nth term of s, and write {s
More informationPSEUDOARCS, PSEUDOCIRCLES, LAKES OF WADA AND GENERIC MAPS ON S 2
PSEUDOARCS, PSEUDOCIRCLES, LAKES OF WADA AND GENERIC MAPS ON S 2 Abstract. We prove a BrucknerGarg type theorem for the fiber structure of a generic map from a continuum X into the unit interval I. We
More informationMathematics for Computer Science/Software Engineering. Notes for the course MSM1F3 Dr. R. A. Wilson
Mathematics for Computer Science/Software Engineering Notes for the course MSM1F3 Dr. R. A. Wilson October 1996 Chapter 1 Logic Lecture no. 1. We introduce the concept of a proposition, which is a statement
More informationA QUICK GUIDE TO THE FORMULAS OF MULTIVARIABLE CALCULUS
A QUIK GUIDE TO THE FOMULAS OF MULTIVAIABLE ALULUS ontents 1. Analytic Geometry 2 1.1. Definition of a Vector 2 1.2. Scalar Product 2 1.3. Properties of the Scalar Product 2 1.4. Length and Unit Vectors
More informationContinuous firstorder model theory for metric structures Lecture 2 (of 3)
Continuous firstorder model theory for metric structures Lecture 2 (of 3) C. Ward Henson University of Illinois Visiting Scholar at UC Berkeley October 21, 2013 Hausdorff Institute for Mathematics, Bonn
More informationRandom graphs with a given degree sequence
Sourav Chatterjee (NYU) Persi Diaconis (Stanford) Allan Sly (Microsoft) Let G be an undirected simple graph on n vertices. Let d 1,..., d n be the degrees of the vertices of G arranged in descending order.
More informationSet theory, and set operations
1 Set theory, and set operations Sayan Mukherjee Motivation It goes without saying that a Bayesian statistician should know probability theory in depth to model. Measure theory is not needed unless we
More informationStructure of Measurable Sets
Structure of Measurable Sets In these notes we discuss the structure of Lebesgue measurable subsets of R from several different points of view. Along the way, we will see several alternative characterizations
More informationMATH 289 PROBLEM SET 1: INDUCTION. 1. The induction Principle The following property of the natural numbers is intuitively clear:
MATH 89 PROBLEM SET : INDUCTION The induction Principle The following property of the natural numbers is intuitively clear: Axiom Every nonempty subset of the set of nonnegative integers Z 0 = {0,,, 3,
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS Systems of Equations and Matrices Representation of a linear system The general system of m equations in n unknowns can be written a x + a 2 x 2 + + a n x n b a
More informationUndergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics
Undergraduate Notes in Mathematics Arkansas Tech University Department of Mathematics An Introductory Single Variable Real Analysis: A Learning Approach through Problem Solving Marcel B. Finan c All Rights
More informationMOP 2007 Black Group Integer Polynomials Yufei Zhao. Integer Polynomials. June 29, 2007 Yufei Zhao yufeiz@mit.edu
Integer Polynomials June 9, 007 Yufei Zhao yufeiz@mit.edu We will use Z[x] to denote the ring of polynomials with integer coefficients. We begin by summarizing some of the common approaches used in dealing
More informationF. ABTAHI and M. ZARRIN. (Communicated by J. Goldstein)
Journal of Algerian Mathematical Society Vol. 1, pp. 1 6 1 CONCERNING THE l p CONJECTURE FOR DISCRETE SEMIGROUPS F. ABTAHI and M. ZARRIN (Communicated by J. Goldstein) Abstract. For 2 < p
More informationREAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE
REAL ANALYSIS LECTURE NOTES: 1.4 OUTER MEASURE CHRISTOPHER HEIL 1.4.1 Introduction We will expand on Section 1.4 of Folland s text, which covers abstract outer measures also called exterior measures).
More informationAssignment 7; Due Friday, November 11
Assignment 7; Due Friday, November 9.8 a The set Q is not connected because we can write it as a union of two nonempty disjoint open sets, for instance U = (, 2) and V = ( 2, ). The connected subsets are
More informationIRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL. 1. Introduction
IRREDUCIBLE OPERATOR SEMIGROUPS SUCH THAT AB AND BA ARE PROPORTIONAL R. DRNOVŠEK, T. KOŠIR Dedicated to Prof. Heydar Radjavi on the occasion of his seventieth birthday. Abstract. Let S be an irreducible
More informationMATRIX ALGEBRA AND SYSTEMS OF EQUATIONS. + + x 2. x n. a 11 a 12 a 1n b 1 a 21 a 22 a 2n b 2 a 31 a 32 a 3n b 3. a m1 a m2 a mn b m
MATRIX ALGEBRA AND SYSTEMS OF EQUATIONS 1. SYSTEMS OF EQUATIONS AND MATRICES 1.1. Representation of a linear system. The general system of m equations in n unknowns can be written a 11 x 1 + a 12 x 2 +
More informationGROUPS ACTING ON A SET
GROUPS ACTING ON A SET MATH 435 SPRING 2012 NOTES FROM FEBRUARY 27TH, 2012 1. Left group actions Definition 1.1. Suppose that G is a group and S is a set. A left (group) action of G on S is a rule for
More informationMASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES
MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES Contents 1. Random variables and measurable functions 2. Cumulative distribution functions 3. Discrete
More informationProperties of BMO functions whose reciprocals are also BMO
Properties of BMO functions whose reciprocals are also BMO R. L. Johnson and C. J. Neugebauer The main result says that a nonnegative BMOfunction w, whose reciprocal is also in BMO, belongs to p> A p,and
More informationCARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE
CARDINALITY, COUNTABLE AND UNCOUNTABLE SETS PART ONE With the notion of bijection at hand, it is easy to formalize the idea that two finite sets have the same number of elements: we just need to verify
More informationd(f(g(p )), f(g(q))) = d(g(p ), g(q)) = d(p, Q).
10.2. (continued) As we did in Example 5, we may compose any two isometries f and g to obtain new mappings f g: E E, (f g)(p ) = f(g(p )), g f: E E, (g f)(p ) = g(f(p )). These are both isometries, the
More informationMathematics for Economics (Part I) Note 5: Convex Sets and Concave Functions
Natalia Lazzati Mathematics for Economics (Part I) Note 5: Convex Sets and Concave Functions Note 5 is based on Madden (1986, Ch. 1, 2, 4 and 7) and Simon and Blume (1994, Ch. 13 and 21). Concave functions
More informationIdeal Class Group and Units
Chapter 4 Ideal Class Group and Units We are now interested in understanding two aspects of ring of integers of number fields: how principal they are (that is, what is the proportion of principal ideals
More informationContents. Gbur, Gregory J. Mathematical methods for optical physics and engineering digitalisiert durch: IDS Basel Bern
Preface page xv 1 Vector algebra 1 1.1 Preliminaries 1 1.2 Coordinate System invariance 4 1.3 Vector multiplication 9 1.4 Useful products of vectors 12 1.5 Linear vector Spaces 13 1.6 Focus: periodic media
More informationThe Goldberg Rao Algorithm for the Maximum Flow Problem
The Goldberg Rao Algorithm for the Maximum Flow Problem COS 528 class notes October 18, 2006 Scribe: Dávid Papp Main idea: use of the blocking flow paradigm to achieve essentially O(min{m 2/3, n 1/2 }
More informationAn example of a computable
An example of a computable absolutely normal number Verónica Becher Santiago Figueira Abstract The first example of an absolutely normal number was given by Sierpinski in 96, twenty years before the concept
More informationFourier Series and SturmLiouville Eigenvalue Problems
Fourier Series and SturmLiouville Eigenvalue Problems 2009 Outline Functions Fourier Series Representation Halfrange Expansion Convergence of Fourier Series Parseval s Theorem and Mean Square Error Complex
More informationLINEAR ALGEBRA W W L CHEN
LINEAR ALGEBRA W W L CHEN c W W L Chen, 1997, 2008 This chapter is available free to all individuals, on understanding that it is not to be used for financial gain, and may be downloaded and/or photocopied,
More informationNOTES ON MEASURE THEORY. M. Papadimitrakis Department of Mathematics University of Crete. Autumn of 2004
NOTES ON MEASURE THEORY M. Papadimitrakis Department of Mathematics University of Crete Autumn of 2004 2 Contents 1 σalgebras 7 1.1 σalgebras............................... 7 1.2 Generated σalgebras.........................
More informationSolutions to Tutorial 2 (Week 3)
THE UIVERSITY OF SYDEY SCHOOL OF MATHEMATICS AD STATISTICS Solutions to Tutorial 2 (Week 3) MATH3969: Measure Theory and Fourier Analysis (Advanced) Semester 2, 2016 Web Page: http://sydney.edu.au/science/maths/u/ug/sm/math3969/
More information1. Sigma algebras. Let A be a collection of subsets of some fixed set Ω. It is called a σ algebra with the unit element Ω if. lim sup. j E j = E.
Real Analysis, course outline Denis Labutin 1 Measure theory I 1. Sigma algebras. Let A be a collection of subsets of some fixed set Ω. It is called a σ algebra with the unit element Ω if (a), Ω A ; (b)
More informationand s n (x) f(x) for all x and s.t. s n is measurable if f is. REAL ANALYSIS Measures. A (positive) measure on a measurable space
RAL ANALYSIS A survey of MA 641643, UAB 19992000 M. Griesemer Throughout these notes m denotes Lebesgue measure. 1. Abstract Integration σalgebras. A σalgebra in X is a nonempty collection of subsets
More informationGambling Systems and MultiplicationInvariant Measures
Gambling Systems and MultiplicationInvariant Measures by Jeffrey S. Rosenthal* and Peter O. Schwartz** (May 28, 997.. Introduction. This short paper describes a surprising connection between two previously
More informationRESULTANT AND DISCRIMINANT OF POLYNOMIALS
RESULTANT AND DISCRIMINANT OF POLYNOMIALS SVANTE JANSON Abstract. This is a collection of classical results about resultants and discriminants for polynomials, compiled mainly for my own use. All results
More informationMATH31011/MATH41011/MATH61011: FOURIER ANALYSIS AND LEBESGUE INTEGRATION. Chapter 4: Fourier Series and L 2 ([ π, π], µ) ( 1 π
MATH31011/MATH41011/MATH61011: FOURIER ANALYSIS AND LEBESGUE INTEGRATION Chapter 4: Fourier Series and L ([, π], µ) Square Integrable Functions Definition. Let f : [, π] R be measurable. We say that f
More informationStochastic Inventory Control
Chapter 3 Stochastic Inventory Control 1 In this chapter, we consider in much greater details certain dynamic inventory control problems of the type already encountered in section 1.3. In addition to the
More informationMATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform
MATH 433/533, Fourier Analysis Section 11, The Discrete Fourier Transform Now, instead of considering functions defined on a continuous domain, like the interval [, 1) or the whole real line R, we wish
More informationPoint Set Topology. A. Topological Spaces and Continuous Maps
Point Set Topology A. Topological Spaces and Continuous Maps Definition 1.1 A topology on a set X is a collection T of subsets of X satisfying the following axioms: T 1.,X T. T2. {O α α I} T = α IO α T.
More informationRevision of ring theory
CHAPTER 1 Revision of ring theory 1.1. Basic definitions and examples In this chapter we will revise and extend some of the results on rings that you have studied on previous courses. A ring is an algebraic
More informationRotation Rate of a Trajectory of an Algebraic Vector Field Around an Algebraic Curve
QUALITATIVE THEORY OF DYAMICAL SYSTEMS 2, 61 66 (2001) ARTICLE O. 11 Rotation Rate of a Trajectory of an Algebraic Vector Field Around an Algebraic Curve Alexei Grigoriev Department of Mathematics, The
More informationRieszFredhölm Theory
RieszFredhölm Theory T. Muthukumar tmk@iitk.ac.in Contents 1 Introduction 1 2 Integral Operators 1 3 Compact Operators 7 4 Fredhölm Alternative 14 Appendices 18 A AscoliArzelá Result 18 B Normed Spaces
More informationSome Polynomial Theorems. John Kennedy Mathematics Department Santa Monica College 1900 Pico Blvd. Santa Monica, CA 90405 rkennedy@ix.netcom.
Some Polynomial Theorems by John Kennedy Mathematics Department Santa Monica College 1900 Pico Blvd. Santa Monica, CA 90405 rkennedy@ix.netcom.com This paper contains a collection of 31 theorems, lemmas,
More informationTaylor and Maclaurin Series
Taylor and Maclaurin Series In the preceding section we were able to find power series representations for a certain restricted class of functions. Here we investigate more general problems: Which functions
More informationExtension of measure
1 Extension of measure Sayan Mukherjee Dynkin s π λ theorem We will soon need to define probability measures on infinite and possible uncountable sets, like the power set of the naturals. This is hard.
More informationP (A) = lim P (A) = N(A)/N,
1.1 Probability, Relative Frequency and Classical Definition. Probability is the study of random or nondeterministic experiments. Suppose an experiment can be repeated any number of times, so that we
More informationMATH41112/61112 Ergodic Theory Lecture Measure spaces
8. Measure spaces 8.1 Background In Lecture 1 we remarked that ergodic theory is the study of the qualitative distributional properties of typical orbits of a dynamical system and that these properties
More information