Thus, a sequence is not a Cauchy sequence if there exists ε > 0 and a subsequence (x nk : k N) with

Similar documents
CHAPTER II THE LIMIT OF A SEQUENCE OF NUMBERS DEFINITION OF THE NUMBER e.

Undergraduate Notes in Mathematics. Arkansas Tech University Department of Mathematics

1 if 1 x 0 1 if 0 x 1

Mathematical Methods of Engineering Analysis

x a x 2 (1 + x 2 ) n.

Mathematics for Econometrics, Fourth Edition

n k=1 k=0 1/k! = e. Example 6.4. The series 1/k 2 converges in R. Indeed, if s n = n then k=1 1/k, then s 2n s n = 1 n

MA4001 Engineering Mathematics 1 Lecture 10 Limits and Continuity

Notes on metric spaces

God created the integers and the rest is the work of man. (Leopold Kronecker, in an after-dinner speech at a conference, Berlin, 1886)

10.2 Series and Convergence

Metric Spaces. Chapter Metrics

FIRST YEAR CALCULUS. Chapter 7 CONTINUITY. It is a parabola, and we can draw this parabola without lifting our pencil from the paper.

THE BANACH CONTRACTION PRINCIPLE. Contents

I. GROUPS: BASIC DEFINITIONS AND EXAMPLES

Section 2.7 One-to-One Functions and Their Inverses

Metric Spaces Joseph Muscat 2003 (Last revised May 2009)

No: Bilkent University. Monotonic Extension. Farhad Husseinov. Discussion Papers. Department of Economics

1. Prove that the empty set is a subset of every set.

So let us begin our quest to find the holy grail of real analysis.

Math 55: Discrete Mathematics

Continuity of the Perron Root

MATH 289 PROBLEM SET 4: NUMBER THEORY

FUNCTIONAL ANALYSIS LECTURE NOTES: QUOTIENT SPACES

1 Norms and Vector Spaces

Math 104: Introduction to Analysis

MASSACHUSETTS INSTITUTE OF TECHNOLOGY 6.436J/15.085J Fall 2008 Lecture 5 9/17/2008 RANDOM VARIABLES

Section 1.3 P 1 = 1 2. = P n = 1 P 3 = Continuing in this fashion, it should seem reasonable that, for any n = 1, 2, 3,..., =

Sequences and Series

Metric Spaces. Chapter 1

88 CHAPTER 2. VECTOR FUNCTIONS. . First, we need to compute T (s). a By definition, r (s) T (s) = 1 a sin s a. sin s a, cos s a

SOLUTIONS TO EXERCISES FOR. MATHEMATICS 205A Part 3. Spaces with special properties

Duality of linear conic problems

Sample Induction Proofs

k, then n = p2α 1 1 pα k

1. Let P be the space of all polynomials (of one real variable and with real coefficients) with the norm

MA651 Topology. Lecture 6. Separation Axioms.

mod 10 = mod 10 = 49 mod 10 = 9.

Further Study on Strong Lagrangian Duality Property for Invex Programs via Penalty Functions 1

BANACH AND HILBERT SPACE REVIEW

Follow links for Class Use and other Permissions. For more information send to:

Mathematical Induction

Chapter 17. Orthogonal Matrices and Symmetries of Space

0 <β 1 let u(x) u(y) kuk u := sup u(x) and [u] β := sup

MATH 4330/5330, Fourier Analysis Section 11, The Discrete Fourier Transform

Introduction to Topology

I. Pointwise convergence

Linear Risk Management and Optimal Selection of a Limited Number

5544 = = = Now we have to find a divisor of 693. We can try 3, and 693 = 3 231,and we keep dividing by 3 to get: 1

t := maxγ ν subject to ν {0,1,2,...} and f(x c +γ ν d) f(x c )+cγ ν f (x c ;d).

7 Gaussian Elimination and LU Factorization

Mathematics 31 Pre-calculus and Limits

Taylor and Maclaurin Series

University of Miskolc

MATH 304 Linear Algebra Lecture 20: Inner product spaces. Orthogonal sets.

HOMEWORK 5 SOLUTIONS. n!f n (1) lim. ln x n! + xn x. 1 = G n 1 (x). (2) k + 1 n. (n 1)!

Bipan Hazarika ON ACCELERATION CONVERGENCE OF MULTIPLE SEQUENCES. 1. Introduction

Lecture 14: Section 3.3

ALMOST COMMON PRIORS 1. INTRODUCTION

Section 4.2: The Division Algorithm and Greatest Common Divisors

1 The Brownian bridge construction

Date: April 12, Contents

MATH10212 Linear Algebra. Systems of Linear Equations. Definition. An n-dimensional vector is a row or a column of n numbers (or letters): a 1.

Arkansas Tech University MATH 4033: Elementary Modern Algebra Dr. Marcel B. Finan

Real Roots of Univariate Polynomials with Real Coefficients

6.207/14.15: Networks Lecture 15: Repeated Games and Cooperation

9 More on differentiation

Invariant Option Pricing & Minimax Duality of American and Bermudan Options

Notes V General Equilibrium: Positive Theory. 1 Walrasian Equilibrium and Excess Demand

5.3 Improper Integrals Involving Rational and Exponential Functions

Random graphs with a given degree sequence

3.3 Real Zeros of Polynomials

Continued Fractions and the Euclidean Algorithm

An example of a computable

CS 103X: Discrete Structures Homework Assignment 3 Solutions

On Lexicographic (Dictionary) Preference

Practice with Proofs

MATH PROBLEMS, WITH SOLUTIONS

3. Mathematical Induction

IEOR 6711: Stochastic Models I Fall 2012, Professor Whitt, Tuesday, September 11 Normal Approximations and the Central Limit Theorem

Solving Linear Systems, Continued and The Inverse of a Matrix

Lecture Notes on Measure Theory and Functional Analysis

36 CHAPTER 1. LIMITS AND CONTINUITY. Figure 1.17: At which points is f not continuous?

THE CENTRAL LIMIT THEOREM TORONTO

8 Divisibility and prime numbers

Math 319 Problem Set #3 Solution 21 February 2002

Student Outcomes. Lesson Notes. Classwork. Discussion (10 minutes)

Section 3.7. Rolle s Theorem and the Mean Value Theorem. Difference Equations to Differential Equations

1. Let X and Y be normed spaces and let T B(X, Y ).

Inner Product Spaces

Discrete Mathematics and Probability Theory Fall 2009 Satish Rao, David Tse Note 2

Every Positive Integer is the Sum of Four Squares! (and other exciting problems)

E3: PROBABILITY AND STATISTICS lecture notes

Numerical Analysis Lecture Notes

U.C. Berkeley CS276: Cryptography Handout 0.1 Luca Trevisan January, Notes on Algebra

Lies My Calculator and Computer Told Me

Adaptive Online Gradient Descent

INDISTINGUISHABILITY OF ABSOLUTELY CONTINUOUS AND SINGULAR DISTRIBUTIONS

Transcription:

Cauchy sequences. Definition: A sequence (x n ) is said to be a Cauchy sequence if given any ε > 0, there exists K N such that x n x m < ε for all n, m K. Thus, a sequence is not a Cauchy sequence if there exists ε > 0 and a subsequence (x nk : k N) with x nk x nk+1 ε for all k N. 3.5.5 A sequence converges if and only if it is a Cauchy sequence. Proof. If a sequence converges, it is easy to see that it must be a Cauchy sequence (exercise). Next, if it is a Cauchy sequence, then it is bounded (why) and hence it has a convergent subsequence say (x nk ) by the Bolzano-Weierstrass theorem. Suppose lim(x nk : k N) = x, it is easy to check that lim(x n ) = x (exercise). Example If (s n ) is a sequence such that s n s n+1 r n for all n N, 0 r < 1, then the sequence converges. In particular, if s n = x 1 + x 2 + + x n where x n r n, then (s n ) is a Cauchy sequence and hence converges. 3.5.6 (a) x 1 = 1, x 2 = 2 and x n+2 = (x n+1 + x n )/2 for all n. (b) s n = 1 + 1 2! + + ( 1)n. n! (c) x n+1 x n r x n x n 1 for all n 2. Example 3.5.10. Solution of x 3 7x + 2 = 0. Define x n+1 = 1 7 (x3 n + 2) for suitable choice of x 1. Indeed, one can also define u = sup{x : x 3 7x + 2 < 0}. 1

2 Construction of Real numbers by Cauchy Sequence. Recall that we have constructed the set of rational numbers. However, we have yet shown that there exists a set of real numbers, i.e., a complete ordered field. We will now construct this set using rational numbers. Since we have yet to define real numbers. We will say (x n ) is a Cauchy sequence of rational numbers if given any positive rational number r, there exists K N such that x n x m < r for all n, m K. Let S be the collection of Cauchy sequences of rational numbers. We say (x n ) (y n ) if given any positive rational number ε, there exists K N such that x n y n < ε for all n K. We then show that this defines an equivalence relation on S. Exercise: (x n ) (x n+k : n N). We will now define R as the set of equivalence classes in S and let us identify any rational number r with the equivalence class that contains the sequence (r). Note that if (a) (b) where a, b Q, then a = b; see Homework/Exercise. We will now show that R is a field.

The only more difficult part is to show that each nonzero equivalence class has a multiplicative inverse. First, we will need a simple observation. Fact: If (x n ) is not a Cauchy sequence that is equivalence to 0, then there exists M, K N such that x n > 1/M for all n K. It is then clear that (x n ) is equivalence to a sequence (y n ) of rational numbers with absolute value more than 1/M. 3 Using the above sequence, we now claim that the sequence (1/y n ) is Cauchy and clearly it is the multiplicative inverse of (x n ). We next show that R is an ordered field. Similar to the previous argument, we will take the positive real numbers to be the set of equivalence classes (y n ) with y n > r for all n for some positive rational number r. Finally, we show that it is complete. In general, let ((y(k) n : n N) : k N) be a Cauchy sequence of Cauchy sequences of rational numbers. Then note that lim(y(k) : k N) = (z n : n N) for some Cauchy sequence of rational numbers (z n ). Hence every Cauchy sequence converges. For more details, see the Appendix at the end of the note.

4 Now suppose S is a nonempty set of equivalence classes of Cauchy sequences that is bounded above. For each fixed n N, consider the set ( recall that we have identified constant sequences (r) with rational numbers r) T n = {k Z : k/2 n is an upper bound of S}. First, let us show that it is nonempty. Let X be an upper bound of S. We may assume that X > 0. Now, note that 1/X > 0 and there exists rational number r = m/k, m, K N such that 0 < m/k < 1/X. Clearly 1/X > 1/K and hence K2 n T n. We next show that T n has a least number. For simplicity, let us first assume that the set has a nonnegative real number (an equivalence class of Cauchy sequences of rational numbers). Then it has a least element say n 0 by a consequence of well ordering property of natural number. Note that i n 1 T n and hence (i n 1)/2 n is not an upper bound while i n /2 n is an upper bound. (Note that we have identified the number i n /2 n to the constant sequence (r) with r = i n /2 n. Define a n = i n /2 n and check that (a n ) is a Cauchy sequence of rational numbers since a n a m 1/2 n for any m n. Finally, we need to show that [(i n /2 n )] is the least upper bound of S. Note that ((i n 1)/2 n ) [(i n /2 n )]. In general if X is a set with a distance function, we say it is complete if and only if every Cauchy sequence in the set converges. R n is complete. Cauchy sequences converges. It is not an ordered field for n > 1. But it is complete, i.e., every

5 Homework/Exercise: A. Show that multiplication of real numbers is well defined. B. Let a, b Q. Prove that the constant sequences (a) (b) if and only if a = b. C. Show that if we define the positive real numbers as above, then the set of real numbers satisfies properties 2.1.5. Sec 3.5: all questions except 1,3 and 7. (4th ed is the same as 3rd ed) Additional questions for HW4: Sec 3.5: 6,8,12. Sec 3.6: all questions except 1,6,10. (4th ed is the same as 3rd ed) Homework5: 5,7,8 in the homework on limsup and liminf below, Questions B and Sec 3.6: 1, 6, 10. Properly divergent sequences We say lim(x n ) = if given any real number α R, there exists K N such that x n > α for all n K. Note that then the sequence diverges. Similarly, we could define the meaning of lim(x n ) =. Example : lim(n) = and hence lim(n k ), lim(n!), lim(r n ) = (if r > 1.) Moreover, if lim(x n+1 /x n ) = L > 1 where (x n ) is a sequence of positive real numbers, then lim(x n ) =. A simple fact (3.6.4) Suppose x n y n for all n. Then lim(x n ) = = lim(y n ) =.

6 Operation with infinite limits: Suppose lim(x n ) = x and lim(y n ) = l, l could be infinite while x R. Then (i) lim(x n + y n ) = x + l (x + = and x =.) (ii) lim(x n y n ) = lx if x 0 (a = if a > 0.) (iii) lim(x n /y n ) = 0 if l is infinite and y n 0 for all n. Theorem 3.6.5 Let (x n ), (y n ) be sequences of positive real numbers and lim(x n /y n ) = L > 0 (L ). Then lim(x n ) = if and only if lim(y n ) =. Limit superior and limit inferior Definition Let {a n ) n=1 be a sequence of real numbers. We define its set of cluster points as follows: S(a n ) = {c R : there exists a subsequence (a nk : k N) of (a n ) that converges to c}. Examples (i) S(( 1) n ) = {1, 1}. (ii) S( 1, 1, 1, 2, 1, 1, 2, 3, 1, 1, ) = [0, 1]. 2 3 3 4 4 4 5 (iii) S(sin n) =?. Definition Let (a n ) be a bounded sequence. We define lim(a n ) = lim a n = limsup a n = sup S(a n ) n n lim(a n ) = lim n a n = liminf n a n = inf S(a n )

7 Useful Fact lim(a n ) = l if and only if (i) there exists a subsequence of (a n ) that converges to l and (ii) lim(a nk ) l for any convergent subsequence (a nk ) of (a n ). Proof. It is clear that l = lim n a n if (i) and (ii) hold. Conversely, let lim n a n = l. Then (ii) follows immediately from the definition. To prove (i), by the definition of the supremum, for each k N there exists an u k S(a n ) such that l u k > l 1 2k. But there exists a subsequence (a km ) of (a n ) that converges to u k. By choosing a subsequence of the subsequence, we may assume that a km u k < 1/2m for each m N. Moreover, we may assume that k m < (k+1) m for k, m N (again by choosing subsequences). We now note that (a kk ) is a subsequence of (a n ) that converges to l. Remark By modifying the above argument, we can also show that the set of cluster points is closed, i.e., if there exists (u k ), u k S(a n ) for all k such that u k u, then u S(a n ). Examples (1) lim n sin(nπ/4) = 1. Proof. It is clear that sin(nπ/4) 1 for all n N and lim(sin(8n + 2)π/4) = 1. 1 + 1 if n is odd n (2) Let a n = Then lim(a n ) = 1 and lim(a n ) = 2. 7 2 if n is even. n Proof. Let (a nk ) be a convergent subsequence of (a n ). It is clear that min{1 + 1 n k, 7 n k 2} a nk max{1 + 1 n k, 7 n k 2} and hence 2 lim(a nk ) 1. Finally, since lim(a 2k ) = 2 and lim(a 2k+1 ) = 1, the answer follows.

8 Theorem Let (a n ) be a sequence of real numbers. If it is bounded above we let U k = sup{a n : n k}. And if (a n ) is bounded below we let L k = inf{a n : n k}. If (a n ) is bounded, then lim(a n ) = lim(u k ) and lim(a n ) = lim(l k ). Useful properties of limit superior and limit inferior (i) lim(a n ) u if and only if given any ε > 0, there exists an N > 0 such that a n < u + ε for n > N ( ) Proof: ( = ) done in class using U k = sup{a n : n k}. ( ) Suppose on the contrary that lim(a n ) = a > u. Then (a n ) has a subsequence (a nk ) that converges to a. Take ε = (a u)/2. Then there exists N N such that a nk a < ε for all k N. In particular, we have u + ε > a nk > a ε if k max{n, N } where N is given in ( ). which is impossible as u + ε = (a + u)/2 = a ε. (ii) (Comparison of limit superior) Let a n b n for n N. Then lim(a n ) lim(b n ). (iii) lim(a n )+lim(b n ) lim(a n +b n ) lim(a n )+lim(b n ) lim(a n +b n ) lim(a n )+lim(b n ). (iv) lim( a n ) = lim(a n ). (v) If lim n a n = lim n a n = l, then (a n ) converges to l.

9 Remark (i) If a set S is not bounded above then we write sup S =, similarly we write inf S = if S is not bounded below. Clearly, if = A B, then inf B inf A sup A sup B. We will usually write inf = and sup =. (ii) We can extend the definition of limit superior to unbounded sequences as follows: if (a n ) is not bounded, it is still possible to define limit superior and limit inferior. However, we will have to define it by sup S(a n ) and inf S(a n ) and include and as possible limits. Homework on limit superior and inferior (1) Given lim(a n ) 0 and (b n ) is bounded, show that lim a nb n = lim a n lim b n. n n n (2) Show that a convergent sequence has at least a maximum or minimum element. (3) Let a n > 0 for n N. If lim n a n+1 /a n = r, show that {a n } n=1 converges if r < 1. What if r 1? (4) Show that ( π/6 lim n 0 ) 1/n sin n xdx = 1 2. (5) Given lim n a n 5 with a n > 3 for n N, show that lim n 4a n 3 + a n 5/2. (6) Show that the set of cluster points of the sequence (( 1) n ) is { 1, 1}.

10 (7) Given lim n a n a, show by using the definition that (8) Show that a 1 + a 2 + a 3 + + a n lim n n a. lim(a n )+lim(b n ) lim(a n +b n ) lim(a n )+lim(b n ) lim(a n +b n ) lim(a n )+lim(b n ). Appendix We will give a sketch to show that any Cauchy sequence of equivalence classes of Cauchy sequence of rational numbers converges to a (an equivalence class of) Cauchy sequence of rational numbers. Indeed, first we will need to choose a better representative from each equivalence class, we will choose them (by taking subsequences) such that y(k) n y(k) m < 1 if m n. 2k+n Moreover, we can choose a subsequence (y(m k )) of the Cauchy sequence such that First note we have for all l k, y(m k ) y(m l ) < 1/2 k+1 if l k. y(m k ) n y(m l ) n < 1/2 k for all n 2. Indeed, for each l k, there exists N N such that y(m k ) N y(m l )N < 1/2 k+1. Hence y(m k ) n y(m l ) n y(m k ) n y(m k ) N + y(m k ) N y(m l ) N + y(m l ) N y(m l ) n < 1/2 k for all n 2. Claim: we may take z n = y(m n ) n. It is easy to see that it is a Cauchy sequence and lim([y(m k )]) = [(z n )] and hence lim([y(k)]) = [(z n )].