Solutions of Equations in One Variable. FixedPoint Iteration II


 Jocelin Woods
 1 years ago
 Views:
Transcription
1 Solutions of Equations in One Variable FixedPoint Iteration II Numerical Analysis (9th Edition) R L Burden & J D Faires Beamer Presentation Slides prepared by John Carroll Dublin City University c 2011 Brooks/Cole, Cengage Learning
2 Outline 1 Functional (FixedPoint) Iteration Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 2 / 54
3 Outline 1 Functional (FixedPoint) Iteration 2 Convergence Criteria for the FixedPoint Method Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 2 / 54
4 Outline 1 Functional (FixedPoint) Iteration 2 Convergence Criteria for the FixedPoint Method 3 Sample Problem: f (x) = x 3 + 4x 2 10 = 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 2 / 54
5 Outline 1 Functional (FixedPoint) Iteration 2 Convergence Criteria for the FixedPoint Method 3 Sample Problem: f (x) = x 3 + 4x 2 10 = 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 3 / 54
6 Functional (FixedPoint) Iteration Now that we have established a condition for which g(x) has a unique fixed point in I, there remains the problem of how to find it. The technique employed is known as fixedpoint iteration. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 4 / 54
7 Functional (FixedPoint) Iteration Now that we have established a condition for which g(x) has a unique fixed point in I, there remains the problem of how to find it. The technique employed is known as fixedpoint iteration. Basic Approach To approximate the fixed point of a function g, we choose an initial approximation p 0 and generate the sequence {p n } n=0 by letting p n = g(p n 1 ), for each n 1. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 4 / 54
8 Functional (FixedPoint) Iteration Now that we have established a condition for which g(x) has a unique fixed point in I, there remains the problem of how to find it. The technique employed is known as fixedpoint iteration. Basic Approach To approximate the fixed point of a function g, we choose an initial approximation p 0 and generate the sequence {p n } n=0 by letting p n = g(p n 1 ), for each n 1. If the sequence converges to p and g is continuous, then ( ) p = lim p n = lim g(p n 1 ) = g lim p n 1 = g(p), n n n and a solution to x = g(x) is obtained. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 4 / 54
9 Functional (FixedPoint) Iteration Now that we have established a condition for which g(x) has a unique fixed point in I, there remains the problem of how to find it. The technique employed is known as fixedpoint iteration. Basic Approach To approximate the fixed point of a function g, we choose an initial approximation p 0 and generate the sequence {p n } n=0 by letting p n = g(p n 1 ), for each n 1. If the sequence converges to p and g is continuous, then ( ) p = lim p n = lim g(p n 1 ) = g lim p n 1 = g(p), n n n and a solution to x = g(x) is obtained. This technique is called fixedpoint, or functional iteration. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 4 / 54
10 Functional (FixedPoint) Iteration y p 2 5 g(p 1 ) p 3 5 g(p 2 ) p 1 5 g(p 0 ) (p 1, p 1 ) (p 1, p 2 ) (p 2, p 2 ) y 5 x (p 0, p 1 ) y p 3 5 g(p 2 ) p 2 5 g(p 1 ) p 1 5 g(p 0 ) (p 0, p 1 ) y 5 x (p 2, p 3 ) y 5 g(x) (p 2, p 2 ) (p 1, p 1 ) y 5 g(x) p 1 p 3 p 2 p 0 x p 0 p 1 p 2 x (a) (b) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 5 / 54
11 Functional (FixedPoint) Iteration Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
12 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
13 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: 1. n = 1; Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
14 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: 1. n = 1; 2. p n = g(p n 1 ); Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
15 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: 1. n = 1; 2. p n = g(p n 1 ); 3. If p n p n 1 < ɛ then 5; Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
16 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: 1. n = 1; 2. p n = g(p n 1 ); 3. If p n p n 1 < ɛ then 5; 4. n n + 1; go to 2. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
17 Functional (FixedPoint) Iteration FixedPoint Algorithm To find the fixed point of g in an interval [a, b], given the equation x = g(x) with an initial guess p 0 [a, b]: 1. n = 1; 2. p n = g(p n 1 ); 3. If p n p n 1 < ɛ then 5; 4. n n + 1; go to End of Procedure. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 6 / 54
18 A Single Nonlinear Equation Example 1 The equation x 3 + 4x 2 10 = 0 has a unique root in [1, 2]. Its value is approximately Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 7 / 54
19 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] y 14 y = f(x) = x 3 + 4x x 5 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 8 / 54
20 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] Possible Choices for g(x) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 9 / 54
21 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] Possible Choices for g(x) There are many ways to change the equation to the fixedpoint form x = g(x) using simple algebraic manipulation. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 9 / 54
22 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] Possible Choices for g(x) There are many ways to change the equation to the fixedpoint form x = g(x) using simple algebraic manipulation. For example, to obtain the function g described in part (c), we can manipulate the equation x 3 + 4x 2 10 = 0 as follows: 4x 2 = 10 x 3, so x 2 = 1 4 (10 x 3 ), and x = ± 1 2 (10 x 3 ) 1/2. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 9 / 54
23 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] Possible Choices for g(x) There are many ways to change the equation to the fixedpoint form x = g(x) using simple algebraic manipulation. For example, to obtain the function g described in part (c), we can manipulate the equation x 3 + 4x 2 10 = 0 as follows: 4x 2 = 10 x 3, so x 2 = 1 4 (10 x 3 ), and x = ± 1 2 (10 x 3 ) 1/2. We will consider 5 such rearrangements and, later in this section, provide a brief analysis as to why some do and some not converge to p = Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 9 / 54
24 Solving f (x) = x 3 + 4x 2 10 = 0 5 Possible Transpositions to x = g(x) x = g 1 (x) = x x 3 4x x = g 2 (x) = x = g 3 (x) = x 4x 10 x 3 x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 10 / 54
25 Numerical Results for f (x) = x 3 + 4x 2 10 = 0 n g 1 g 2 g 3 g 4 g ( 8.65) 1/ Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 11 / 54
26 Solving f (x) = x 3 + 4x 2 10 = 0 x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x Does not Converge x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 12 / 54
27 Outline 1 Functional (FixedPoint) Iteration 2 Convergence Criteria for the FixedPoint Method 3 Sample Problem: f (x) = x 3 + 4x 2 10 = 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 13 / 54
28 Functional (FixedPoint) Iteration A Crucial Question How can we find a fixedpoint problem that produces a sequence that reliably and rapidly converges to a solution to a given rootfinding problem? Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 14 / 54
29 Functional (FixedPoint) Iteration A Crucial Question How can we find a fixedpoint problem that produces a sequence that reliably and rapidly converges to a solution to a given rootfinding problem? The following theorem and its corollary give us some clues concerning the paths we should pursue and, perhaps more importantly, some we should reject. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 14 / 54
30 Functional (FixedPoint) Iteration Convergence Result Let g C[a, b] with g(x) [a, b] for all x [a, b]. Let g (x) exist on (a, b) with g (x) k < 1, x [a, b]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 15 / 54
31 Functional (FixedPoint) Iteration Convergence Result Let g C[a, b] with g(x) [a, b] for all x [a, b]. Let g (x) exist on (a, b) with g (x) k < 1, x [a, b]. If p 0 is any point in [a, b] then the sequence defined by p n = g(p n 1 ), n 1, will converge to the unique fixed point p in [a, b]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 15 / 54
32 Functional (FixedPoint) Iteration Proof of the Convergence Result Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
33 Functional (FixedPoint) Iteration Proof of the Convergence Result By the Uniquenes Theorem, a unique fixed point exists in [a, b]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
34 Functional (FixedPoint) Iteration Proof of the Convergence Result By the Uniquenes Theorem, a unique fixed point exists in [a, b]. Since g maps [a, b] into itself, the sequence {p n } n=0 is defined for all n 0 and p n [a, b] for all n. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
35 Functional (FixedPoint) Iteration Proof of the Convergence Result By the Uniquenes Theorem, a unique fixed point exists in [a, b]. Since g maps [a, b] into itself, the sequence {p n } n=0 is defined for all n 0 and p n [a, b] for all n. Using the Mean Value Theorem MVT and the assumption that g (x) k < 1, x [a, b], we write p n p = g(p n 1 ) g(p) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
36 Functional (FixedPoint) Iteration Proof of the Convergence Result By the Uniquenes Theorem, a unique fixed point exists in [a, b]. Since g maps [a, b] into itself, the sequence {p n } n=0 is defined for all n 0 and p n [a, b] for all n. Using the Mean Value Theorem MVT and the assumption that g (x) k < 1, x [a, b], we write p n p = g(p n 1 ) g(p) g (ξ) p n 1 p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
37 Functional (FixedPoint) Iteration Proof of the Convergence Result By the Uniquenes Theorem, a unique fixed point exists in [a, b]. Since g maps [a, b] into itself, the sequence {p n } n=0 is defined for all n 0 and p n [a, b] for all n. Using the Mean Value Theorem MVT and the assumption that g (x) k < 1, x [a, b], we write where ξ (a, b). p n p = g(p n 1 ) g(p) g (ξ) p n 1 p k p n 1 p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 16 / 54
38 Functional (FixedPoint) Iteration Proof of the Convergence Result (Cont d) Applying the inequality of the hypothesis inductively gives Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 17 / 54
39 Functional (FixedPoint) Iteration Proof of the Convergence Result (Cont d) Applying the inequality of the hypothesis inductively gives p n p k p n 1 p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 17 / 54
40 Functional (FixedPoint) Iteration Proof of the Convergence Result (Cont d) Applying the inequality of the hypothesis inductively gives p n p k p n 1 p k 2 p n 2 p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 17 / 54
41 Functional (FixedPoint) Iteration Proof of the Convergence Result (Cont d) Applying the inequality of the hypothesis inductively gives p n p k p n 1 p k 2 p n 2 p k n p 0 p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 17 / 54
42 Functional (FixedPoint) Iteration Proof of the Convergence Result (Cont d) Applying the inequality of the hypothesis inductively gives Since k < 1, and {p n } n=0 converges to p. p n p k p n 1 p k 2 p n 2 p k n p 0 p lim p n p lim k n p 0 p = 0, n n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 17 / 54
43 Functional (FixedPoint) Iteration Corrollary to the Convergence Result If g satisfies the hypothesis of the Theorem, then p n p k n 1 k p 1 p 0. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 18 / 54
44 Functional (FixedPoint) Iteration Corrollary to the Convergence Result If g satisfies the hypothesis of the Theorem, then p n p k n 1 k p 1 p 0. Proof of Corollary (1 of 3) For n 1, the procedure used in the proof of the theorem implies that p n+1 p n = g(p n ) g(p n 1 ) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 18 / 54
45 Functional (FixedPoint) Iteration Corrollary to the Convergence Result If g satisfies the hypothesis of the Theorem, then p n p k n 1 k p 1 p 0. Proof of Corollary (1 of 3) For n 1, the procedure used in the proof of the theorem implies that p n+1 p n = g(p n ) g(p n 1 ) k p n p n 1 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 18 / 54
46 Functional (FixedPoint) Iteration Corrollary to the Convergence Result If g satisfies the hypothesis of the Theorem, then p n p k n 1 k p 1 p 0. Proof of Corollary (1 of 3) For n 1, the procedure used in the proof of the theorem implies that p n+1 p n = g(p n ) g(p n 1 ) k p n p n 1 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 18 / 54
47 Functional (FixedPoint) Iteration Corrollary to the Convergence Result If g satisfies the hypothesis of the Theorem, then p n p k n 1 k p 1 p 0. Proof of Corollary (1 of 3) For n 1, the procedure used in the proof of the theorem implies that p n+1 p n = g(p n ) g(p n 1 ) k p n p n 1 k n p 1 p 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 18 / 54
48 Functional (FixedPoint) Iteration Proof of Corollary (2 of 3) p n+1 p n k n p 1 p 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 19 / 54
49 Functional (FixedPoint) Iteration p n+1 p n k n p 1 p 0 Proof of Corollary (2 of 3) Thus, for m > n 1, p m p n = p m p m 1 + p m 1 p m p n+1 p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 19 / 54
50 Functional (FixedPoint) Iteration p n+1 p n k n p 1 p 0 Proof of Corollary (2 of 3) Thus, for m > n 1, p m p n = p m p m 1 + p m 1 p m p n+1 p n p m p m 1 + p m 1 p m p n+1 p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 19 / 54
51 Functional (FixedPoint) Iteration p n+1 p n k n p 1 p 0 Proof of Corollary (2 of 3) Thus, for m > n 1, p m p n = p m p m 1 + p m 1 p m p n+1 p n p m p m 1 + p m 1 p m p n+1 p n k m 1 p 1 p 0 + k m 2 p 1 p k n p 1 p 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 19 / 54
52 Functional (FixedPoint) Iteration p n+1 p n k n p 1 p 0 Proof of Corollary (2 of 3) Thus, for m > n 1, p m p n = p m p m 1 + p m 1 p m p n+1 p n p m p m 1 + p m 1 p m p n+1 p n k m 1 p 1 p 0 + k m 2 p 1 p k n p 1 p 0 k n 1 + k + k k m n 1) p 1 p 0. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 19 / 54
53 Functional (FixedPoint) Iteration p m p n k n ( 1 + k + k k m n 1) p 1 p 0. Proof of Corollary (3 of 3) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 20 / 54
54 Functional (FixedPoint) Iteration p m p n k n ( 1 + k + k k m n 1) p 1 p 0. Proof of Corollary (3 of 3) However, since lim m p m = p, we obtain p p n = lim m p m p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 20 / 54
55 Functional (FixedPoint) Iteration p m p n k n ( 1 + k + k k m n 1) p 1 p 0. Proof of Corollary (3 of 3) However, since lim m p m = p, we obtain p p n = lim m p n m k n p 1 p 0 i=1 k i Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 20 / 54
56 Functional (FixedPoint) Iteration p m p n k n ( 1 + k + k k m n 1) p 1 p 0. Proof of Corollary (3 of 3) However, since lim m p m = p, we obtain p p n = lim m p n m k n p 1 p 0 = i=1 k i k n 1 k p 1 p 0. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 20 / 54
57 Functional (FixedPoint) Iteration Example: g(x) = g(x) = 3 x Consider the iteration function g(x) = 3 x over the interval [ 1 3, 1] starting with p 0 = 1 3. Determine a lower bound for the number of iterations n required so that p n p < 10 5? Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 21 / 54
58 Functional (FixedPoint) Iteration Example: g(x) = g(x) = 3 x Consider the iteration function g(x) = 3 x over the interval [ 1 3, 1] starting with p 0 = 1 3. Determine a lower bound for the number of iterations n required so that p n p < 10 5? Determine the Parameters of the Problem Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 21 / 54
59 Functional (FixedPoint) Iteration Example: g(x) = g(x) = 3 x Consider the iteration function g(x) = 3 x over the interval [ 1 3, 1] starting with p 0 = 1 3. Determine a lower bound for the number of iterations n required so that p n p < 10 5? Determine the Parameters of the Problem Note that p 1 = g(p 0 ) = = and, since g (x) = 3 x ln 3, we obtain the bound g (x) ln = k. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 21 / 54
60 Functional (FixedPoint) Iteration Use the Corollary Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 22 / 54
61 Functional (FixedPoint) Iteration Use the Corollary Therefore, we have p n p k n 1 k p 0 p 1 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 22 / 54
62 Functional (FixedPoint) Iteration Use the Corollary Therefore, we have p n p k n 1 k p 0 p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 22 / 54
63 Functional (FixedPoint) Iteration Use the Corollary Therefore, we have p n p k n 1 k p 0 p n n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 22 / 54
64 Functional (FixedPoint) Iteration Use the Corollary Therefore, we have p n p k n 1 k p 0 p n n We require that n < 10 5 or n > Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 22 / 54
65 Footnote on the Estimate Obtained Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 23 / 54
66 Footnote on the Estimate Obtained It is important to realise that the estimate for the number of iterations required given by the theorem is an upper bound. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 23 / 54
67 Footnote on the Estimate Obtained It is important to realise that the estimate for the number of iterations required given by the theorem is an upper bound. In the previous example, only 21 iterations are required in practice, i.e. p 21 = is accurate to Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 23 / 54
68 Footnote on the Estimate Obtained It is important to realise that the estimate for the number of iterations required given by the theorem is an upper bound. In the previous example, only 21 iterations are required in practice, i.e. p 21 = is accurate to The reason, in this case, is that we used g (1) = whereas g ( ) = Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 23 / 54
69 Footnote on the Estimate Obtained It is important to realise that the estimate for the number of iterations required given by the theorem is an upper bound. In the previous example, only 21 iterations are required in practice, i.e. p 21 = is accurate to The reason, in this case, is that we used g (1) = whereas g ( ) = If one had used k = (were it available) to compute the bound, one would obtain N = 23 which is a more accurate estimate. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 23 / 54
70 Outline 1 Functional (FixedPoint) Iteration 2 Convergence Criteria for the FixedPoint Method 3 Sample Problem: f (x) = x 3 + 4x 2 10 = 0 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 24 / 54
71 A Single Nonlinear Equation Example 2 We return to Example 1 and the equation x 3 + 4x 2 10 = 0 which has a unique root in [1, 2]. Its value is approximately Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 25 / 54
72 f (x) = x 3 + 4x 2 10 = 0 on [1, 2] y 14 y = f(x) = x 3 + 4x x 5 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 26 / 54
73 Solving f (x) = x 3 + 4x 2 10 = 0 Earlier, we listed 5 possible transpositions to x = g(x) x = g 1 (x) = x x 3 4x x = g 2 (x) = x = g 3 (x) = x 4x 10 x 3 x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 27 / 54
74 Solving f (x) = x 3 + 4x 2 10 = 0 Results Observed for x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 28 / 54
75 Solving f (x) = x 3 + 4x 2 10 = 0 x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x Does not Converge x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 29 / 54
76 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 1 (x) = x x 3 4x Iteration for x = g 1 (x) Does Not Converge Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 30 / 54
77 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 1 (x) = x x 3 4x Iteration for x = g 1 (x) Does Not Converge Since g 1 (x) = 1 3x 2 8x g 1 (1) = 10 g 1 (2) = 27 there is no interval [a, b] containing p for which g 1 (x) < 1. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 30 / 54
78 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 1 (x) = x x 3 4x Iteration for x = g 1 (x) Does Not Converge Since g 1 (x) = 1 3x 2 8x g 1 (1) = 10 g 1 (2) = 27 there is no interval [a, b] containing p for which g 1 (x) < 1. Also, note that g 1 (1) = 6 and g 2 (2) = 12 so that g(x) / [1, 2] for x [1, 2]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 30 / 54
79 Iteration Function: x = g 1 (x) = x x 3 4x Iterations starting with p 0 = 1.5 n p n 1 p n p n p n p Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 31 / 54
80 g 1 Does Not Map [1, 2] into [1, 2] y g 1 (x) = x x 3 4x x 10 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 32 / 54
81 g 1 (x) > 1 on [1, 2] y 1 2 x 10 g 1 (x) = 1 3x2 8x 27 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 33 / 54
82 Solving f (x) = x 3 + 4x 2 10 = 0 x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x Does not Converge x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 34 / 54
83 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 2 (x) = Iteration for x = g 2 (x) is Not Defined 10 x 4x Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 35 / 54
84 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 2 (x) = Iteration for x = g 2 (x) is Not Defined 10 x 4x It is clear that g 2 (x) does not map [1, 2] onto [1, 2] and the sequence {p n } n=0 is not defined for p 0 = 1.5. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 35 / 54
85 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 2 (x) = Iteration for x = g 2 (x) is Not Defined 10 x 4x It is clear that g 2 (x) does not map [1, 2] onto [1, 2] and the sequence {p n } n=0 is not defined for p 0 = 1.5. Also, there is no interval containing p such that g 2 (x) < 1 since g (1) 2.86 g (p) 3.43 and g (x) is not defined for x > Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 35 / 54
86 Iteration Function: x = g 2 (x) = 10 x 4x Iterations starting with p 0 = 1.5 n p n 1 p n p n p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 36 / 54
87 Solving f (x) = x 3 + 4x 2 10 = 0 x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x Does not Converge x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 37 / 54
88 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 3 (x) = x 3 Iteration for x = g 3 (x) Converges (Slowly) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 38 / 54
89 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 3 (x) = x 3 Iteration for x = g 3 (x) Converges (Slowly) By differentiation, g 3 (x) = 3x 2 4 < 0 for x [1, 2] 10 x 3 and so g=g 3 is strictly decreasing on [1, 2]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 38 / 54
90 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 3 (x) = x 3 Iteration for x = g 3 (x) Converges (Slowly) By differentiation, g 3 (x) = 3x 2 4 < 0 for x [1, 2] 10 x 3 and so g=g 3 is strictly decreasing on [1, 2]. However, g 3 (x) > 1 for x > 1.71 and g 3 (2) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 38 / 54
91 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 3 (x) = x 3 Iteration for x = g 3 (x) Converges (Slowly) By differentiation, g 3 (x) = 3x 2 4 < 0 for x [1, 2] 10 x 3 and so g=g 3 is strictly decreasing on [1, 2]. However, g 3 (x) > 1 for x > 1.71 and g 3 (2) A closer examination of {p n } n=0 will show that it suffices to consider the interval [1, 1.7] where g 3 (x) < 1 and g(x) [1, 1.7] for x [1, 1.7]. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 38 / 54
92 Iteration Function: x = g 3 (x) = x 3 Iterations starting with p 0 = 1.5 n p n 1 p n p n p n Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 39 / 54
93 g 3 Maps [1, 1.7] into [1, 1.7] y g 3 (x) = x x Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 40 / 54
94 g 3 (x) < 1 on [1, 1.7] y g 3 3x2 (x) = 4 10 x x 1 Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 41 / 54
95 Solving f (x) = x 3 + 4x 2 10 = 0 x = g(x) with x 0 = 1.5 x = g 1 (x) = x x 3 4x Does not Converge x = g 2 (x) = x = g 3 (x) = x 4x Does not Converge 10 x 3 Converges after 31 Iterations x = g 4 (x) = x x = g 5 (x) = x x 3 + 4x x 2 + 8x Converges after 12 Iterations Converges after 5 Iterations Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 42 / 54
96 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 4 (x) = x Iteration for x = g 4 (x) Converges (Moderately) Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 43 / 54
97 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 4 (x) = x Iteration for x = g 4 (x) Converges (Moderately) By differentiation, and it is easy to show that g 4 (x) = 10 4(4 + x) 3 < < g 4 (x) < 0.15 x [1, 2] Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 43 / 54
98 Solving f (x) = x 3 + 4x 2 10 = 0 x = g 4 (x) = x Iteration for x = g 4 (x) Converges (Moderately) By differentiation, and it is easy to show that g 4 (x) = 10 4(4 + x) 3 < < g 4 (x) < 0.15 x [1, 2] The bound on the magnitude of g 4 (x) is much smaller than that for g 3 (x) and this explains the reason for the much faster convergence. Numerical Analysis (Chapter 2) FixedPoint Iteration II R L Burden & J D Faires 43 / 54
OPRE 6201 : 2. Simplex Method
OPRE 6201 : 2. Simplex Method 1 The Graphical Method: An Example Consider the following linear program: Max 4x 1 +3x 2 Subject to: 2x 1 +3x 2 6 (1) 3x 1 +2x 2 3 (2) 2x 2 5 (3) 2x 1 +x 2 4 (4) x 1, x 2
More informationHow to Use Expert Advice
NICOLÒ CESABIANCHI Università di Milano, Milan, Italy YOAV FREUND AT&T Labs, Florham Park, New Jersey DAVID HAUSSLER AND DAVID P. HELMBOLD University of California, Santa Cruz, Santa Cruz, California
More informationHow many numbers there are?
How many numbers there are? RADEK HONZIK Radek Honzik: Charles University, Department of Logic, Celetná 20, Praha 1, 116 42, Czech Republic radek.honzik@ff.cuni.cz Contents 1 What are numbers 2 1.1 Natural
More informationFigure 2.1: Center of mass of four points.
Chapter 2 Bézier curves are named after their inventor, Dr. Pierre Bézier. Bézier was an engineer with the Renault car company and set out in the early 196 s to develop a curve formulation which would
More informationU.C. Berkeley CS276: Cryptography Handout 0.1 Luca Trevisan January, 2009. Notes on Algebra
U.C. Berkeley CS276: Cryptography Handout 0.1 Luca Trevisan January, 2009 Notes on Algebra These notes contain as little theory as possible, and most results are stated without proof. Any introductory
More information2 Integrating Both Sides
2 Integrating Both Sides So far, the only general method we have for solving differential equations involves equations of the form y = f(x), where f(x) is any function of x. The solution to such an equation
More informationA Modern Course on Curves and Surfaces. Richard S. Palais
A Modern Course on Curves and Surfaces Richard S. Palais Contents Lecture 1. Introduction 1 Lecture 2. What is Geometry 4 Lecture 3. Geometry of InnerProduct Spaces 7 Lecture 4. Linear Maps and the Euclidean
More informationFindTheNumber. 1 FindTheNumber With Comps
FindTheNumber 1 FindTheNumber With Comps Consider the following twoperson game, which we call FindTheNumber with Comps. Player A (for answerer) has a number x between 1 and 1000. Player Q (for questioner)
More informationBasic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011
Basic Concepts of Point Set Topology Notes for OU course Math 4853 Spring 2011 A. Miller 1. Introduction. The definitions of metric space and topological space were developed in the early 1900 s, largely
More informationIEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1
IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING, 2013. ACCEPTED FOR PUBLICATION 1 ActiveSet Newton Algorithm for Overcomplete NonNegative Representations of Audio Tuomas Virtanen, Member,
More informationThe Set Covering Machine
Journal of Machine Learning Research 3 (2002) 723746 Submitted 12/01; Published 12/02 The Set Covering Machine Mario Marchand School of Information Technology and Engineering University of Ottawa Ottawa,
More informationA Case Study in Approximate Linearization: The Acrobot Example
A Case Study in Approximate Linearization: The Acrobot Example Richard M. Murray Electronics Research Laboratory University of California Berkeley, CA 94720 John Hauser Department of EESystems University
More informationCritical points of once continuously differentiable functions are important because they are the only points that can be local maxima or minima.
Lecture 0: Convexity and Optimization We say that if f is a once continuously differentiable function on an interval I, and x is a point in the interior of I that x is a critical point of f if f (x) =
More informationTAKEAWAY GAMES. ALLEN J. SCHWENK California Institute of Technology, Pasadena, California INTRODUCTION
TAKEAWAY GAMES ALLEN J. SCHWENK California Institute of Technology, Pasadena, California L INTRODUCTION Several games of Tf takeaway?f have become popular. The purpose of this paper is to determine the
More informationDiscreteTime Signals and Systems
2 DiscreteTime Signals and Systems 2.0 INTRODUCTION The term signal is generally applied to something that conveys information. Signals may, for example, convey information about the state or behavior
More informationRate adaptation, Congestion Control and Fairness: A Tutorial. JEANYVES LE BOUDEC Ecole Polytechnique Fédérale de Lausanne (EPFL)
Rate adaptation, Congestion Control and Fairness: A Tutorial JEANYVES LE BOUDEC Ecole Polytechnique Fédérale de Lausanne (EPFL) September 12, 2014 2 Thanks to all who contributed to reviews and debugging
More informationA Course on Number Theory. Peter J. Cameron
A Course on Number Theory Peter J. Cameron ii Preface These are the notes of the course MTH6128, Number Theory, which I taught at Queen Mary, University of London, in the spring semester of 2009. There
More informationSome Basic Techniques of Group Theory
Chapter 5 Some Basic Techniques of Group Theory 5.1 Groups Acting on Sets In this chapter we are going to analyze and classify groups, and, if possible, break down complicated groups into simpler components.
More informationA direct approach to false discovery rates
J. R. Statist. Soc. B (2002) 64, Part 3, pp. 479 498 A direct approach to false discovery rates John D. Storey Stanford University, USA [Received June 2001. Revised December 2001] Summary. Multiplehypothesis
More informationMEP Pupil Text 12. A list of numbers which form a pattern is called a sequence. In this section, straightforward sequences are continued.
MEP Pupil Text Number Patterns. Simple Number Patterns A list of numbers which form a pattern is called a sequence. In this section, straightforward sequences are continued. Worked Example Write down the
More informationOrthogonal Bases and the QR Algorithm
Orthogonal Bases and the QR Algorithm Orthogonal Bases by Peter J Olver University of Minnesota Throughout, we work in the Euclidean vector space V = R n, the space of column vectors with n real entries
More informationCHAPTER 1. Internal Set Theory
CHAPTER 1 Internal Set Theory Ordinarily in mathematics, when one introduces a new concept one defines it. For example, if this were a book on blobs I would begin with a definition of this new predicate:
More information1. Graphing Linear Inequalities
Notation. CHAPTER 4 Linear Programming 1. Graphing Linear Inequalities x apple y means x is less than or equal to y. x y means x is greater than or equal to y. x < y means x is less than y. x > y means
More informationThe Backpropagation Algorithm
7 The Backpropagation Algorithm 7. Learning as gradient descent We saw in the last chapter that multilayered networks are capable of computing a wider range of Boolean functions than networks with a single
More informationWHICH SCORING RULE MAXIMIZES CONDORCET EFFICIENCY? 1. Introduction
WHICH SCORING RULE MAXIMIZES CONDORCET EFFICIENCY? DAVIDE P. CERVONE, WILLIAM V. GEHRLEIN, AND WILLIAM S. ZWICKER Abstract. Consider an election in which each of the n voters casts a vote consisting of
More information1 Sets and Set Notation.
LINEAR ALGEBRA MATH 27.6 SPRING 23 (COHEN) LECTURE NOTES Sets and Set Notation. Definition (Naive Definition of a Set). A set is any collection of objects, called the elements of that set. We will most
More informationAn example of a computable
An example of a computable absolutely normal number Verónica Becher Santiago Figueira Abstract The first example of an absolutely normal number was given by Sierpinski in 96, twenty years before the concept
More informationAn Introductory Course in Elementary Number Theory. Wissam Raji
An Introductory Course in Elementary Number Theory Wissam Raji 2 Preface These notes serve as course notes for an undergraduate course in number theory. Most if not all universities worldwide offer introductory
More informationLinear Control Systems
Chapter 3 Linear Control Systems Topics : 1. Controllability 2. Observability 3. Linear Feedback 4. Realization Theory Copyright c Claudiu C. Remsing, 26. All rights reserved. 7 C.C. Remsing 71 Intuitively,
More informationThis document has been written by Michaël Baudin from the Scilab Consortium. December 2010 The Scilab Consortium Digiteo. All rights reserved.
SCILAB IS NOT NAIVE This document has been written by Michaël Baudin from the Scilab Consortium. December 2010 The Scilab Consortium Digiteo. All rights reserved. December 2010 Abstract Most of the time,
More information