SIMPLE MULTIVARIATE OPTIMIZATION
|
|
- Jeffrey Flowers
- 7 years ago
- Views:
Transcription
1 SIMPLE MULTIVARIATE OPTIMIZATION 1. DEFINITION OF LOCAL MAXIMA AND LOCAL MINIMA 1.1. Functions of variables. Let f(,x ) be defined on a region D in R containing the point (a, b). Then a: f(a, b) is a local maximum value of f if f(a, b) f(,x ) for all domain points (,x ) in an open disk centered at (a, b). b: f(a, b) is a local minimum value of f if f(a, b) f(,x ) for all domain points (,x ) in an open disk centered at (a, b). 1.. Functions of n variables. a: Consider a real valued function f with domain D in R n. Then f is said to have a local minimum at a point x D if there exists a real number δ>such that f(x) f(x ) x D satisfying x x <δ (1) b: Consider a real valued function f with domain D in R n. Then f is said to have a local maximum at a point x D if there exists a real number δ> such that f(x) f(x ) x D satisfying x x <δ () c: A real valued function f with domain D in R n is said to have a local extremum at a point x Dif either equation 1 or equation holds. d: The function f has a global maximum at x ɛ D if holds for all x ɛ D and similarly for a global minimum.. DEFINITION OF THE GRADIENT AND HESSIAN OF A FUNCTION OF n VARIABLES.1. Gradient of f. The gradient of a function of n variables f(,x,,x n ) is defined as follows. f(x) = = ( x. x n... ) x x n (3) Date: September 1, 5. 1
2 SIMPLE MULTIVARIATE OPTIMIZATION.. Hessian matrix of f. The Hessian matrix of a function of n variables f(,x,,x n ) is as follows. [ ] f f(x) = i, j = 1,,..., n x i x j = 3.1. First derivative test for local extreme values. f(x ) f(x ) x... f(x ) f(x ) x. x x..... f(x ) f(x ) x n x n x... f(x ) x n f(x ) x x n. f(x ) x n x n 3. NECESSARY CONDITIONS FOR EXTREME POINTS Theorem 1. Let x be an interior point of a domain D in R n and assume that f is twice continuously differentiable on D. It is necessary for a local minimum of f at x that (4) This implies that f(x ) = (5) (x ) = (x ) x =. (6) (x ) x n = Theorem. Let x be an interior point of a domain D in R n and assume that f is twice continuously differentiable on D. It is necessary for a local maximum of f at x that f(x ) = (7) 3.. Graphical illustration. Figure 1 shows the relative maximum of a function. The plane that is tangent to the surface at the point where the gradient is equal to zero is horizontal in the f(,x ) plane Critical points and saddle points Critical point. An interior point of the domain of a function f(,x,..., x n ) where all first partial derivatives are zero or where one or more of the first partials does not exist is a critical point of f Saddle point. A critical point that is not a local extremum is called a saddle point. We can say that a differentiable function f(,x,..., x n ) has a saddle point at a critical point (x ) if we can partition the vector x* into two subvectors (,x ) where X 1 R q and x X R p (n = p + q) with the following property f(,x ) f(,x ) f(,x ) (8)
3 SIMPLE MULTIVARIATE OPTIMIZATION 3 FIGURE 1. Local maximum of function f(,x )=e ( +x ) 1 f,x x 1 for all X 1 and x X. The idea is that a saddle point attains a maximum in one direction and a minimum in the other direction. Figure shows a function with a saddle point. The function reaches a maximum along the axis and a minimum along the x axis. A contour plot for the function f(,x ) = x 1 x in contained in figure Example problems. Find all the critical points for each of the following functions. 1: y = 16 +1x x 1 x : y = 5 +18x x 1 x 3: y = 1 +76x 4 x 1 x 4: y = +4x x 1 + x x 5: y = 3 +x x 1 +x x 6: y = 3x.4 1 x. 6 x 7: y = x.3 1 x x 4. SECOND DERIVATIVE TEST FOR LOCAL EXTREME VALUES 4.1. A theorem on second derivatives of a function and local extreme values. Theorem 3. Suppose that f(,x ) and its first and second partial derivatives are continuous throughout a disk centered at (a, b) and that (a, b) = x (a, b) =. Then a: f has a local maximum at (a, b) if f (a, b) < and f x 1 x 1 f x [ ] f x > at (a, b).
4 4 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE. Saddle point of the function f(,x )=x 1 x f,x 5 5 a x FIGURE 3. Contour plot for function f(,x )=x 1 x We can also write this as f 11 < and f 11 f f 1 > at (a, b). b: f has a local minimum at (a, b) if
5 f (a, b) > and f f x 1 x 1 x We can also write this as f 11 > and f 11 f f1 SIMPLE MULTIVARIATE OPTIMIZATION 5 [ ] f x c: fhasasaddle point at (a, b) if f f x 1 x We can also write this as f 11 f f1 [ > at (a, b). ] f x > at (a, b). < at (a, b). < at (a, b). [ ] d: The test is inconclusive at (a, b) if f f f x 1 x x = at (a, b). In this case we must find some other way to determine the behavior of f at (a, b). [ ] The expression f f f x 1 x x 1 x is called the discriminant of f. It is sometimes easier to remember it by writing it in determinant form f x 1 f x [ f x ] = f 11 f 1 f 1 f (9) The theorem says that if the discriminant is positive at the point (a, b), then the surface curves the same way in all directions; downwards if f 11 <, giving rise to a local maximum, and upwards if f 11 >, giving a local minimum. On the other hand, if the discriminant is negative at (a, b), then the surface curves up in some directions and down in others and we have a saddle point. 4.. Example problems Example 1. Taking the first partial derivatives we obtain y = x 1 x = = (1a) x = x = (1b) =, x = (1c) Thus we have a critical point at (,). Taking the second derivatives we obtain f x 1 =, f x =, f x f x =, = The discriminant is f [ f ] f x 1 x = x f 11 f 1 f 1 f = = ( ) ( ) () () = 4. Thus this function has a maximum at the point (, ) because f and the discriminant is positive. The x 1 graph of the function is given in figure 4. The level curves are given in figure 5. The tangent plane is given in figure 6.
6 6 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE 4. Graph of the function x 1 x f,x x FIGURE 5. Level curves of the function x 1 x Example. y = 16 +1x + x 1 + x
7 SIMPLE MULTIVARIATE OPTIMIZATION 7 FIGURE 6. Tangent plane to the function x 1 x 5 f,x 1 15 x Taking the first partial derivatives we obtain = 16 + = (11a) x = 1 + x = (11b) These equations are easy to solve because the first equation only depends on and the second equation only depends on x. Solving equation 11a, we obtain 16 + = = 16 Solving equation 11b, we obtain = x = x = 1 = 6 Thus we have a critical point at (-8,-6). Taking the second derivatives we obtain The discriminant is f x 1 =, f x =, f x = f x =
8 8 SIMPLE MULTIVARIATE OPTIMIZATION f x 1 f x [ ] f = x f 11 f 1 f 1 f = = () () () () = 4. Thus this function has a minimum at the point (-8, -6) because f > and the discriminant is positive. x 1 The graph of the function is given in figure 7. The level curves are given in figure 8. FIGURE 7. Graph of the function f(,x )=16 +1x + x 1 + x 1 f,x x 15 FIGURE 8. Level curves of the function 16 +1x + x 1 + x
9 SIMPLE MULTIVARIATE OPTIMIZATION 9 The tangent plane is given in figure 9. FIGURE 9. Plane tangent to the function 16 +1x + x 1 + x f,x x Example 3. y = x Taking the first partial derivatives we obtain = x = (1a) x = = (1b) Thus this function has a critical value at the point at (,). Taking the second derivatives we obtain The discriminant is f x 1 =, f x =1, f x = 1 f x = f x 1 f x [ ] f = x f 11 f 1 f 1 f = 1 1 = () () (1) (1) = 1. The function has a saddle point at (,) because the discriminant is negative at this critical value. The graph of the function is given in figure 1. The level curves are given in figure 11. The tangent plane is shown from two different angles in figures 1 and 13.
10 1 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE 1. Graph of the function f(,x )= x 4 f,x x FIGURE 11. Let sets of the function f(,x )= x Example 4. Taking the first partial derivatives we obtain y = +4x x 1 +4 x x
11 SIMPLE MULTIVARIATE OPTIMIZATION 11 FIGURE 1. Saddle point of the function f(,x )= x 1 f,x 1 1 x 1 FIGURE 13. Saddle point of the function f(,x )= x 1 f,x x = +4x = (13a) x = x = (13b) Write this system of equations as
12 1 SIMPLE MULTIVARIATE OPTIMIZATION +4x = (14a) x = (14b) 4x = (14c) 4 4x = 4 (14d) Multiply equation 14c by - and add it to equation 14d. First the multiplication ( 4x ) = () Then the addition 4 +8x = x = 4 4 4x = 4 4x = 8 Now multiply the result in equation 15 by 1 to obtain the system 4 4x = x = Now multiply the second equation in 16 by 4 and add to the first equation as follows 4x = 4x = 8 = 6 Multiplying the result in equation 17 by 1 we obtain the system (15) (16) (17) = 3 (18) x = Thus we have a critical value at (-3, -). We obtain the second derivatives by differentiating the system in equation 13 The discriminant is f f x 1 x [ f x f x 1 =, f x =4, ] = f x 1 f x = 4 = 4 f 11 f 1 f 1 f = = ( ) ( 4) (4) (4) = 8.
13 SIMPLE MULTIVARIATE OPTIMIZATION 13 The discriminant is negative and so the function has a saddle point. The graph of the function is given in figure 14. The level curves are given in figure 15. The tangent plane is shown from two different angles in figures 16 and 17. FIGURE 14. Graph of the function f(,x )= +4x x 1 +4 x x 1 1 f,x x Example 5. Taking the first partial derivatives we obtain y = x e ( + x ) x = x e ( + x ) + x 1x e ( + x ) = x (x 1 1)e (x 1 + x ) = e ( + x ) + x e ( + x ) = (x 1)e (x 1 + x ) We set both of the equations equal to zero and solve for critical values of and x. Because
14 14 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE 15. Level sets of the function f(,x )= +4x x 1 +4 x x FIGURE 16. Plane through saddle point of the function f(,x )= +4x x x x f,x x e (x 1 + x ) for all (,x ) the equations can be zero if and only if x (x 1 1) = (x 1) =
15 SIMPLE MULTIVARIATE OPTIMIZATION 15 FIGURE 17. Plane through saddle point of the function f(,x )= +4x x x x f x 5 1,x 65 4 x Thus we have critical values at (, ), (1, 1), (1, -1), (-1, 1) and (-1, -1). A graph of the function is contained in figure 18. FIGURE 18. Graph of the function f(,x ) = x e ( + x ). f,x. x A set of level curves is contained in figure 19.
16 16 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE 19. Level sets of the function f(,x ) = x e ( + x ) We compute the second partial derivatives. The second partial derivative of f with respect to is f x1 = 3e x x e x x 3 1 x The second partial derivative of f with respect to x is given by f x x = 3e x x e x x 3 The cross partial derivative of f with respect to and x is f x = e x 1 x + e x x 1 + e x x e x x 1x [ ] The discriminant f f f is f x 1 x x 1 x given by 11 f 1 f 1 f. We can write this as follows by making the substitutions. e x 3e x 1 x x e x x 3 1 x e x + e x x 1 + e x x e x x 1 x + e x x 1 + e x x e x x 1 x 3e x x e x x 3 Computing the discriminant we obtain
17 SIMPLE MULTIVARIATE OPTIMIZATION 17 x 1 Discriminant = 3e x x 1 x x e x 3 x 1 3e x x 1 x x e x 3 x 1 x e x 1 x + e x x 1 + e 1 x x x e 1 x x x 1 x 1 x e x 1 x + e x x 1 + e 1 x x x e 1 x x 1 x Multiplying out the first term we obtain term 1= e x x 1 ( 3+x 1 ) x ( 3+x ) ( = e x 9 x 1 x 3 x 4 1 x 3 x 1 x 4 + x 4 1 x) 4 Multiplying out the second term we obtain term = e x ( 1+x 1 ) ( 1+x ) ( = e x 1 x 1 + x 4 1 x +4x 1 x x 4 1 x + x 4 x 1 x 4 + x 4 1 x) 4 Subtracting term from term 1 we obtain ( Discriminant = e x 9 x 1 x 3 x 4 1 x 3 x 1 x 4 + x 4 1 x 4 ) + ( ) 1+x 1 x 4 1 +x 4x 1 x +x 4 1 x x 4 +x 1 x 4 x 4 1 x 4 ( = e x 1+5x 1 x x4 1 x x4 + +x x4 1 ) x4 Because e x > for all (,x ), we need only consider the term in parentheses to check the sign of the discriminant. Consider each of the cases in turn. a: Consider the critical point (, ). In the case the relevant term is given by ( 1+5x 1 x x 4 1 x x 1 x 4 +x 1 +x x 4 1 x 4 ) = 1 This is negative so this is a saddle point. We can see this in figure. b: Consider the critical point (1, -1). In the case the relevant term is given by ( 1+5x 1 x x 4 1 x x 1 x 4 +x 1 +x x 4 1 x 4 ) =4 This is positive. The second derivative of f with respect to evaluated at (1, -1) is given by f x1 =3e x 1 x x e x x 3 1 x =e x 1 x ( 3x1 x x 3 1 x ) =e 1 ( 3+1)= e <. Given that the f 11 is negative, this point is a local maximum. We can see this in figure 1. c: Consider the critical point (-1, 1). In the case the relevant term is given by ( 1+5x 1 x x4 1 x x4 + +x x4 1 ) x4 =4 This is positive. The second derivative of x with respect to evaluated at (1, -1) is given by
18 18 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE. Saddle point of the function f(,x ) = x e ( + x )..1 f,x.1. x f x1 =3e x x e x x 3 1x ( ) 3x1 x x 3 1x =e x =e 1 ( 3+1)= e <. Given that f 11 is negative, this point is a local maximum. We can see this in figure. d: Consider the critical point (1, 1). In the case the relevant term is given by ( 1+5x 1 x x 4 1 x x 1 x 4 +x 1 +x x 4 1 x 4 ) =4 This is positive. The second derivative of f with respect to evaluated at (1, 1) is given by f x1 =3e x x e x x 3 1x ( ) 3x1 x x 3 1x =e x =e 1 (3 1) = e >. Given that the f 11 derivative is positive, this point is a local minimum. We can see this in figure 3.
19 SIMPLE MULTIVARIATE OPTIMIZATION 19 FIGURE 1. Local maximum of the function f(,x ) = x e ( + x ). f,x. x FIGURE. Local maximum of the function f(,x ) = x e (x 1 + x ). f,x. x e: Consider the critical point (-1, -1). In the case the relevant term is given by ( 1+5x 1 x x4 1 x x4 + +x x4 1 ) x4 =4
20 SIMPLE MULTIVARIATE OPTIMIZATION FIGURE 3. Local minimum of the function f(,x ) = x e ( + x ) x f,x.. This is positive. The second derivative of f with respect to evaluated at (-1, -1) is given by f x1 =3e x x e x x 3 1 x ( ) 3x1 x x 3 1 x =e x =e 1 (3 1) = e >. Given that the f 11 derivative is positive, this point is a local minimum. We can see this in figure 4. FIGURE 4. Local minimum of the function f(,x ) = x e (x 1 + x ) x f,x..
21 SIMPLE MULTIVARIATE OPTIMIZATION In-class problems. a: y = x 1 + x x 7 x b: y = x x + + x +1 c: y = 16 +1x x 1 + x x d: y = 4 x x 1 x 4 e: y = 1x1.4 x. x 5. TAYLOR SERIES 5.1. Definition of a Taylor series. Let f be a function with derivatives of all orders throughout some interval containing a as an interior point. The Taylor series generated by f at x = a is k= f k (a) k! (x a) k = f(a) + f a)(x a) + f (a)! (x a) + f (a) 3! (x a) f n (a) (x a) n + (19) n! 5.. Definition of a Taylor polynomial. The linearization of a differentiable function f at a point a is the polynomial P 1 (x) = f(a) + f (a)(x a) () For a given a, f(a) and f (a) will be constants and we get a linear equation in x. This can be extended to higher order terms as follows. Let f be a function with derivatives of order k for k = 1,,..., N in some interval containing a as an interior point. Then for any integer n from through N, the Taylor polynomial of order n generated by f at x = a is the polynomial P n (x) =f(a) +f (a)(x a) + f (a)! (x a) + + f k (a) k! (x a) k + + f n (a) n! (x a) n (1) That is, the Taylor polynomial of order n is the Taylor series truncated with the term containing the nth derivative of f. This allows us to approximate a function with polynomials of higher orders Taylor s theorem. Theorem 4. If a function f and its first n derivatives f,f,...,f (n) are continuous on [a, b] or on [b, a], and f (n) is differentiable on (a, b) or (b, a), then there exists a number c between a and b such that f(b) = f(a) + f (a)(b a) + f (a)! (b a) f n (a) n! (b a) n + f n+1 (c) (n + 1)! (b a)n+1 () What this says is that we can approximate the function f at the point b by an nth order polynomial defined at the point a with an error term defined by f n+1 (c) (n+1)! (b a) n+1. In using Taylor s theorem we usually think of a as being fixed and treat b as an independent variable. If we replace b with x we obtain the following corollary. Corollary 1. If a function f has derivatives of all orders in an open interval I containing a, then for each positive integer n and for each x in I,
22 SIMPLE MULTIVARIATE OPTIMIZATION f(x) = f(a) +f (a)(x a) + f (a) (x a) + + f n (a) (x a) n + R n (x),! n! where (3) R n (x) = f n+1 (c) (n + 1)! (x a)n+1 for some c between a and x. If R n (x) asn for all x in I, then we say that the Taylor series generated by f at x = a converges to foni. 6. PROOF OF THE SECOND DERIVATIVE TEST FOR LOCAL EXTREME VALUES Let f(,x ) have continuous partial derivatives in the open region R containing a point P(a, b) where = x =. Let h and k be increments small enough to put the point S(a+h, b+k) and the line segment joining it to P inside R. We parameterize the line segment PS as = a + th, x = b + tk, t 1. (4) Define F(t) as f(a+th, b+tk). In this way F tracks the movement of the function f along the line segment from P to S. Now differentiate F with respect to t using the chain rule to obtain F (t) = d dt + dx x dt = f 1 h + f k. (5) Because and x are differentiable, F is a differentiable function of t and we have F (t) = F d dt + F dx x dt = (f 1 h + f k) h + x = h f 11 +hk f 1 + k f, (f 1 h + f k) k where we use the fact that f 1 =f 1. By the definition of F, which is defined over the interval t 1, and the fact that f is continuous over the open region R, it is clear that F and F are continuous on [, 1] and that F is differentiable on (, 1). We can then apply Taylor s formula with n = and a =. This will give (6) Simplifying we obtain F (1) = F () + F () (1 ) + F (1 ) (c) (7) F (1) = F () + F () (1 ) + F (1 ) (c) (8) = F () + F () + F (c) for some c between and 1. Now write equation 8 in terms of f. Since t = 1 in equation 8, we obtain f at the point (a+h, b+k) or f(a + h, b + k) =f(a, b)+hf 1 (a, b)+kf (a, b)+ 1 (h f 11 +hkf 1 + k f ) (a+ch, b+ck) (9) Because = x = at (a, b), equation 9 reduces to f(a + h, b + k) f(a, b) = 1 (h f 11 +hkf 1 + k f ) (a+ch, b+ck) (3) The presence of an extremum of f at the point (a, b) is determined by the sign of the left hand side of equation 3, or f(a+b, b+k) - f(a, b). If [f(a + h, b + k) f(a, b)] < then the point is a maximum. If
23 SIMPLE MULTIVARIATE OPTIMIZATION 3 [f(a + h, b + k) f(a, b)] >, the point is a minimum. So if the left hand side (lhs) of equation <, we have a maximum, and if the left hand side of equation >, we have a minimum. Specifically, lhs <, lhs >, By equation 3 this is the same as the sign of f is at a maximum f is at a minimum Q(c) = (h f 11 +hkf 1 + k f ) (a + ch, b+ck) (31) If Q(), the sign of Q(c) will be the same as the sign of Q() for sufficiently small values of h and k. We can predict the sign of Q() = h f 11 (a, b) +hkf 1 (a, b) +k f (a, b) (3) from the signs of f 11 and f 11 f f1 at the point (a, b). Multiply both sides of equation 3 by f 11 and rearrange to obtain f 11 Q() = f 11 (h f 11 +hkf 1 + k f ) = f11 h +hk f 11 f 1 + k f 11 f = f11 h +hk f 11 f 1 + k f1 k f1 + k f 11 f (33) =(hf 11 + kf 1 ) k f1 + k f 11 f =(hf 11 + kf 1 ) +(f 11 f f1 ) k Now from equation 33 we can see that a: If f 11 < and f 11 f f1 > at (a, b), then Q() < for all sufficiently small values of h and k. This is clear because the right hand side of equation 33 will be positive if the discriminant is positive. With the right hand side positive, the left hand side must be positive which implies that with f 11 <, Q() must also be negative. Thus f has a local maximum at (a, b) because f evaluated at points close to (a, b) is less than f at (a, b). b: If f 11 > and f 11 f f1 > at (a, b), then Q() > for all sufficiently small values of h and k. This is clear because the right hand side of equation 33 will be positive if the discriminant is positive. With the right hand side positive, the left hand side must be positive which implies that with f 11 >, Q() must also be positive. Thus f has a local minimum at (a, b) because f evaluated at points close to (a, b) is greater than f at (a, b). c: If f 11 f f1 < at (a, b), there are combinations of arbitrarily small nonzero values of h and k for which Q() > and other values for which Q() <. Arbitrarily close to the point P (a, b, f(a, b)) on the surface y = f(,x ) there are points above P and points below P, so f has a saddle point at (a, b). d: If f 11 f f1 =, another test is needed. The possibility that Q() can be zero prevents us from drawing conclusions about the sign of Q(c).
DERIVATIVES AS MATRICES; CHAIN RULE
DERIVATIVES AS MATRICES; CHAIN RULE 1. Derivatives of Real-valued Functions Let s first consider functions f : R 2 R. Recall that if the partial derivatives of f exist at the point (x 0, y 0 ), then we
More informationSECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA
SECOND DERIVATIVE TEST FOR CONSTRAINED EXTREMA This handout presents the second derivative test for a local extrema of a Lagrange multiplier problem. The Section 1 presents a geometric motivation for the
More informationTOPIC 4: DERIVATIVES
TOPIC 4: DERIVATIVES 1. The derivative of a function. Differentiation rules 1.1. The slope of a curve. The slope of a curve at a point P is a measure of the steepness of the curve. If Q is a point on the
More informationRolle s Theorem. q( x) = 1
Lecture 1 :The Mean Value Theorem We know that constant functions have derivative zero. Is it possible for a more complicated function to have derivative zero? In this section we will answer this question
More information5.1 Derivatives and Graphs
5.1 Derivatives and Graphs What does f say about f? If f (x) > 0 on an interval, then f is INCREASING on that interval. If f (x) < 0 on an interval, then f is DECREASING on that interval. A function has
More informationMicroeconomic Theory: Basic Math Concepts
Microeconomic Theory: Basic Math Concepts Matt Van Essen University of Alabama Van Essen (U of A) Basic Math Concepts 1 / 66 Basic Math Concepts In this lecture we will review some basic mathematical concepts
More informationIncreasing for all. Convex for all. ( ) Increasing for all (remember that the log function is only defined for ). ( ) Concave for all.
1. Differentiation The first derivative of a function measures by how much changes in reaction to an infinitesimal shift in its argument. The largest the derivative (in absolute value), the faster is evolving.
More information1 3 4 = 8i + 20j 13k. x + w. y + w
) Find the point of intersection of the lines x = t +, y = 3t + 4, z = 4t + 5, and x = 6s + 3, y = 5s +, z = 4s + 9, and then find the plane containing these two lines. Solution. Solve the system of equations
More informationSection 1.1 Linear Equations: Slope and Equations of Lines
Section. Linear Equations: Slope and Equations of Lines Slope The measure of the steepness of a line is called the slope of the line. It is the amount of change in y, the rise, divided by the amount of
More informationSOLUTIONS. f x = 6x 2 6xy 24x, f y = 3x 2 6y. To find the critical points, we solve
SOLUTIONS Problem. Find the critical points of the function f(x, y = 2x 3 3x 2 y 2x 2 3y 2 and determine their type i.e. local min/local max/saddle point. Are there any global min/max? Partial derivatives
More informationLecture 2. Marginal Functions, Average Functions, Elasticity, the Marginal Principle, and Constrained Optimization
Lecture 2. Marginal Functions, Average Functions, Elasticity, the Marginal Principle, and Constrained Optimization 2.1. Introduction Suppose that an economic relationship can be described by a real-valued
More informationCritical points of once continuously differentiable functions are important because they are the only points that can be local maxima or minima.
Lecture 0: Convexity and Optimization We say that if f is a once continuously differentiable function on an interval I, and x is a point in the interior of I that x is a critical point of f if f (x) =
More informationMath Common Core Sampler Test
High School Algebra Core Curriculum Math Test Math Common Core Sampler Test Our High School Algebra sampler covers the twenty most common questions that we see targeted for this level. For complete tests
More information2013 MBA Jump Start Program
2013 MBA Jump Start Program Module 2: Mathematics Thomas Gilbert Mathematics Module Algebra Review Calculus Permutations and Combinations [Online Appendix: Basic Mathematical Concepts] 2 1 Equation of
More informationHigher Education Math Placement
Higher Education Math Placement Placement Assessment Problem Types 1. Whole Numbers, Fractions, and Decimals 1.1 Operations with Whole Numbers Addition with carry Subtraction with borrowing Multiplication
More informationSolving Quadratic Equations
9.3 Solving Quadratic Equations by Using the Quadratic Formula 9.3 OBJECTIVES 1. Solve a quadratic equation by using the quadratic formula 2. Determine the nature of the solutions of a quadratic equation
More informationMulti-variable Calculus and Optimization
Multi-variable Calculus and Optimization Dudley Cooke Trinity College Dublin Dudley Cooke (Trinity College Dublin) Multi-variable Calculus and Optimization 1 / 51 EC2040 Topic 3 - Multi-variable Calculus
More information1.7 Graphs of Functions
64 Relations and Functions 1.7 Graphs of Functions In Section 1.4 we defined a function as a special type of relation; one in which each x-coordinate was matched with only one y-coordinate. We spent most
More informationReview of Fundamental Mathematics
Review of Fundamental Mathematics As explained in the Preface and in Chapter 1 of your textbook, managerial economics applies microeconomic theory to business decision making. The decision-making tools
More informationIntermediate Value Theorem, Rolle s Theorem and Mean Value Theorem
Intermediate Value Theorem, Rolle s Theorem and Mean Value Theorem February 21, 214 In many problems, you are asked to show that something exists, but are not required to give a specific example or formula
More informationLagrange Interpolation is a method of fitting an equation to a set of points that functions well when there are few points given.
Polynomials (Ch.1) Study Guide by BS, JL, AZ, CC, SH, HL Lagrange Interpolation is a method of fitting an equation to a set of points that functions well when there are few points given. Sasha s method
More informationDifferentiation of vectors
Chapter 4 Differentiation of vectors 4.1 Vector-valued functions In the previous chapters we have considered real functions of several (usually two) variables f : D R, where D is a subset of R n, where
More informationPOLYNOMIAL FUNCTIONS
POLYNOMIAL FUNCTIONS Polynomial Division.. 314 The Rational Zero Test.....317 Descarte s Rule of Signs... 319 The Remainder Theorem.....31 Finding all Zeros of a Polynomial Function.......33 Writing a
More information1 if 1 x 0 1 if 0 x 1
Chapter 3 Continuity In this chapter we begin by defining the fundamental notion of continuity for real valued functions of a single real variable. When trying to decide whether a given function is or
More informationDIFFERENTIABILITY OF COMPLEX FUNCTIONS. Contents
DIFFERENTIABILITY OF COMPLEX FUNCTIONS Contents 1. Limit definition of a derivative 1 2. Holomorphic functions, the Cauchy-Riemann equations 3 3. Differentiability of real functions 5 4. A sufficient condition
More informationMath 120 Final Exam Practice Problems, Form: A
Math 120 Final Exam Practice Problems, Form: A Name: While every attempt was made to be complete in the types of problems given below, we make no guarantees about the completeness of the problems. Specifically,
More information3.2. Solving quadratic equations. Introduction. Prerequisites. Learning Outcomes. Learning Style
Solving quadratic equations 3.2 Introduction A quadratic equation is one which can be written in the form ax 2 + bx + c = 0 where a, b and c are numbers and x is the unknown whose value(s) we wish to find.
More informationThe Mean Value Theorem
The Mean Value Theorem THEOREM (The Extreme Value Theorem): If f is continuous on a closed interval [a, b], then f attains an absolute maximum value f(c) and an absolute minimum value f(d) at some numbers
More informationExam 1 Sample Question SOLUTIONS. y = 2x
Exam Sample Question SOLUTIONS. Eliminate the parameter to find a Cartesian equation for the curve: x e t, y e t. SOLUTION: You might look at the coordinates and notice that If you don t see it, we can
More informationby the matrix A results in a vector which is a reflection of the given
Eigenvalues & Eigenvectors Example Suppose Then So, geometrically, multiplying a vector in by the matrix A results in a vector which is a reflection of the given vector about the y-axis We observe that
More informationSection 12.6: Directional Derivatives and the Gradient Vector
Section 26: Directional Derivatives and the Gradient Vector Recall that if f is a differentiable function of x and y and z = f(x, y), then the partial derivatives f x (x, y) and f y (x, y) give the rate
More informationScalar Valued Functions of Several Variables; the Gradient Vector
Scalar Valued Functions of Several Variables; the Gradient Vector Scalar Valued Functions vector valued function of n variables: Let us consider a scalar (i.e., numerical, rather than y = φ(x = φ(x 1,
More informationUnderstanding Basic Calculus
Understanding Basic Calculus S.K. Chung Dedicated to all the people who have helped me in my life. i Preface This book is a revised and expanded version of the lecture notes for Basic Calculus and other
More informationA QUICK GUIDE TO THE FORMULAS OF MULTIVARIABLE CALCULUS
A QUIK GUIDE TO THE FOMULAS OF MULTIVAIABLE ALULUS ontents 1. Analytic Geometry 2 1.1. Definition of a Vector 2 1.2. Scalar Product 2 1.3. Properties of the Scalar Product 2 1.4. Length and Unit Vectors
More informationFigure 1.1 Vector A and Vector F
CHAPTER I VECTOR QUANTITIES Quantities are anything which can be measured, and stated with number. Quantities in physics are divided into two types; scalar and vector quantities. Scalar quantities have
More informationTaylor and Maclaurin Series
Taylor and Maclaurin Series In the preceding section we were able to find power series representations for a certain restricted class of functions. Here we investigate more general problems: Which functions
More informationAim. Decimal Search. An Excel 'macro' was used to do the calculations. A copy of the script can be found in Appendix A.
Aim The aim of this investigation is to use and compare three different methods of finding specific solutions to polynomials that cannot be solved algebraically. The methods that will be considered are;
More informationthe points are called control points approximating curve
Chapter 4 Spline Curves A spline curve is a mathematical representation for which it is easy to build an interface that will allow a user to design and control the shape of complex curves and surfaces.
More informationSolutions to Homework 10
Solutions to Homework 1 Section 7., exercise # 1 (b,d): (b) Compute the value of R f dv, where f(x, y) = y/x and R = [1, 3] [, 4]. Solution: Since f is continuous over R, f is integrable over R. Let x
More information2.5 Zeros of a Polynomial Functions
.5 Zeros of a Polynomial Functions Section.5 Notes Page 1 The first rule we will talk about is Descartes Rule of Signs, which can be used to determine the possible times a graph crosses the x-axis and
More information88 CHAPTER 2. VECTOR FUNCTIONS. . First, we need to compute T (s). a By definition, r (s) T (s) = 1 a sin s a. sin s a, cos s a
88 CHAPTER. VECTOR FUNCTIONS.4 Curvature.4.1 Definitions and Examples The notion of curvature measures how sharply a curve bends. We would expect the curvature to be 0 for a straight line, to be very small
More information3.3. Solving Polynomial Equations. Introduction. Prerequisites. Learning Outcomes
Solving Polynomial Equations 3.3 Introduction Linear and quadratic equations, dealt within Sections 3.1 and 3.2, are members of a class of equations, called polynomial equations. These have the general
More informationList the elements of the given set that are natural numbers, integers, rational numbers, and irrational numbers. (Enter your answers as commaseparated
MATH 142 Review #1 (4717995) Question 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 Description This is the review for Exam #1. Please work as many problems as possible
More information6. Define log(z) so that π < I log(z) π. Discuss the identities e log(z) = z and log(e w ) = w.
hapter omplex integration. omplex number quiz. Simplify 3+4i. 2. Simplify 3+4i. 3. Find the cube roots of. 4. Here are some identities for complex conjugate. Which ones need correction? z + w = z + w,
More informationZeros of Polynomial Functions
Review: Synthetic Division Find (x 2-5x - 5x 3 + x 4 ) (5 + x). Factor Theorem Solve 2x 3-5x 2 + x + 2 =0 given that 2 is a zero of f(x) = 2x 3-5x 2 + x + 2. Zeros of Polynomial Functions Introduction
More informationBiggar High School Mathematics Department. National 5 Learning Intentions & Success Criteria: Assessing My Progress
Biggar High School Mathematics Department National 5 Learning Intentions & Success Criteria: Assessing My Progress Expressions & Formulae Topic Learning Intention Success Criteria I understand this Approximation
More information4.3 Lagrange Approximation
206 CHAP. 4 INTERPOLATION AND POLYNOMIAL APPROXIMATION Lagrange Polynomial Approximation 4.3 Lagrange Approximation Interpolation means to estimate a missing function value by taking a weighted average
More informationWeek 1: Functions and Equations
Week 1: Functions and Equations Goals: Review functions Introduce modeling using linear and quadratic functions Solving equations and systems Suggested Textbook Readings: Chapter 2: 2.1-2.2, and Chapter
More informationClass Meeting # 1: Introduction to PDEs
MATH 18.152 COURSE NOTES - CLASS MEETING # 1 18.152 Introduction to PDEs, Fall 2011 Professor: Jared Speck Class Meeting # 1: Introduction to PDEs 1. What is a PDE? We will be studying functions u = u(x
More informationcorrect-choice plot f(x) and draw an approximate tangent line at x = a and use geometry to estimate its slope comment The choices were:
Topic 1 2.1 mode MultipleSelection text How can we approximate the slope of the tangent line to f(x) at a point x = a? This is a Multiple selection question, so you need to check all of the answers that
More information2.1 Increasing, Decreasing, and Piecewise Functions; Applications
2.1 Increasing, Decreasing, and Piecewise Functions; Applications Graph functions, looking for intervals on which the function is increasing, decreasing, or constant, and estimate relative maxima and minima.
More informationCORRELATED TO THE SOUTH CAROLINA COLLEGE AND CAREER-READY FOUNDATIONS IN ALGEBRA
We Can Early Learning Curriculum PreK Grades 8 12 INSIDE ALGEBRA, GRADES 8 12 CORRELATED TO THE SOUTH CAROLINA COLLEGE AND CAREER-READY FOUNDATIONS IN ALGEBRA April 2016 www.voyagersopris.com Mathematical
More informationZeros of Polynomial Functions
Zeros of Polynomial Functions The Rational Zero Theorem If f (x) = a n x n + a n-1 x n-1 + + a 1 x + a 0 has integer coefficients and p/q (where p/q is reduced) is a rational zero, then p is a factor of
More informationFixed Point Theorems
Fixed Point Theorems Definition: Let X be a set and let T : X X be a function that maps X into itself. (Such a function is often called an operator, a transformation, or a transform on X, and the notation
More informationMath 241, Exam 1 Information.
Math 241, Exam 1 Information. 9/24/12, LC 310, 11:15-12:05. Exam 1 will be based on: Sections 12.1-12.5, 14.1-14.3. The corresponding assigned homework problems (see http://www.math.sc.edu/ boylan/sccourses/241fa12/241.html)
More information(a) We have x = 3 + 2t, y = 2 t, z = 6 so solving for t we get the symmetric equations. x 3 2. = 2 y, z = 6. t 2 2t + 1 = 0,
Name: Solutions to Practice Final. Consider the line r(t) = 3 + t, t, 6. (a) Find symmetric equations for this line. (b) Find the point where the first line r(t) intersects the surface z = x + y. (a) We
More informationCore Maths C1. Revision Notes
Core Maths C Revision Notes November 0 Core Maths C Algebra... Indices... Rules of indices... Surds... 4 Simplifying surds... 4 Rationalising the denominator... 4 Quadratic functions... 4 Completing the
More informationThis unit will lay the groundwork for later units where the students will extend this knowledge to quadratic and exponential functions.
Algebra I Overview View unit yearlong overview here Many of the concepts presented in Algebra I are progressions of concepts that were introduced in grades 6 through 8. The content presented in this course
More informationSection 3.2 Polynomial Functions and Their Graphs
Section 3.2 Polynomial Functions and Their Graphs EXAMPLES: P(x) = 3, Q(x) = 4x 7, R(x) = x 2 +x, S(x) = 2x 3 6x 2 10 QUESTION: Which of the following are polynomial functions? (a) f(x) = x 3 +2x+4 (b)
More informationTwo Fundamental Theorems about the Definite Integral
Two Fundamental Theorems about the Definite Integral These lecture notes develop the theorem Stewart calls The Fundamental Theorem of Calculus in section 5.3. The approach I use is slightly different than
More informationLinear Equations and Inequalities
Linear Equations and Inequalities Section 1.1 Prof. Wodarz Math 109 - Fall 2008 Contents 1 Linear Equations 2 1.1 Standard Form of a Linear Equation................ 2 1.2 Solving Linear Equations......................
More information1.1 Practice Worksheet
Math 1 MPS Instructor: Cheryl Jaeger Balm 1 1.1 Practice Worksheet 1. Write each English phrase as a mathematical expression. (a) Three less than twice a number (b) Four more than half of a number (c)
More informationAlgebra Unpacked Content For the new Common Core standards that will be effective in all North Carolina schools in the 2012-13 school year.
This document is designed to help North Carolina educators teach the Common Core (Standard Course of Study). NCDPI staff are continually updating and improving these tools to better serve teachers. Algebra
More informationEconomics 121b: Intermediate Microeconomics Problem Set 2 1/20/10
Dirk Bergemann Department of Economics Yale University s by Olga Timoshenko Economics 121b: Intermediate Microeconomics Problem Set 2 1/20/10 This problem set is due on Wednesday, 1/27/10. Preliminary
More informationSolutions for Review Problems
olutions for Review Problems 1. Let be the triangle with vertices A (,, ), B (4,, 1) and C (,, 1). (a) Find the cosine of the angle BAC at vertex A. (b) Find the area of the triangle ABC. (c) Find a vector
More informationPractice Final Math 122 Spring 12 Instructor: Jeff Lang
Practice Final Math Spring Instructor: Jeff Lang. Find the limit of the sequence a n = ln (n 5) ln (3n + 8). A) ln ( ) 3 B) ln C) ln ( ) 3 D) does not exist. Find the limit of the sequence a n = (ln n)6
More informationAlgebra II End of Course Exam Answer Key Segment I. Scientific Calculator Only
Algebra II End of Course Exam Answer Key Segment I Scientific Calculator Only Question 1 Reporting Category: Algebraic Concepts & Procedures Common Core Standard: A-APR.3: Identify zeros of polynomials
More information1. Then f has a relative maximum at x = c if f(c) f(x) for all values of x in some
Section 3.1: First Derivative Test Definition. Let f be a function with domain D. 1. Then f has a relative maximum at x = c if f(c) f(x) for all values of x in some open interval containing c. The number
More informationLinear Algebra Notes for Marsden and Tromba Vector Calculus
Linear Algebra Notes for Marsden and Tromba Vector Calculus n-dimensional Euclidean Space and Matrices Definition of n space As was learned in Math b, a point in Euclidean three space can be thought of
More informationMATH2210 Notebook 1 Fall Semester 2016/2017. 1 MATH2210 Notebook 1 3. 1.1 Solving Systems of Linear Equations... 3
MATH0 Notebook Fall Semester 06/07 prepared by Professor Jenny Baglivo c Copyright 009 07 by Jenny A. Baglivo. All Rights Reserved. Contents MATH0 Notebook 3. Solving Systems of Linear Equations........................
More informationLS.6 Solution Matrices
LS.6 Solution Matrices In the literature, solutions to linear systems often are expressed using square matrices rather than vectors. You need to get used to the terminology. As before, we state the definitions
More informationMA107 Precalculus Algebra Exam 2 Review Solutions
MA107 Precalculus Algebra Exam 2 Review Solutions February 24, 2008 1. The following demand equation models the number of units sold, x, of a product as a function of price, p. x = 4p + 200 a. Please write
More informationHow To Understand The Theory Of Algebraic Functions
Homework 4 3.4,. Show that x x cos x x holds for x 0. Solution: Since cos x, multiply all three parts by x > 0, we get: x x cos x x, and since x 0 x x 0 ( x ) = 0, then by Sandwich theorem, we get: x 0
More informationThe Point-Slope Form
7. The Point-Slope Form 7. OBJECTIVES 1. Given a point and a slope, find the graph of a line. Given a point and the slope, find the equation of a line. Given two points, find the equation of a line y Slope
More information5 Numerical Differentiation
D. Levy 5 Numerical Differentiation 5. Basic Concepts This chapter deals with numerical approximations of derivatives. The first questions that comes up to mind is: why do we need to approximate derivatives
More informationIndiana State Core Curriculum Standards updated 2009 Algebra I
Indiana State Core Curriculum Standards updated 2009 Algebra I Strand Description Boardworks High School Algebra presentations Operations With Real Numbers Linear Equations and A1.1 Students simplify and
More informationRepresentation of functions as power series
Representation of functions as power series Dr. Philippe B. Laval Kennesaw State University November 9, 008 Abstract This document is a summary of the theory and techniques used to represent functions
More informationThe Method of Partial Fractions Math 121 Calculus II Spring 2015
Rational functions. as The Method of Partial Fractions Math 11 Calculus II Spring 015 Recall that a rational function is a quotient of two polynomials such f(x) g(x) = 3x5 + x 3 + 16x x 60. The method
More informationSample Problems. Practice Problems
Lecture Notes Quadratic Word Problems page 1 Sample Problems 1. The sum of two numbers is 31, their di erence is 41. Find these numbers.. The product of two numbers is 640. Their di erence is 1. Find these
More informationPractice with Proofs
Practice with Proofs October 6, 2014 Recall the following Definition 0.1. A function f is increasing if for every x, y in the domain of f, x < y = f(x) < f(y) 1. Prove that h(x) = x 3 is increasing, using
More informationMATHEMATICS FOR ENGINEERING BASIC ALGEBRA
MATHEMATICS FOR ENGINEERING BASIC ALGEBRA TUTORIAL 3 EQUATIONS This is the one of a series of basic tutorials in mathematics aimed at beginners or anyone wanting to refresh themselves on fundamentals.
More information63. Graph y 1 2 x and y 2 THE FACTOR THEOREM. The Factor Theorem. Consider the polynomial function. P(x) x 2 2x 15.
9.4 (9-27) 517 Gear ratio d) For a fixed wheel size and chain ring, does the gear ratio increase or decrease as the number of teeth on the cog increases? decreases 100 80 60 40 20 27-in. wheel, 44 teeth
More informationPrentice Hall Mathematics: Algebra 2 2007 Correlated to: Utah Core Curriculum for Math, Intermediate Algebra (Secondary)
Core Standards of the Course Standard 1 Students will acquire number sense and perform operations with real and complex numbers. Objective 1.1 Compute fluently and make reasonable estimates. 1. Simplify
More informationWhen the fluid velocity is zero, called the hydrostatic condition, the pressure variation is due only to the weight of the fluid.
Fluid Statics When the fluid velocity is zero, called the hydrostatic condition, the pressure variation is due only to the weight of the fluid. Consider a small wedge of fluid at rest of size Δx, Δz, Δs
More informationCollege Algebra - MAT 161 Page: 1 Copyright 2009 Killoran
College Algebra - MAT 6 Page: Copyright 2009 Killoran Zeros and Roots of Polynomial Functions Finding a Root (zero or x-intercept) of a polynomial is identical to the process of factoring a polynomial.
More informationLIMITS AND CONTINUITY
LIMITS AND CONTINUITY 1 The concept of it Eample 11 Let f() = 2 4 Eamine the behavior of f() as approaches 2 2 Solution Let us compute some values of f() for close to 2, as in the tables below We see from
More informationDifferentiating under an integral sign
CALIFORNIA INSTITUTE OF TECHNOLOGY Ma 2b KC Border Introduction to Probability and Statistics February 213 Differentiating under an integral sign In the derivation of Maximum Likelihood Estimators, or
More informationSolutions to Practice Problems for Test 4
olutions to Practice Problems for Test 4 1. Let be the line segmentfrom the point (, 1, 1) to the point (,, 3). Evaluate the line integral y ds. Answer: First, we parametrize the line segment from (, 1,
More informationPrecalculus REVERSE CORRELATION. Content Expectations for. Precalculus. Michigan CONTENT EXPECTATIONS FOR PRECALCULUS CHAPTER/LESSON TITLES
Content Expectations for Precalculus Michigan Precalculus 2011 REVERSE CORRELATION CHAPTER/LESSON TITLES Chapter 0 Preparing for Precalculus 0-1 Sets There are no state-mandated Precalculus 0-2 Operations
More information3.2 The Factor Theorem and The Remainder Theorem
3. The Factor Theorem and The Remainder Theorem 57 3. The Factor Theorem and The Remainder Theorem Suppose we wish to find the zeros of f(x) = x 3 + 4x 5x 4. Setting f(x) = 0 results in the polynomial
More informationDRAFT. Further mathematics. GCE AS and A level subject content
Further mathematics GCE AS and A level subject content July 2014 s Introduction Purpose Aims and objectives Subject content Structure Background knowledge Overarching themes Use of technology Detailed
More informationMATH BOOK OF PROBLEMS SERIES. New from Pearson Custom Publishing!
MATH BOOK OF PROBLEMS SERIES New from Pearson Custom Publishing! The Math Book of Problems Series is a database of math problems for the following courses: Pre-algebra Algebra Pre-calculus Calculus Statistics
More informationAn Introduction to Calculus. Jackie Nicholas
Mathematics Learning Centre An Introduction to Calculus Jackie Nicholas c 2004 University of Sydney Mathematics Learning Centre, University of Sydney 1 Some rules of differentiation and how to use them
More informationwww.mathsbox.org.uk ab = c a If the coefficients a,b and c are real then either α and β are real or α and β are complex conjugates
Further Pure Summary Notes. Roots of Quadratic Equations For a quadratic equation ax + bx + c = 0 with roots α and β Sum of the roots Product of roots a + b = b a ab = c a If the coefficients a,b and c
More informationMathematics Course 111: Algebra I Part IV: Vector Spaces
Mathematics Course 111: Algebra I Part IV: Vector Spaces D. R. Wilkins Academic Year 1996-7 9 Vector Spaces A vector space over some field K is an algebraic structure consisting of a set V on which are
More informationGeometric Transformations
Geometric Transformations Definitions Def: f is a mapping (function) of a set A into a set B if for every element a of A there exists a unique element b of B that is paired with a; this pairing is denoted
More information5.3 The Cross Product in R 3
53 The Cross Product in R 3 Definition 531 Let u = [u 1, u 2, u 3 ] and v = [v 1, v 2, v 3 ] Then the vector given by [u 2 v 3 u 3 v 2, u 3 v 1 u 1 v 3, u 1 v 2 u 2 v 1 ] is called the cross product (or
More informationParametric Curves. (Com S 477/577 Notes) Yan-Bin Jia. Oct 8, 2015
Parametric Curves (Com S 477/577 Notes) Yan-Bin Jia Oct 8, 2015 1 Introduction A curve in R 2 (or R 3 ) is a differentiable function α : [a,b] R 2 (or R 3 ). The initial point is α[a] and the final point
More informationDon't Forget the Differential Equations: Finishing 2005 BC4
connect to college success Don't Forget the Differential Equations: Finishing 005 BC4 Steve Greenfield available on apcentral.collegeboard.com connect to college success www.collegeboard.com The College
More information