Packet #4: Recursion. Applied Discrete Mathematics

Transcription

1 Packet #4: Recursion Applied Discrete Mathematics Table of Contents Recursion Information Page 1 Linear Homogeneous Recursion Page Recursion Examples Pages 3-4 Solving Recursions Page 5 Towers of Hanoi Page 6 Binary Gray Codes Page 8 Big O Information Page 9

2 Recursion Information I Recursive form defines a set, an equation, or a process by defining a starting set or value and giving a rule for continuing to build the set, equation, or process based on previously defined items II Closed form is a way of writing a recursive expression or process that does not depend on any previously defined items A recursive definition has two parts: Recursive Form of Recursive Sequences Basis: Recursion: must define values for some finite number of elements remaining elements are defined by the recursion relation Example 41: Define "L" as the integer part after a division on positive integers 5 3 = 1+ L 5 = = L 3 = 5 Let's define a sequence by recursion Basis: Q(1) = 1 Recursion: Q(n) = Q( L ) + 1 n 3 We could develop the sequence immediately: Q(1) = 1 Q() = Q(3) = Q(4) = 3 Q(5) = 3 Q(6) = 3 Q(7) = 3 Q(8) = 4 Q(45) =? We may not need all of the previous Q's to calculate Q(45): Q(45) = Q() + 1 = Q(11) = Q(5) = Q() + 4= Q(1) + 5 = = 6 4 1

3 Closed Form of Linear Homogeneous Recursive Sequences Some linear recursion forms can be put into closed form by derivation: Given: S(0) = S(0) S(1) = S(1) S(n) = AS(n-1) + BS(n-) This form lends itself to closed form representation Assume: S(n) = a x n (This is an educated guess) S(n-1) = a x (n-1) S(n-) = a x (n-) Substitute these into the recursive definition: S(n) = a x n = A a x (n-1) + B a x (n-) a x (n-) [x - Ax - B] = 0 for a x (n-) 0 [x A ± A + 4B - Ax - B] = 0 x = Using the quadratic formula, there are two roots: x = r 1 and x = r If r 1 r then we fix our guess for : = C 1 r n 1 + C r n Otherwise if r 1 = r we must separate the solutions by multiplying one by n: = C 1 r n 1 + C n r n We can use S(0) and S(1) to write two equations and solve for C 1 and C

4 Example 41: S(0) = S(1) = 5 S(n) = 5S(n-1) - 6S(n-) Recursion Examples x - 5x + 6 = 0 (x-3)(x-)=0 Roots: x = 3 and x = = C 1 n + C 3 n S(0) = = C 1 + C S(1) = 5 = C 1 + 3C C 1 = 1 & C = 1 = n + 3 n Prove using Second Principle of Induction Basis: S(0) =, S 0 = = = S(1) = 5, S 1 = = 5 Assume true for (n-1) and (n-): S (n-) = (n-) + 3 (n-) S (n-1) = (n-1) +3 (n-1) Prove true for n: = n + 3 n S(n) = 5S(n-1) - 6S(n-) (Recursive definition) S(n) = 5[ n n-1 ] - 6[ n- + 3 n- ] (Substitute in from Assumption) = 5[ n-1 ] - 6[ n- ] + 5[3 n-1 ] - 6[3 n- ] (Group like terms) = [ n-1 ] + 3[3 n-1 ] = n + 3 n QED Example 4: S(0) = S(n) = 3S(n-1) (x-3) = 0 Root: x = 3 = C 1 3 n S(0) = = C 1 = 3 n 3

5 Example 43: S(0) = C 0 S(n) = as(n-1) + b S(1) = ac 0 + b S() = a[ac 0 + b] + b = a C 0 + ab + b S(3) = a[a C 0 + ab + b] + b = a 3 C 0 + a b + ab + b n-1 S(n) = a n C 0 + b a i i=0 S(n) = a n C 0 + b[ 1-an 1-a ], a 1 Let a =, b = 1, C 0 = 3 S(0) = 3 S(1) = 7 S() = 15 S(3) = 31 Using equation: S(3) = [ ] = = 31 One can use induction to prove that S(n) = a n C 0 + b[ 1-an 1-a ], a 1, for n P Example 44: S(0) = S(1) = 9 S(n) = 6S(n-1) - 9S(n-) x - 6x + 9 = 0 x = 3 and x = 3 - roots are the same = C 1 3 n + C n3 n (Note factor of n since roots are the same!) S(0) = = C 1 S(1) = 9 = 3C 1 + 3C C = 1 = 3 n + n3 n 4

6 Solving Recursive Sequences Sometimes we consider recurrences with n/ as an argument In order to consider just integer values of the function, we'll map n to powers of For example: S(1) = 3 Assume n = k S( 0 ) = 3 S(n) = S( n ) + 5n Then k = log n S(k ) = *S( )+5* k Write out first terms with no S's, leave them factored: k = 0 S( 0 ) = 3 = k = 1 S( 1 ) = = k = S( ) = [ ] + 5 = = k = 3 S( 3 ) = = Make a guess at S( k ) by finding a pattern: S( k ) = 3* k + 5k* k (Alternatively, S(n) = 3n + 5n[log n]) Prove by induction Basis: k = 0, S( 0 ) = 3( 0 ) + 0 = 3 = S(1) Assume true for k : S( k ) = 3* k + 5k* k Prove true for k+1 : S( k+1 ) = 3* k+1 + 5(k+1)* k+1 S( k+1 ) = *S( k ) + 5* k+1 (recursive definition) = (3* k + 5k* k ) + 5* k+1 = 3** k + 5k** k + 5* k+1 = 3* k+1 + 5k* k+1 + 5* k+1 = 3* k+1 + 5(k+1)* k+1 5

7 Towers of Hanoi (We will fill this in during class) Object: Move a stack of n disks (stacked in order of decreasing size) from one column (eg A) to another designated column (eg C) Just one disk can be moved at a time There are only three columns allowed and at no time can a larger disk cover a smaller disk How many moves does it take to move all n disks? A B C Moving just one disk takes one move, so S(1) = 1 Moving disks takes 3 moves, so S() = 3 How many moves does it take to move 3? In general, if you know how to move n disks then to move (n+1) disks: 1 Move the top n as before to intermediate pole (S(n) moves) Move the bottom largest disk to final pole (1 move) 3 Move the n from intermediate pole to final pole (S(n) moves) 1 3 Then the recursion can be written: S(1)=1 basis S(n+1) = S(n) S(n) = S(n) + 1 6

8 Use the recursion to fill out the table: Towers of Hanoi continued n S(n) n S(n) ? 3 7 7? ? Guess: S(n) = n - 1 Prove by induction: Basis: S(1) = 1-1 = 1 Assume true for n: S(n) = n - 1 Prove true for (n+1): S(n+1) = n+1-1 S(n+1) = S(n) + 1 (from recursion) = ( n - 1) + 1 (substitute in from Assumption) = n = n+1-1 7

9 A Recursion for Gray Codes A binary gray code is a list of binary strings such that the neighbors of any string differ by only 1 bit We say such a list is "gray" Basis: S(1) = 0, 1 differ by only one Recursion: S(n) = 0S(n-1),1S'(n-1) (S'(n-1) is S(n-1) in reverse order) S() = 00, 01, 11, 10 Let's prove that S(n) is always a gray code Basis: S(1) = 0,1 is gray (by inspection) Assume: S(n) is gray Prove: S(n+1) is gray S(n+1) = 0S(n),1S'(n) Prove 0S(n) and 1S'(n) are gray: Since S(n) is gray, 0S(n) is gray Since S(n) is gray, S'(n) is gray, and so is 1S'(n) Prove the last string of 0S(n) differs in only one bit from the first string of 1S'(n): Since S'(n) is the reverse of S(n), the last string (say x) in S(n) is equal to the first string in S'(n) Therefore, the last string of 0S(n) is 0x and the first string of 1S'(n) is 1x, and these two strings differ only by 1 bit Prove the last string of 1S'(n) differs in only one bit from the first string of 0S(n): Since S'(n) is the reverse of S(n), the last string (say y) in S'(n) is equal to the first string in S(n) Therefore, the last string of 1S'(n) is 1y and the first string of 0S(n) is 0y, and these two strings differ only by 1 bit Since 0S(n) and 1S'(n) are gray and their first and last strings differ by just one bit each, S(n+1) is gray 8

10 Big-O Information I Definition: If f and g are functions then f is Big O of g, or f(x) is in O(g(x)), if there exist constants C and k so that x (x > k) f(x) C g(x) In other words, f(x) is smaller than some constant times g(x) whenever x is large enough O(g(x)) actually defines a set of functions that grow at the rate of a constant times g, or at a slower rate II Generating a Big-O for a function The general rules: I O(c*g(x)), where c is constant (independent of x), is O(g(x)) II III IV If f(x) g(x) then f(x) + g(x) * g(x), so O(f(x) + g(x)) = O(g(x)) If a sum has more than terms, count the number of terms the sum has Then if the sum has m terms, and g(x) is the largest term, then the sum is m* g(x) O(sum) = O(m * g(x)) Note that m might depend on x! O(f(x) * g(x)) = O(f(x)) * O(g(x)) V O(f(x)/g(x)) = O(f(x))/O(g(x)) ** Be careful with division! 9

11 Big-O Formal Definition: f(n) grows no faster than g(n) f(n) is O(g(n)) if there is a constant c such that f(n) cg(n) for all n some k Purpose: to describe growth rate of a function e g does it grow like log(n)? like n? like n? e g n + 3n - 1 "grows like" n 1 nlog(n) - 3n + 7 "grows like" nlog(n) Big-O is used to denote an upper bound on growth rate Examples 1 1 n - n 1 n for all n 0 Therefore, 1 n - n is O(n ) n + 3 n + n = n for n 3 Therefore, n + 3 is O(n) 3 5n + log(n) + 1 5n + n + n = 7n for n 1 Therefore, 5n + log(n) + 1 is O(n) 4 n 3-5n + 6n - 7 is O(n 3 ) since n 3-5n + 6n - 7 n 3 + 6n n 3 + 6n 3 = 8n 3 for n 1 5 n + 1 is O(n 3 ) since n + 1 n n 3 for n 1 (However, n + 1 is also O(n )) 6 log(n 3 ) is O(log(n)) since log(n 3 ) = 3log(n) 10

12 Example of Definition of Big-O Function f(x) is O(g(x)) c n o n[(n n o ) [f(n) cg(n)]] (f(x) is O(g(x)) there is a constant c and a value n o such that f(n) cg(n) whenever n n o ) Negate: (definition of Big-O) c n o n[(n n o ) f(n) cg(n)] [ c n o n[(n n o ) f(n) cg(n)]] c n o n [(n n o ) f(n) cg(n)] c n o n [ (n n o ) (f(n) cg(n))] c n o n[(n n o ) (f(n) cg(n))] c n o n[(n n o ) (f(n) > cg(n))] Big-O negation of Big-O negation of Big-O Merge Sort Recurrence C() = 1 C(n) = C( n ) + n for n 4 Solving for n = k (then k = log (n)) C() = 1 C( ) = ( 1) + C( 3 ) = ( ) + 3 C( 4 ) = ( ) + 4 C( 5 ) = ( ) + 5 C( k ) = k-1 + (k-1) k (guess) = k-1 + k k - k = k k + k ( 1-1) = kk - 1 (k ) C(n) = nlog(n) - 1 n (Can prove by induction) Therefore, O(nlog(n)) 11

13 Binary Search Search for x in sorted array A of n elements BINSRCH(x,A,n) if n 1 then split A into sorted arrays B and C each with n elements [Note: (last(b) first(c))] (1) if x is smaller than first(c) then C( n ) BINSRCH(x,B,n ) or C( n ) else BINSRCH(x,C,n ) (1) else {n = 1} check if the only element in A is x Solving Binary Search Recurrence C(1) = 1 C(n) = C( n ) + 1 Assume n = k Then k = log (n) C(1) = 1 C() = (1) + 1 C( ) = (1 + 1) + 1 C( 3 ) = ( ) + 1 C( 4 ) = ( ) + 1 C( k ) = k + 1 (guess) C(n) = log (n) + 1 (can prove by induction) 1