Binary Golomb Codes. CSE 589 Applied Algorithms Autumn Constructing a Binary Golomb Code. Example. Example. Comparison of GC with Entropy


 Maximillian Powell
 11 months ago
 Views:
Transcription
1 CSE 589 pplied lgorithms utumn Golom Coding rithmetic Coding LZW Sequitur Binry Golom Codes Binry source with s much more frequent thn s. Vriletovrile length code Prefix code. Golom code of order 4 input output 2 Exmple Constructing Binry Golom Code input output Let p e the proility of Choose the order k such tht lest likely p k + k p < p k most likely k 3 4 p =.89 p 7 = p 6 =.53 p 5 =.558 Order = 6 Exmple input output Comprison of GC with Entropy order p GC entropy entropy 5 6
2 Notes on Binry Golom Code Very effective s inry runlength code s p goes to effectiveness ner entropy There re dptive Golom codes, so tht the order cn chnge ccording to oserved frequency of s. rithmetic Coding Huffmn coding works well for lrger lphets nd gets to within one it of the entropy lower ound. Cn we do etter. Yes Bsic ide in rithmetic coding: represent ech string x of length n y n intervl [l,r) in [,). We ssume n is known. The width rl of the intervl [l,r) represents the proility of x occurring. The intervl [l,r) cn itself e represented y ny numer, clled tg, within the hlf open intervl. The k significnt its of the tg.t t 2 t 3... is the code of x. Tht is,..t t 2 t 3...t k... is in the intervl [l,r). 7 8 Exmple of rithmetic Coding () Some Tgs re Better thn Others /3. tg must e in the hlf open intervl. 2. tg cn e chosen to e (l+r)/2. 3. code is significnt its of the tg. /3 2/3 5/ /27... tg = 7/27 =... code = 2/3 / /27... Using tg = (l+r)/2 tg = 3/27 =... code = lterntive tg = 4/37 =... code = 9 P() = /3, P() = 2/3. Exmple of Codes /27 /27 3/27 5/ /27... tg = (l+r)/2 code /27... / / / its/symol.92 entropy lower ound Code Genertion from Tg If inry tg is.t t 2 t 3... = (r+l)/2 in [l,r) then we wnt to choose k to form the code t t 2...t k. Short code: choose k to e s smll s possile so tht l <.t t 2...t k... < r. Good if n is known. Gurnteed code: choose k = log 2 ( r l) + l <.t t 2...t k < r for ny its for fixed length strings provides good prefix code. exmple: [...,...), tg =... Short code: Gurnteed code: 2 2
3 Gurnteed Code Exmple rithmetic Coding lgorithm P() = /3, P() = 2/3. /27 /27 3/27 tg = (l+r)/2 short code Prefix code / /27 / / /27... P( ), P( 2 ),, P( m ) C( i ) = P( ) + P( 2 ) + + P( i ) Encode x x 2...x n Initilize l := nd r := ; for i = to n do w := r  l; l := l + w * C(x i ); r := l + w * P(x i ); t := (l+r)/2; choose code for the tg 27/ rithmetic Coding Exmple rithmetic Coding Exercise P() = /4, P() = /2, P(c) = /4 C() =, C() = /4, C(c) = 3/4 c w := r  l; l := l + w C(x); r := l + w P(x) symol w l r /4 /4 /6 3/6 c /8 5/32 6/32 /32 5/32 2/28 P() = /4, P() = /2, P(c) = /4 C() =, C() = /4, C(c) = 3/4 w := r  l; l := l + w C(x); r := l + w P(x) symol w l r tg = (5/32 + 2/28)/2 = 4/256 =... l =... r =... code = prefix code = tg = l = r = code = prefix code = 5 6 Decoding () Decoding (2) ssume the length is known to e 3. which converts to the tg... ssume the length is known to e 3. which converts to the tg output... output 7 8 3
4 Decoding (3) rithmetic Decoding lgorithm ssume the length is known to e 3. which converts to the tg output P( ), P( 2 ),, P( m ) C( i ) = P( ) + P( 2 ) + + P( i ) Decode 2... m, numer of symols is n. Initilize l := nd r := ; t := m... for i = to n do w := r  l; find j such tht l + w * C( j ) < t < l + w * (C( j )+P( j )) output j ; l := l + w * C( j ); r := l + w * P( j ); 9 2 Decoding Exmple Prcticl rithmetic Coding P() = /4, P() = /2, P(c) = /4 C() =, C() = /4, C(c) = 3/4 tg =... = 5/32 w l r output /4 /4 /6 3/6 /8 5/32 6/32 c /32 5/32 2/28 Scling: By scling we cn keep l nd r in resonle rnge of vlues so tht w = r  l does not underflow. The code cn e produced progressively, not t the end. Complictes decoding some. Integer rithmetic coding voids floting point ltogether Notes on rithmetic Coding rithmetic codes come close to the entropy lower ound. Grouping symols is effective for rithmetic coding. rithmetic codes cn e used effectively on smll symol sets. dvntge over Huffmn. Context cn e dded so tht more thn one proility distriution cn e used. The est coders in the world use this method. There re very effective dptive rithmetic coding methods. Coding Does not use sttisticl knowledge of dt. Encoder: s the input is processed develop dictionry nd trnsmit the index of strings found in the dictionry. Decoder: s the code is processed reconstruct the dictionry to invert the process of encoding. Exmples: LZW, LZ77, Unix Compress, gzip, GIF
5 LZW Encoding lgorithm LZW Encoding Exmple () Repet find the longest mtch w in the dictionry output the index of w put w in the dictionry where ws the unmtched symol LZW Encoding Exmple (2) LZW Encoding Exmple (3) LZW Encoding Exmple (4) LZW Encoding Exmple (5)
6 LZW Encoding Exmple (6) LZW Decoding lgorithm Emulte the encoder in uilding the dictionry. Decoder is slightly ehind the encoder. initilize dictionry; decode first index to w; put w? in dictionry; repet decode the first symol s of the index; complete the previous dictionry entry with s; finish decoding the reminder of the index; put w? in the dictionry where w ws just decoded; 3 32 LZW Decoding Exmple () LZW Decoding Exmple (2) 2? LZW Decoding Exmple (2) LZW Decoding Exmple (3) 3?
7 LZW Decoding Exmple (3) LZW Decoding Exmple (4) 3 4? LZW Decoding Exmple (4) LZW Decoding Exmple (5) 3 4 5? LZW Decoding Exmple (5) LZW Decoding Exmple (6) ?
8 LZW Decoding Exmple (6) ? Trie Dt Structure for Encoder s Fredkin (96) 9 c d 2 c d 3 d r 4 r 3 r 5 4 r 6 r 7 r 8 c c d r 5 c 8 d r 6 9 r Encoder Uses Trie () Encoder Uses Trie (2) c d r c d r 5 c 8 d r c 8 d r r 2 3 r r c d r r c d r r c d r r c d r Decoder s Dt Structure Notes on Coding Simply n rry of strings 9 c d 2 c d 3 d r 4 r 3 r 5 4 r? 6 r 7 r 8 c r c d r r Extremely effective when there re repeted ptterns in the dt tht re widely spred. Where locl context is not s significnt. text some grphics progrm sources or inries Vrints of LZW re pervsive
9 Sequitur NevillMnning nd Witten, 996. Uses contextfree grmmr (without recursion) to represent string. The grmmr is inferred from the string. If there is structure nd repetition in the string then the grmmr my e very smll compred to the originl string. Clever encoding of the grmmr yields impressive compression rtios. Compression plus structure! ContextFree Grmmrs Invented y Chomsky in 959 to explin the grmmr of nturl lnguges. lso invented y Bckus in 959 to generte nd prse Fortrn. Exmple: terminls:, e nonterminls: S, Production Rules: S > S, S >, > Se, S is the strt symol 49 5 ContextFree Grmmr Exmple S > S S > > Se Exmple: nd e mtched s prentheses derivtion of eee S Se Se e ee eee hierrchicl prse tree S S e S e e S > S + T S > T T > T*F T > F F > F > (S) rithmetic Expressions derivtion of * ( + ) + S S+T T+T T*F+T F*F+T *F+T *(S)+F *(S+F)+T *(T+F)+T *(F+F)+T *(+F)+T *(+)+T *(+)+F *(+)+ T T * F S S + T F ( S ) S + T T F prse tree F F 5 52 Sequitur Principles Sequitur Exmple () Digrm Uniqueness: no pir of djcent symols (digrm) ppers more thn once in the grmmr. Rule Utility: Every production rule is used more thn once. These two principles re mintined s n invrint while inferring grmmr for the input string. S >
10 Sequitur Exmple (2) Sequitur Exmple (3) S > S > e Sequitur Exmple (4) Sequitur Exmple (5) S > e S > ee Enforce digrm uniqueness. e occurs twice. Crete new rule >e Sequitur Exmple (6) Sequitur Exmple (7) S > S > e 59 6
11 Sequitur Exmple (8) Sequitur Exmple (9) S > e S > ee Enforce digrm uniqueness. e occurs twice. Use existing rule Sequitur Exmple () Sequitur Exmple () S > e S > e Sequitur Exmple (2) Sequitur Exmple (3) S > ee Enforce digrm uniqueness. e occurs twice. Use existing rule. S > e Enforce digrm uniqueness occurs twice. Crete new rule
12 Sequitur Exmple (4) Sequitur Exmple (5) S > BeB S > BeB Sequitur Exmple (6) Sequitur Exmple (7) S > BeB S > BeBe Enforce digrm uniqueness. e occurs twice. Use existing rule >e Sequitur Exmple (8) Sequitur Exmple (9) S > BeB S > BeB
13 Sequitur Exmple (2) Sequitur Exmple (2) S > BeBe Enforce digrm uniqueness. e occurs twice. Use existing rule. S > BeB Enforce digrm uniqueness. occurs twice. Use existing rule Sequitur Exmple (22) Sequitur Exmple (23) S > BeBB Enforce digrm uniqueness. B occurs twice. Crete new rule C > B. S > CeBC C > B Sequitur Exmple (24) Sequitur Exmple (25) S > CeBCe C > B Enforce digrm uniqueness. Ce occurs twice. Crete new rule D > Ce. S > DBD C > B D > Ce Enforce rule utility. C occurs only once. Remove C > B
14 Sequitur Exmple (26) S > DBD D > Be The Hierrchy S > DBD D > Be B e S D B D B e e e e e e e Is there compression? In this smll exmple, proly not Sequitur lgorithm Input the first symol s to crete the production S > s; repet mtch n existing rule: >.XY >.B. B > XY B > XY crete new rule: >.XY. >.C... B >...XY... B >...C... remove rule: C > XY >.B. B > X X 2 X >. X X 2 X k. k input new symol: S > X X 2 X k until no symols left S > X X 2 X k s Complexity The numer of noninput sequitur opertions pplied < 2n where n is the input length. mortized Complexity rgument Let s = the sum of the right hnd sides of ll the production rules. Let r = the numer of rules. We evlute 2s  r. Initilly 2s  r = ecuse s = nd r =. 2s  r > t ll times ecuse ech rule hs t lest symol on the right hnd side. 2s  r increses y 2 for every input opertion. 2s  r decreses y t lest for ech noninput sequitur rule pplied Sequitur Rule Complexity Digrm Uniqueness  mtch n existing rule. >.XY B > XY Digrm Uniqueness  crete new rule. >.XY. B >...XY... >.B. B > XY >.C... B >...C... C > XY Rule Utility  Remove rule. s r  s r 2s  r 2 2s  r  Liner Time lgorithm There is dt structure to implement ll the sequitur opertions in constnt time. Production rules in n rry of douly linked lists. Ech production rule hs reference count of the numer of times used. Ech nonterminl points to its production rule. digrms stored in hsh tle for quick lookup. >.B. B > X X 2 X k s r >. X X 2 X k s  r
15 S > CeBCe C > B Dt Structure Exmple S C e B C e 2 B 2 e C 2 B reference count current digrm digrm tle BC eb Ce e B 85 Grmmr Bsic Encoding Grmmr S > DBD D > Be Symol Code Grmmr Code e S B D # D B D # e # # B e 39 its Grmmr Code = ( s + r ) log 2 ( r + + ) r = numer of rules s = sum of right hnd sides = numer in originl symol lphet 86 Better Encoding of the Grmmr NevillMnning nd Witten suggest more efficient encoding of the grmmr tht resemles LZ77. The first time nonterminl is sent, its right hnd side is trnsmitted insted. The second time nonterminl is sent the new production rule is estlished with pointer to the previous occurrence sent long with the length of the rule. Susequently, the nonterminl is represented y the index of the production rule. Compression Qulity NevilleMnning nd Witten 997 size compress gzip sequitur PPMC i ook geo oj pic progc Files from the Clgry Corpus Units in its per chrcter (8 its) compress  sed on LZW gzip  sed on LZ77 PPMC  dptive rithmetic coding with context Notes on Sequitur Very new nd different from the stndrds. Yields compression nd hierrchicl structure simultneously. With clever encoding is competitive with the est of the stndrds. Prcticl liner time encoding nd decoding. lterntives Offline lgorithms (i) find the most frequent digrm, (ii) find the longest repeted sustring 89 5
Assuming all values are initially zero, what are the values of A and B after executing this Verilog code inside an always block? C=1; A <= C; B = C;
B26 Appendix B The Bsics of Logic Design Check Yourself ALU n [Arthritic Logic Unit or (rre) Arithmetic Logic Unit] A rndomnumer genertor supplied s stndrd with ll computer systems Stn KellyBootle,
More informationData Compression. Lossless And Lossy Compression
Dt Compression Reduce the size of dt. ƒ Reduces storge spce nd hence storge cost. Compression rtio = originl dt size/compressed dt size ƒ Reduces time to retrieve nd trnsmit dt. Lossless And Lossy Compression
More informationa. Implement the function using a minimal network of 2:4 decoders and OR gates.
CSE4 Eercise Solutions I. Given threeinput Boolen function f(,, c) = m(, 2, 4, 6, 7) + d().. Implement the function using miniml network of 2:4 decoders nd OR gtes. Stndrd solution: Use s the enle signl,
More informationSuffix Trees CMSC 423
Suffix Trees CMSC 423 Preprocessing Strings Over the next few lectures, we ll see severl methods for preprocessing string dt into dt structures tht mke mny questions (like serching) esy to nswer: Suffix
More informationHomework 3 Solutions
CS 341: Foundtions of Computer Science II Prof. Mrvin Nkym Homework 3 Solutions 1. Give NFAs with the specified numer of sttes recognizing ech of the following lnguges. In ll cses, the lphet is Σ = {,1}.
More informationOne Minute To Learn Programming: Finite Automata
Gret Theoreticl Ides In Computer Science Steven Rudich CS 15251 Spring 2005 Lecture 9 Fe 8 2005 Crnegie Mellon University One Minute To Lern Progrmming: Finite Automt Let me tech you progrmming lnguge
More informationPolynomial Functions. Polynomial functions in one variable can be written in expanded form as ( )
Polynomil Functions Polynomil functions in one vrible cn be written in expnded form s n n 1 n 2 2 f x = x + x + x + + x + x+ n n 1 n 2 2 1 0 Exmples of polynomils in expnded form re nd 3 8 7 4 = 5 4 +
More informationMATLAB: Mfiles; Numerical Integration Last revised : March, 2003
MATLAB: Mfiles; Numericl Integrtion Lst revised : Mrch, 00 Introduction to Mfiles In this tutoril we lern the bsics of working with Mfiles in MATLAB, so clled becuse they must use.m for their filenme
More informationLec 2: Gates and Logic
Lec 2: Gtes nd Logic Kvit Bl CS 34, Fll 28 Computer Science Cornell University Announcements Clss newsgroup creted Posted on wepge Use it for prtner finding First ssignment is to find prtners Due this
More informationFormal Languages and Automata Exam
Forml Lnguges nd Automt Exm Fculty of Computers & Informtion Deprtment: Computer Science Grde: Third Course code: CSC 34 Totl Mrk: 8 Dte: 23//2 Time: 3 hours Answer the following questions: ) Consider
More informationJava CUP. Java CUP Specifications. User Code Additions You may define Java code to be included within the generated parser:
Jv CUP Jv CUP is prsergenertion tool, similr to Ycc. CUP uilds Jv prser for LALR(1) grmmrs from production rules nd ssocited Jv code frgments. When prticulr production is recognized, its ssocited code
More informationAPPLICATION NOTE Revision 3.0 MTD/PS0534 August 13, 2008 KODAK IMAGE SENDORS COLOR CORRECTION FOR IMAGE SENSORS
APPLICATION NOTE Revision 3.0 MTD/PS0534 August 13, 2008 KODAK IMAGE SENDORS COLOR CORRECTION FOR IMAGE SENSORS TABLE OF FIGURES Figure 1: Spectrl Response of CMOS Imge Sensor...3 Figure 2: Byer CFA Ptterns...4
More informationConcept Formation Using Graph Grammars
Concept Formtion Using Grph Grmmrs Istvn Jonyer, Lwrence B. Holder nd Dine J. Cook Deprtment of Computer Science nd Engineering University of Texs t Arlington Box 19015 (416 Ytes St.), Arlington, TX 760190015
More informationTuring Machine Extensions
Red K & S 4.3.1, 4.4. Do Homework 19. Turing Mchine Extensions Turing Mchine Definitions An lterntive definition of Turing mchine: (K, Σ, Γ, δ, s, H): Γ is finite set of llowble tpe symbols. One of these
More informationSequences and Series
Centre for Eduction in Mthemtics nd Computing Euclid eworkshop # 5 Sequences nd Series c 014 UNIVERSITY OF WATERLOO While the vst mjority of Euclid questions in this topic re use formule for rithmetic
More informationReasoning to Solve Equations and Inequalities
Lesson4 Resoning to Solve Equtions nd Inequlities In erlier work in this unit, you modeled situtions with severl vriles nd equtions. For exmple, suppose you were given usiness plns for concert showing
More informationUnion, Intersection and Complement. Formal Foundations Computer Theory
Union, Intersection nd Complement FAs Union, Intersection nd Complement FAs Forml Foundtions Computer Theory Ferury 21, 2013 This hndout shows (y exmples) how to construct FAs for the union, intersection
More informationIn this section make precise the idea of a matrix inverse and develop a method to find the inverse of a given square matrix when it exists.
Mth 52 Sec S060/S0602 Notes Mtrices IV 5 Inverse Mtrices 5 Introduction In our erlier work on mtrix multipliction, we sw the ide of the inverse of mtrix Tht is, for squre mtrix A, there my exist mtrix
More informationChapter 4: Dynamic Programming
Chpter 4: Dynmic Progrmming Objectives of this chpter: Overview of collection of clssicl solution methods for MDPs known s dynmic progrmming (DP) Show how DP cn be used to compute vlue functions, nd hence,
More informationMATH 150 HOMEWORK 4 SOLUTIONS
MATH 150 HOMEWORK 4 SOLUTIONS Section 1.8 Show tht the product of two of the numbers 65 1000 8 2001 + 3 177, 79 1212 9 2399 + 2 2001, nd 24 4493 5 8192 + 7 1777 is nonnegtive. Is your proof constructive
More informationGraphs on Logarithmic and Semilogarithmic Paper
0CH_PHClter_TMSETE_ 3//00 :3 PM Pge Grphs on Logrithmic nd Semilogrithmic Pper OBJECTIVES When ou hve completed this chpter, ou should be ble to: Mke grphs on logrithmic nd semilogrithmic pper. Grph empiricl
More informationRegular Sets and Expressions
Regulr Sets nd Expressions Finite utomt re importnt in science, mthemtics, nd engineering. Engineers like them ecuse they re super models for circuits (And, since the dvent of VLSI systems sometimes finite
More informationTests for One Poisson Mean
Chpter 412 Tests for One Poisson Men Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson distribution
More informationAntiderivatives/Indefinite Integrals of Basic Functions
Antiderivtives/Indefinite Integrls of Bsic Functions Power Rule: x n+ x n n + + C, dx = ln x + C, if n if n = In prticulr, this mens tht dx = ln x + C x nd x 0 dx = dx = dx = x + C Integrl of Constnt:
More informationSirindhorn International Institute of Technology Thammasat University at Rangsit
Sirindhorn Interntionl Institute of Technology Thmmst University t Rngsit School of Informtion, Computer nd Communiction Technology COURSE : ECS 204 Bsic Electricl Engineering L INSTRUCTOR : Asst. Prof.
More informationMath 135 Circles and Completing the Square Examples
Mth 135 Circles nd Completing the Squre Exmples A perfect squre is number such tht = b 2 for some rel number b. Some exmples of perfect squres re 4 = 2 2, 16 = 4 2, 169 = 13 2. We wish to hve method for
More informationSection 54 Trigonometric Functions
5 Trigonometric Functions Section 5 Trigonometric Functions Definition of the Trigonometric Functions Clcultor Evlution of Trigonometric Functions Definition of the Trigonometric Functions Alternte Form
More informationBasic Research in Computer Science BRICS RS0213 Brodal et al.: Solving the String Statistics Problem in Time O(n log n)
BRICS Bsic Reserch in Computer Science BRICS RS0213 Brodl et l.: Solving the String Sttistics Prolem in Time O(n log n) Solving the String Sttistics Prolem in Time O(n log n) Gerth Stølting Brodl Rune
More informationFactoring Polynomials
Fctoring Polynomils Some definitions (not necessrily ll for secondry school mthemtics): A polynomil is the sum of one or more terms, in which ech term consists of product of constnt nd one or more vribles
More informationOperations with Polynomials
38 Chpter P Prerequisites P.4 Opertions with Polynomils Wht you should lern: Write polynomils in stndrd form nd identify the leding coefficients nd degrees of polynomils Add nd subtrct polynomils Multiply
More informationBasics of Logic Design: Boolean Algebra, Logic Gates. Administrative
Bsics of Logic Design: Boolen Alger, Logic Gtes Computer Science 104 Administrtive Homework #3 Due Sundy Midterm I Mondy in clss, closed ook, closed notes Ø Will provide IA32 instruction set hndout Ø Lst
More informationSquare Roots Teacher Notes
Henri Picciotto Squre Roots Techer Notes This unit is intended to help students develop n understnding of squre roots from visul / geometric point of view, nd lso to develop their numer sense round this
More informationSection 2.3. Motion Along a Curve. The Calculus of Functions of Several Variables
The Clculus of Functions of Severl Vribles Section 2.3 Motion Along Curve Velocity ccelertion Consider prticle moving in spce so tht its position t time t is given by x(t. We think of x(t s moving long
More informationUse Geometry Expressions to create a more complex locus of points. Find evidence for equivalence using Geometry Expressions.
Lerning Objectives Loci nd Conics Lesson 3: The Ellipse Level: Preclculus Time required: 120 minutes In this lesson, students will generlize their knowledge of the circle to the ellipse. The prmetric nd
More informationSolutions to Section 1
Solutions to Section Exercise. Show tht nd. This follows from the fct tht mx{, } nd mx{, } Exercise. Show tht = { if 0 if < 0 Tht is, the bsolute vlue function is piecewise defined function. Grph this
More information1 Numerical Solution to Quadratic Equations
cs42: introduction to numericl nlysis 09/4/0 Lecture 2: Introduction Prt II nd Solving Equtions Instructor: Professor Amos Ron Scribes: Yunpeng Li, Mrk Cowlishw Numericl Solution to Qudrtic Equtions Recll
More informationhas the desired form. On the other hand, its product with z is 1. So the inverse x
First homework ssignment p. 5 Exercise. Verify tht the set of complex numers of the form x + y 2, where x nd y re rtionl, is sufield of the field of complex numers. Solution: Evidently, this set contins
More informationAlgorithms Chapter 4 Recurrences
Algorithms Chpter 4 Recurrences Outline The substitution method The recursion tree method The mster method Instructor: Ching Chi Lin 林清池助理教授 chingchilin@gmilcom Deprtment of Computer Science nd Engineering
More informationChapter 6 Solving equations
Chpter 6 Solving equtions Defining n eqution 6.1 Up to now we hve looked minly t epressions. An epression is n incomplete sttement nd hs no equl sign. Now we wnt to look t equtions. An eqution hs n = sign
More informationAppendix D: Completing the Square and the Quadratic Formula. In Appendix A, two special cases of expanding brackets were considered:
Appendi D: Completing the Squre nd the Qudrtic Formul Fctoring qudrtic epressions such s: + 6 + 8 ws one of the topics introduced in Appendi C. Fctoring qudrtic epressions is useful skill tht cn help you
More informationExperiment 6: Friction
Experiment 6: Friction In previous lbs we studied Newton s lws in n idel setting, tht is, one where friction nd ir resistnce were ignored. However, from our everydy experience with motion, we know tht
More informationSo there are two points of intersection, one being x = 0, y = 0 2 = 0 and the other being x = 2, y = 2 2 = 4. y = x 2 (2,4)
Ares The motivtion for our definition of integrl ws the problem of finding the re between some curve nd the is for running between two specified vlues. We pproimted the region b union of thin rectngles
More informationAREA OF A SURFACE OF REVOLUTION
AREA OF A SURFACE OF REVOLUTION h cut r πr h A surfce of revolution is formed when curve is rotted bout line. Such surfce is the lterl boundr of solid of revolution of the tpe discussed in Sections 7.
More informationBasic Math Review. Numbers. Important Properties. Absolute Value PROPERTIES OF ADDITION NATURAL NUMBERS {1, 2, 3, 4, 5, }
ƒ Bsic Mth Review Numers NATURAL NUMBERS {1,, 3, 4, 5, } WHOLE NUMBERS {0, 1,, 3, 4, } INTEGERS {, 3,, 1, 0, 1,, } The Numer Line 5 4 3 1 0 1 3 4 5 Negtive integers Positive integers RATIONAL NUMBERS All
More informationAssignment 2. Solutions. Compiler Design I (Kompilatorteknik I) 2011
Assignment 2 olutions Compiler Design I Kompiltorteknik I) 2011 1 Contextfree grmmrs Give the definition of context free grmmr over the lphbet Σ = {, b} tht describes ll strings tht hve different number
More informationHomework #6 Chapter 7 Homework Acids and Bases
Homework #6 Chpter 7 Homework Acids nd Bses 18. ) H O(l) H 3O (q) OH (q) H 3 O OH Or H O(l) H (q) OH (q) H OH ) HCN(q) H O(l) H 3O (q) CN (q) H 3 O HCN CN Or HCN(q) H (q) CN (q) H CN HCN c) NH 3(q) H O(l)
More informationLecture 15  Curve Fitting Techniques
Lecture 15  Curve Fitting Techniques Topics curve fitting motivtion liner regression Curve fitting  motivtion For root finding, we used given function to identify where it crossed zero where does fx
More information2 DIODE CLIPPING and CLAMPING CIRCUITS
2 DIODE CLIPPING nd CLAMPING CIRCUITS 2.1 Ojectives Understnding the operting principle of diode clipping circuit Understnding the operting principle of clmping circuit Understnding the wveform chnge of
More information4. Greed. Algorithm Design by Éva Tardos and Jon Kleinberg Slides by Kevin Wayne (modified by Neil Rhodes)
4 Greed Greed is good Greed is right Greed works Greed clrifies, cuts through, nd cptures the essence of the evolutionry spirit  Gordon Gecko (Michel Dougls) Algorithm Design by Év Trdos nd Jon Kleinberg
More informationBayesian Updating with Continuous Priors Class 13, 18.05, Spring 2014 Jeremy Orloff and Jonathan Bloom
Byesin Updting with Continuous Priors Clss 3, 8.05, Spring 04 Jeremy Orloff nd Jonthn Bloom Lerning Gols. Understnd prmeterized fmily of distriutions s representing continuous rnge of hypotheses for the
More informationChapter 9: Quadratic Equations
Chpter 9: Qudrtic Equtions QUADRATIC EQUATIONS DEFINITION + + c = 0,, c re constnts (generlly integers) ROOTS Synonyms: Solutions or Zeros Cn hve 0, 1, or rel roots Consider the grph of qudrtic equtions.
More informationA new algorithm for generating Pythagorean triples
A new lgorithm for generting Pythgoren triples RH Dye 1 nd RWD Nicklls 2 The Mthemticl Gzette (1998); 82 (Mrch, No. 493), p. 86 91 (JSTOR rchive) http://www.nicklls.org/dick/ppers/mths/pythgtriples1998.pdf
More informationLesson 10. Parametric Curves
Return to List of Lessons Lesson 10. Prmetric Curves (A) Prmetric Curves If curve fils the Verticl Line Test, it cn t be expressed by function. In this cse you will encounter problem if you try to find
More informationCS99S Laboratory 2 Preparation Copyright W. J. Dally 2001 October 1, 2001
CS99S Lortory 2 Preprtion Copyright W. J. Dlly 2 Octoer, 2 Ojectives:. Understnd the principle of sttic CMOS gte circuits 2. Build simple logic gtes from MOS trnsistors 3. Evlute these gtes to oserve logic
More informationFORMAL LANGUAGES, AUTOMATA AND THEORY OF COMPUTATION EXERCISES ON REGULAR LANGUAGES
FORMAL LANGUAGES, AUTOMATA AND THEORY OF COMPUTATION EXERCISES ON REGULAR LANGUAGES Introduction This compendium contins exercises out regulr lnguges for the course Forml Lnguges, Automt nd Theory of Computtion
More informationMultiplication and Division  Left to Right. Addition and Subtraction  Left to Right.
Order of Opertions r of Opertions Alger P lese Prenthesis  Do ll grouped opertions first. E cuse Eponents  Second M D er Multipliction nd Division  Left to Right. A unt S hniqu Addition nd Sutrction
More informationOr more simply put, when adding or subtracting quantities, their uncertainties add.
Propgtion of Uncertint through Mthemticl Opertions Since the untit of interest in n eperiment is rrel otined mesuring tht untit directl, we must understnd how error propgtes when mthemticl opertions re
More informationSuffix Trees. Description follows Dan Gusfield s book Algorithms on Strings, Trees and Sequences
Suffix Trees Description follows Dn Gusfield s ook Algorithms on Strings, Trees nd Sequences Slides sources: Pvel Shviko, (University of Trento), Him Kpln (Tel Aviv University) CG 12 Ron Shmir Outline
More informationMathematics. Vectors. hsn.uk.net. Higher. Contents. Vectors 128 HSN23100
hsn.uk.net Higher Mthemtics UNIT 3 OUTCOME 1 Vectors Contents Vectors 18 1 Vectors nd Sclrs 18 Components 18 3 Mgnitude 130 4 Equl Vectors 131 5 Addition nd Subtrction of Vectors 13 6 Multipliction by
More informationCSC 143S 6 CSC 143S 3
CSC 143 Trees [Chpter 10] Everydy Exmples of Trees Fmily tree Compny orgniztion chrt Tble of contents Any hierrchicl orgniztion of informtion, representing components in terms of their subcomponents NB:
More informationBrief review of prerequisites for ECON4140/4145
1 ECON4140/4145, August 2010 K.S., A.S. Brief review of prerequisites for ECON4140/4145 References: EMEA: K. Sdsæter nd P. Hmmond: Essentil Mthemtics for Economic Anlsis, 3rd ed., FT Prentice Hll, 2008.
More informationAnnouncements. CS 188: Artificial Intelligence. Example: Weather HMM. Filtering / Monitoring. Hidden Markov Models   Filters
Announcements P4 Byes Nets / Tresure Hunting hs een relesed. It s due Mondy April 4th t :59pm. HW7 hs een relesed. It s due Tuesdy April 5th, t :59pm. It s out twice s long s typicl homework. We encourge
More informationTwo hours UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE. Date: Friday 16 th May 2008. Time: 14:00 16:00
COMP20212 Two hours UNIVERSITY OF MANCHESTER SCHOOL OF COMPUTER SCIENCE Digitl Design Techniques Dte: Fridy 16 th My 2008 Time: 14:00 16:00 Plese nswer ny THREE Questions from the FOUR questions provided
More information11. Fourier series. sin mx cos nx dx = 0 for any m, n, sin 2 mx dx = π.
. Fourier series Summry of the bsic ides The following is quick summry of the introductory tretment of Fourier series in MATH. We consider function f with period π, tht is, stisfying f(x + π) = f(x) for
More informationSimple Electric Circuits
Simple Eletri Ciruits Gol: To uild nd oserve the opertion of simple eletri iruits nd to lern mesurement methods for eletri urrent nd voltge using mmeters nd voltmeters. L Preprtion Eletri hrges move through
More informationQuadratic Equations  1
Alger Module A60 Qudrtic Equtions  1 Copyright This puliction The Northern Alert Institute of Technology 00. All Rights Reserved. LAST REVISED Novemer, 008 Qudrtic Equtions  1 Sttement of Prerequisite
More informationHow fast can we sort? Sorting. Decisiontree model. Decisiontree for insertion sort Sort a 1, a 2, a 3. CS 3343  Spring 2009
CS 4  Spring 2009 Sorting Crol Wenk Slides courtesy of Chrles Leiserson with smll chnges by Crol Wenk CS 4 Anlysis of Algorithms 1 How fst cn we sort? All the sorting lgorithms we hve seen so fr re comprison
More informationRational Numbers  Grade 10 [CAPS]
OpenStxCNX module: m848 Rtionl Numers  Grde 0 [CAPS] Free High School Science Texts Project Bsed on Rtionl Numers y Rory Adms Free High School Science Texts Project Mrk Horner Hether Willims This work
More informationON THE FRAMESTEWART ALGORITHM FOR THE TOWER OF HANOI
ON THE FRAMESTEWART ALGORITHM FOR THE TOWER OF HANOI MICHAEL RAND 1. Introduction The Tower of Hnoi puzzle ws creted over century go by the number theorist Edourd Lucs [, 4], nd it nd its vrints hve chllenged
More informationArc Length. P i 1 P i (1) L = lim. i=1
Arc Length Suppose tht curve C is defined by the eqution y = f(x), where f is continuous nd x b. We obtin polygonl pproximtion to C by dividing the intervl [, b] into n subintervls with endpoints x, x,...,x
More informationBinary Representation of Numbers Autar Kaw
Binry Representtion of Numbers Autr Kw After reding this chpter, you should be ble to: 1. convert bse rel number to its binry representtion,. convert binry number to n equivlent bse number. In everydy
More information4.0 5Minute Review: Rational Functions
mth 130 dy 4: working with limits 1 40 5Minute Review: Rtionl Functions DEFINITION A rtionl function 1 is function of the form y = r(x) = p(x) q(x), 1 Here the term rtionl mens rtio s in the rtio of two
More informationSTRINGS AND PATTERN MATCHING
STRINGS AND PATTERN MATCHING Brute Force, RinKrp, KnuthMorrisPrtt Wht s up? I m looking for some string. Tht s quite trick considering tht you hve no eyes. Oh yeh? Hve you seen your writing? It looks
More informationEngineertoEngineer Note
EngineertoEngineer Note EE265 Technicl notes on using Anlog Devices DSPs, processors nd development tools Contct our technicl support t dsp.support@nlog.com nd t dsptools.support@nlog.com Or visit our
More informationRegular Language Membership Constraint
Regulr Lnguge Memership Constrint Niko Pltzer Universität des Srlndes, Deutschlnd, nikopp@ps.unis.de, Advisor: Lutz Strßurger Astrct. This pper minly dels with the work of Gilles Pesnt on the stretch
More informationExponentiation: Theorems, Proofs, Problems Pre/Calculus 11, Veritas Prep.
Exponentition: Theorems, Proofs, Problems Pre/Clculus, Verits Prep. Our Exponentition Theorems Theorem A: n+m = n m Theorem B: ( n ) m = nm Theorem C: (b) n = n b n ( ) n n Theorem D: = b b n Theorem E:
More information0.1 Basic Set Theory and Interval Notation
0.1 Bsic Set Theory nd Intervl Nottion 3 0.1 Bsic Set Theory nd Intervl Nottion 0.1.1 Some Bsic Set Theory Notions Like ll good Mth ooks, we egin with definition. Definition 0.1. A set is welldefined
More informationLogical Design. Design with Basic Logic Gates
Logicl Design Zvi Kohvi nd Nirj K. Jh Design ith Bsic Logic Gtes Logic gtes: perform logicl opertions on input signls Positive (negtive) logic polrit: constnt () denotes high voltge nd constnt lo (high)
More informationOn the Meaning of Regression Coefficients for Categorical and Continuous Variables: Model I and Model II; Effect Coding and Dummy Coding
Dt_nlysisclm On the Mening of Regression for tegoricl nd ontinuous Vribles: I nd II; Effect oding nd Dummy oding R Grdner Deprtment of Psychology This describes the simple cse where there is one ctegoricl
More informationMembrane Systems with Marked Membranes
Membrne Systems with Mrked Membrnes Mtteo Cvliere Microsoft Reserch  University of Trento Centre for Computtionl nd Systems Biology Itly Dep. of Computer Science nd Artificil Intelligence University of
More informationNOTES AND CORRESPONDENCE. Uncertainties of Derived Dewpoint Temperature and Relative Humidity
MAY 4 NOTES AND CORRESPONDENCE 81 NOTES AND CORRESPONDENCE Uncertinties of Derived Dewpoint Temperture nd Reltive Humidity X. LIN AND K. G. HUBBARD High Plins Regionl Climte Center, School of Nturl Resource
More informationLecture 3 Basic Probability and Statistics
Lecture 3 Bsic Probbility nd Sttistics The im of this lecture is to provide n extremely speedy introduction to the probbility nd sttistics which will be needed for the rest of this lecture course. The
More informationP.3 Polynomials and Factoring. P.3 an 1. Polynomial STUDY TIP. Example 1 Writing Polynomials in Standard Form. What you should learn
33337_0P03.qp 2/27/06 24 9:3 AM Chpter P Pge 24 Prerequisites P.3 Polynomils nd Fctoring Wht you should lern Polynomils An lgeric epression is collection of vriles nd rel numers. The most common type of
More information5 a LAN 6 a gateway 7 a modem
STARTER With the help of this digrm, try to descrie the function of these components of typicl network system: 1 file server 2 ridge 3 router 4 ckone 5 LAN 6 gtewy 7 modem Another Novell LAN Router Internet
More informationVectors 2. 1. Recap of vectors
Vectors 2. Recp of vectors Vectors re directed line segments  they cn be represented in component form or by direction nd mgnitude. We cn use trigonometry nd Pythgors theorem to switch between the forms
More informationFinite Automata. Informatics 2A: Lecture 3. John Longley. 25 September School of Informatics University of Edinburgh
Lnguges nd Automt Finite Automt Informtics 2A: Lecture 3 John Longley School of Informtics University of Edinburgh jrl@inf.ed.c.uk 25 September 2015 1 / 30 Lnguges nd Automt 1 Lnguges nd Automt Wht is
More informationHelicopter Theme and Variations
Helicopter Theme nd Vritions Or, Some Experimentl Designs Employing Pper Helicopters Some possible explntory vribles re: Who drops the helicopter The length of the rotor bldes The height from which the
More informationGRADE 7 ADAPTED NJDOE ASSESSMENT. Assessed Standards: 7.NS.1 7.NS.2 7.NS.3. (To be administered after NPS Grade 7 Scope and Sequence Units 1&2)
ADAPTED NJDOE ASSESSMENT GRADE 7 (To e dministered fter NPS Grde 7 Scope nd Sequence Units &2) Assessed Stndrds: 7.NS. 7.NS.2 7.NS.3 The Newrk Pulic Schools  Office of Mthemtics 203 Nme Period Dte Grde
More informationEcon 4721 Money and Banking Problem Set 2 Answer Key
Econ 472 Money nd Bnking Problem Set 2 Answer Key Problem (35 points) Consider n overlpping genertions model in which consumers live for two periods. The number of people born in ech genertion grows in
More informationSolving the String Statistics Problem in Time O(n log n)
Solving the String Sttistics Prolem in Time O(n log n) Gerth Stølting Brodl 1,,, Rune B. Lyngsø 3, Ann Östlin1,, nd Christin N. S. Pedersen 1,2, 1 BRICS, Deprtment of Computer Science, University of Arhus,
More informationUnit 6: Exponents and Radicals
Eponents nd Rdicls : The Rel Numer Sstem Unit : Eponents nd Rdicls Pure Mth 0 Notes Nturl Numers (N):  counting numers. {,,,,, } Whole Numers (W):  counting numers with 0. {0,,,,,, } Integers (I): 
More informationIntegration. 148 Chapter 7 Integration
48 Chpter 7 Integrtion 7 Integrtion t ech, by supposing tht during ech tenth of second the object is going t constnt speed Since the object initilly hs speed, we gin suppose it mintins this speed, but
More informationnot to be republished NCERT POLYNOMIALS CHAPTER 2 (A) Main Concepts and Results (B) Multiple Choice Questions
POLYNOMIALS (A) Min Concepts nd Results Geometricl mening of zeroes of polynomil: The zeroes of polynomil p(x) re precisely the xcoordintes of the points where the grph of y = p(x) intersects the xxis.
More informationBabylonian Method of Computing the Square Root: Justifications Based on Fuzzy Techniques and on Computational Complexity
Bbylonin Method of Computing the Squre Root: Justifictions Bsed on Fuzzy Techniques nd on Computtionl Complexity Olg Koshelev Deprtment of Mthemtics Eduction University of Texs t El Pso 500 W. University
More informationAMTH247 Lecture 16. Numerical Integration I
AMTH47 Lecture 16 Numericl Integrtion I 3 My 006 Reding: Heth 8.1 8., 8.3.1, 8.3., 8.3.3 Contents 1 Numericl Integrtion 1.1 MonteCrlo Integrtion....................... 1. Attinble Accurcy.........................
More informationWritten Homework 6 Solutions
Written Homework 6 Solutions Section.10 0. Explin in terms of liner pproximtions or differentils why the pproximtion is resonble: 1.01) 6 1.06 Solution: First strt by finding the liner pproximtion of f
More information10.5 Graphing Quadratic Functions
0.5 Grphing Qudrtic Functions Now tht we cn solve qudrtic equtions, we wnt to lern how to grph the function ssocited with the qudrtic eqution. We cll this the qudrtic function. Grphs of Qudrtic Functions
More information2.6.3 Characteristic of Compoundwound motor connection common use aids speed falls opposes speed increases ratio seriestoshunt field ampereturns
.6.3 Chrcteristic of Compoundwound motor A compoundwound motor hs both series nd shunt field winding, (i.e. one winding in series nd one in prllel with the rmture circuit), by vrying the number of turns
More informationMA 15800 Lesson 16 Notes Summer 2016 Properties of Logarithms. Remember: A logarithm is an exponent! It behaves like an exponent!
MA 5800 Lesson 6 otes Summer 06 Rememer: A logrithm is n eponent! It ehves like n eponent! In the lst lesson, we discussed four properties of logrithms. ) log 0 ) log ) log log 4) This lesson covers more
More information