Introduction to Theory of Computation

Transcription

1 Introduction to Theory of Computation COMP2600 Formal Methods for Software Engineering Katya Lebedeva Australian National University Semester 2, 2016 Slides created by Katya Lebedeva COMP 2600 Introduction to Theory of Computation 1

2 Brief Historical Overview Already in 1930 s Alan Turing studied an abstract machine, Turing machine! In 1940 s and 1950 s simpler kinds of machines, finite automata, were studied. In the late 1950 s Noam Chomsky began his study of formal grammar. In 1969 Stephen Cook separated problems that are intractable (also called NP-hard ). COMP 2600 Introduction to Theory of Computation 2

3 COMP 2600 Introduction to Theory of Computation 3

4 Initially all Intel chips did all arithmetic using integers. Software programs were instructing the chip how to divide floating-point numbers using integer arithmetic. The 1993 chips had these instructions integrated into them. This makes calculations much faster. In 1994 Thomas R. Nicely discovered that the processor could return incorrect decimal results when dividing large prime numbers. The replacement of flawed chips costed Intel US$475 million! Intel CEO Andy Grove: Intel survived the crisis and was made stronger by it. We dramatically improved our validation methodology to quickly capture and fix errata, and investigated innovative ways to design products that are error-free right from the beginning. COMP 2600 Introduction to Theory of Computation 4

5 Three Major branches of Theory of Computation 1. Automata Theory deals with definitions and properties of computation models. Examples: Deterministic Finite Automata (July 18, July 20) Nondeterministic Finite Automata (July 22) Context-Free Grammars (July 27) Turing Machines (August 1, August 3, August 5) 2. Computability Theory - the study of decidability - classifies problems as being solvable or unsolvable (August 5) 3. Complexity Theory - the study of intractability - classifies problems according to their degree of difficulty COMP 2600 Introduction to Theory of Computation 5

6 Basic Definitions of Automata Theory Alphabet is a finite, nonempty set of symbols Examples: Σ 1 = {0,1} Σ 2 = {a,b,...,z} Σ 3 = {A,B,...,Z} COMP 2600 Introduction to Theory of Computation 6

7 String (word) is a finite sequence of symbols chosen from some alphabet is a string from Σ 1 gobbledygook is a string from Σ 2 Empty string is the string with no symbols ε can be chosen from any alphabet! Length of a string the number of positions for symbols in the string ( number of symbols is often said though) is 5 and not 2 gobbledygook is 12 and not 8 ε is 0 COMP 2600 Introduction to Theory of Computation 7

8 Powers of Alphabet Σ k denotes the set of all strings of length k over Σ Σ k = Σ Σ Σ }{{} k times Σ 0 = {ε} for all Σ For Σ 1 = {0,1}, Σ 1 1 = {0,1} Σ 2 1 = {00,01,10,11} COMP 2600 Introduction to Theory of Computation 8

9 Closure of an alphabet Σ: Σ is the set of all strings over Σ Σ = Σ 0 Σ 1 Σ 2... The set of non-empty strings from alphabet Σ: Σ + = Σ 1 Σ 2 Σ 3... Hence Σ = Σ + {ε} Note: All strings in Σ and Σ + are finite. Σ and Σ + are infinite sets. COMP 2600 Introduction to Theory of Computation 9

10 Concatenation of Strings If then x = a 1 a 2...a m Σ y = b 1 b 2...b n Σ x y = a 1 a 2...a m b 1 b 2...b n ε is the identity for concatenation: ε x = x ε = x Length: x y = x + y COMP 2600 Introduction to Theory of Computation 10

11 Language L over Σ is any subset of Σ (i.e. L Σ ) set of all English words is a language over {A,B,...,Z,a,d,...,z} {ε,01,0011,000111,...}, i.e. all strings with equal number of 0 and 1 and with all 0 s preceeding 1 s, is a language over {0,1} /0, the empty language, is a language over any alphabet {ε}, the language consisting of only the empty string, is a language over any alphabet Note that a language may be infinite. Note that L is also a language over any alphabet that is a superset of Σ. COMP 2600 Introduction to Theory of Computation 11

12 Finite State Automata Neurophysiologists Warren S. McCullough and Walter Pitts published in 1943 the paper A Logical Calculus of the Ideas Immanent in Nervous Activity that is considered as a seminal contribution to the theory of automata. Nowadays FSA are a useful model for many important kinds of hardware and software, such as: software for digital circuits software for validating protocols lexical analizers COMP 2600 Introduction to Theory of Computation 12

13 State is a snapshot of a system s history The advantage of having finite number of states is that we can implement the system with fixed set of resources. An automaton works as follows: it is always in one of finitely many states at a time starts in some state changes state in response to an external input (i.e. makes a transition) accepts input by ending in an accepting (also called final) state The accepted strings constitute the language defined by the automaton! COMP 2600 Introduction to Theory of Computation 13

14 A finite automaton modelling recognition of COMP2600 C O M start C CO COM P COMP 2 COMP COMP260 0 COMP26 6 COMP2 COMP 2600 Introduction to Theory of Computation 14

15 start Start state: COMP2600 Accepting state: Transition: COMP260 0 When the FA is in state COMP26 COMP26 and it sees a 0 in the input, it moves to state COMP260 and advances on the input. COMP 2600 Introduction to Theory of Computation 15

16 Vending Machine accepts $1 and $2 coins refunds all money if more than $4 is added is ready to deliver if exactly $4 has been added 1, $2 $ $0 $1 2 $3 2 Slide created by Ranald Clouston. Adapted by Katya Lebedeva. COMP 2600 Introduction to Theory of Computation 16

17 Σ = {1,2} The start state is $0. This is indicated by the at the left of it. At the accepting state $4 (double circled) you have the exact credit for your purchase Which of the following strings does this automaton accept? the empty string ε Slide created by Ranald Clouston. Adapted by Katya Lebedeva. COMP 2600 Introduction to Theory of Computation 17

18 Finite Automaton and Language each FA defines a language: the set of all strings that result in a sequence of state transitions from the start state to an accepting state each string is a sequence of input labels along the path from the start state to an accepting state languages that can be described by FA are regular languages The study of FA and the study of formal languages are therefore linked: given a FA, find the language that is accepted by this automaton given a language, find the FA that accepts this language COMP 2600 Introduction to Theory of Computation 18