1 epresentation of Games Kerschbamer: Commitment and Information in Games
Game-Theoretic Description of Interactive Decision Situations This lecture deals with the process of translating an informal description of an interactive decision situation in a game-theoretic problem There are two basic forms or types of formal models to describe interactive decision situations: normal-form (or strategic-form) representation extensive-form representation ecture 1: epresentation of Games 2
Normal-Form epresentation Definition 1: The normal-form (or strategic form) representation of a (finite) game specifies 1. Players. A set of players (agents who play the game) N = {1,, n} with typical element i N 2. Strategies. For each player i N a nonempty set of feasible strategies S i with typical element s i S i 3. Payoffs. For each player i N a payoff function u i : S, where S = x i N S i. Notation: s S = x i N S i is called a strategy profile or a strategy combination. Note: The payoff function u i of player i specifies i s payoff for each strategy profile in S. A formal way to write down the normal-form of a game is G N = [N, {S i } i N, {u i } i N ]. For simple games a convenient way to summarize the normal-form information is the bi-matrix form (see next slides). ecture 1: epresentation of Games 3
Example 1: ock-paper-scissors there are two children who simultaneously choose one of three options the three options are rock, paper, scissors if the two choose the same option, the game is a draw; if one chooses rock and the second paper, the second wins (paper covers rock); if one chooses rock and the second scissors, the first wins (rock breaks scissors); and if one chooses paper and the second scissors, the second wins (scissor cuts paper) normal-form representation, formal version: Players. The players are the two children: N = {1,2} Strategies. The strategy set for the two players are S 1 = {, P, S} and S 2 = {, P, S} Payoffs. The payoffs of the two players are: u 1 (s 1,s 2 ) u 2 (s 1,s 2 ) u 1 (, ) = 0 u 2 (, ) = 0 u 1 (, P) = -1 u 2 (, P) = 1 u 1 (, S) = 1 u 2 (, S) = -1 u 1 (P, ) = 1 u 2 (P, ) = -1 u 1 (P, P) = 0 u 2 (P, P) = 0 u 1 (P, S) = -1 u 2 (P, S) = 1 u 1 (S, ) = -1 u 2 (S, ) = 1 u 1 (S, P) = 1 u 2 (S, P) = -1 u 1 (S, ecture S) = 0 1: epresentationuof 2 (S, Games S) = 0 4
Bi-Matrix epresentation of ock-paper-scissors strategies of child 1 child 2 ock Paper Scissors ock 0, 0-1, 1 1, -1 Paper 1, -1 0, 0-1, 1 Scissors -1, 1 1, -1 0, 0 payoff child 1 payoff child 2 ecture 1: epresentation of Games 5
Example 2: Matching Pennies there are two players, denoted A and B each player simultaneously puts a penny (an Euro) down, either heads up (H) or tails up (T) if the two pennies match (either both H or both T), player A pays 1 Dollar (1 Euro) to player B; otherwise player B pays 1 Dollar to player A. normal-form representation, formal version: Players. N = { } Strategies. S A = { }; S B = { } Payoffs. u A (s A, s B ) =, u B (s A, s B ) = normal-from representation, bi-matrix version: s A s B H T H T ecture 1: epresentation of Games 6
Normal-Form epresentation of Games with Continuous Strategy Spaces Example 3: Cournot - Duopoly homogeneous products market two firms simultaneously choose output quantities s 1 and s 2 smaller or equal to 80 total output: x = s 1 + s 2 inverse demand: P(x) = max{80 - x; 0} cost functions: C 1 (s 1 ) = 8s 1 ; C 2 (s 2 ) = 2s 2 normal-form representation (adapt Definition 1): Players. N = {1, 2} Strategies. S 1 = [0, 80]; S 2 = [0, 80] Payoffs. - for s 1 + s 2 80: u 1 (s 1, s 2 ) = (72 s 1 s 2 )s 1 ; u 2 (s 1, s 2 ) = (78 s 1 s 2 )s 2 -for s 1 + s 2 > 80: u 1 (s 1, s 2 ) = 8s 1 ; u 2 (s 1, s 2 ) = 2s 2 ecture 1: epresentation of Games 7
Normal-Form epresentation of Games with Continuous Strategy Spaces Example 4: Nash Demand Game two individuals, 1 and 2, argue over the division of a (perfectly divisible) Dollar they simultaneously make irrevocable demands, s 1 and s 2, smaller or equal to the Dollar if the two demands sum to no more than the Dollar, then both player get their demand, otherwise, neither player receives any money both players are interested in their own monetary payoff only normal-form representation (adapt Definition 1): Players. N = { } Strategies. S 1 = ; S 2 = Payoffs. u 1 (s 1, s 2 ) = ; u 2 (s 1, s 2 ) = ecture 1: epresentation of Games 8
Extensive-Form epresentation The normal-form representation is a very condensed representation of a game. It contains no info. on the timing of moves, on the actions available at each opportunity to move, etc. It seems, that only simultaneous move games can be represented in normal form. This is not true. More on this below Definition 2a (informal version): The extensive-form representation of a game specifies the players (agents) in the game, when each player has the move, what each player can do at each of her opportunities to move, what each player knows at each of her opportunities to move, in games with chance moves: the probabilities assigned to each feasible move, what the outcome is as a function of the actions taken by the players (inclusive the chance player nature ) the payoffs of the players (exclusive the chance player) from each possible outcome For simple games a convenient way to summarize the extensive-form information is the game tree (see next slides). We begin by informally introducing the elements of the extensive-form representation through a series of examples. ecture 1: epresentation of Games 9
Example 5: Game Tree of a Game with Perfect Information game starts at an initial decision node at the initial decision node, player 1 makes her move her choice is between the two actions left (l) and right (r) each of the two possible actions of player 1 is represented by a branch from the initial decision node at the end of each branch is another decision node now player 2 can choose between two actions, left () and right () if player 1 has chosen l and player 2 has chosen, we reach the end of the game, represented by a terminal node each terminal node lists the players payoffs arising from the sequence of moves leading to that terminal node Note: There is an unique connected path of branches from the initial node (sometimes called the root) to each point in the tree. Nodes represent not only the current position but also how it was reached. ecture 1: epresentation of Games 10
Example 6: Game Tree of a Game with Imperfect Information in example 5, when it is a player s turn to move, she is able to observe all her rival s previous moves such games are called games of perfect information (we give a more precise definition below) the concept of an information set allows us to accommodate the possibility that this is not so the elements of an information set are a subset of a particular player s decision nodes the interpretation is that when play has reached one of the decision nodes in the info set and it is that player s turn to move, she does not know which of these nodes she is actually at note that player 2 has the same two possible actions at each of the two nodes in her info set this must be the case if player 2 is unable to distinguish the two nodes Definition 3. An information set for a player is a collection of decision nodes satisfying: (i) the player has the move at every node in the information set; and (ii) when the play of the game reaches a node in the information set, the player with the move does not know which node in the set has been reached Note: The use of info sets also allows us to capture play that is simultaneous in the game tree. Try Example 1 and Example 2. ecture 1: epresentation of Games 11
Example 7 (ussian oulette): Game Tree of a Game with Chance Moves in previous examples the outcome of the game has been a deterministic function of the players choices in many games there is an element of chance this too, can be captured in the game tree by including random moves of nature (player 0) here is the story: two officers who have been competing for the affections of a Muscovite lady for a long time decide to settle the matter with the following game: a bullet is loaded at random into one of the chambers of a six-shooter the two players then alternate in taking turns when it is his turn, a player may chicken out (N) or point the gun at his own head and pull the trigger (A). chickening out or death disqualifies a player from further pursuit of the lady each player prefers being left with the lady undisturbed to chicken out and each prefers chickening out to being dead. Note: Nature plays its actions with fixed probabilities (written in brackets). ecture 1: epresentation of Games 12
Example 8: andom Moves and Information Sets two players flip a coin yielding H (for heads up ) and T (for tails up ) each with probability ½ player 1 puts her penny down, either H or T player 2 puts his penny down, either H or T if the pennies of the two players match, both get 2 Euros if the pennies of the two players don t match, the player whose penny matches nature s move gets 5 Euro, the other player gets nothing Draw the game tree for the following variants of the game: Variant A: player 1 observes the outcome of the coin flip, player 2 observes neither the outcome of the coin flip nor player 1 s move Variant B: player 1 observes the outcome of the coin flip, player 2 does not observe the outcome of the coin flip but he observes player 1 s move Variant C: both players observe the outcome of the coin flip, player 2 does not observe player 1 s move Variant D: both players observe the outcome of the coin flip, player 2 observes player 1 s move Variant E: no player observes the outcome of the coin flip, player 2 doesn t observe player 1 s move Variant ecture 1: epresentation of Games 13
Extensive-Form epresentation: Formal Definition Definition 2b (formal version). The extensive-form representation of a game specifies 1. Players. A set of players N with typical element i. 2. Histories. A set of histories H with typical element h. Each h is a sequence of actions by individual players. H is the start of the game. If h H, but there is no (h, a) H where a is an action for some player, then h is terminal. Denote the set of terminal histories as T H 3. Player Function. A function P : H \ T N {0}, assigning a player or nature (formally player 0) to each non-terminal history. 4. Nature. For each h H such that P(h) = 0, f(a h) is the probability that (h, a) H occurs. 5. Information. For each player i N an information partition I i of {h H : P(h) = i}. (h, a) H (h, a) H for all histories h, h H in the information set I i I i 6. Payoffs. vnm payoffs for each i N are defined over terminal histories, u i : T Note: (h, a) is the history (of length t + 1) which consists of h (of length t), followed by a. A formal way to write down the extensive-form of a game is G E = [N, H, P, f, {I i } i N, {u i } i N ] ecture 1: epresentation of Games 14
Applying the Formal Definition Example 5: Players. The set of players is N = {1, 2}. Nature does not move. Histories. The set of histories is H = {( ), (l), (r), (l, ), (l, ), (r, ), (r, ), (r,, ), (r,, ), (r,,, l), (r,,, r)} The set of terminal histories is T = {(l, ), (l, ), (r, ), (r,, ), (r,,, l), (r,,, r)} Player Function. P( ) = 1, P(l) = 2, P(r) = 2, P(r, ) = 2, P(r,, ) = 1 Information. The information partition of player 1 is I 1 = {, {(r,, )}}, the information partition of player 2 is I 2 = {{(l)}, {(r)}, {(r, )}} Payoffs. Defined over T and shown in the tree, e.g. u 1 (l, ) = 5 and u 2 (l, ) = 0 Example 6: Players. The set of players is N = {1, 2}. Nature does not move. Histories. The set of histories is H = { } The set of terminal histories is T = { } Player Function. P( ) = Information. The information partition of player 1 is I 1 = The information partition of player 2 is I 2 =.. Payoffs. ecture 1: epresentation of Games 15
Applying the Formal Definition (Cont.) Example 7: Players. The set of players is N = { } Histories. The set of histories is H = { } The set of terminal histories is T = {.} Player Function. P( ) = Nature: f(1 ) = Information. The information partition of player 1 is I 1 = { } The information partition of player 2 is I 2 = { } Payoffs.. ecture 1: epresentation of Games 16
Finiteness Assumptions in the Definition of an Extensive Game Note: There are three types of finiteness assumptions hidden in Definition 2b Definition 2 implicitly assumes that players have a finite number of actions available at each decision node. Many economic applications (e.g. Cournot- and Bertrand-competition) violate this assumption. Allowing for an infinite set of actions requires that we allow for an infinite set of histories as well. Also, if nature has an infinite set of moves the f function has to be adapted to allow for this. Definition 2 implicitly assumes that the game must end after a finite number of steps. Some economic situations (e.g. market interactions between firms) violate this assumptions. In games with an infinite sequence of moves there are no terminal nodes and no terminal histories. Payoffs have to be defined over (infinite) sequences of moves (or infinite histories) instead of defining them over terminal nodes (or terminal histories). Definition 2 implicitly assumes a finite number of players who take actions in the game. Some economic examples (e.g. overlapping generation models) violate this assumption. Allowing for an infinite number of players requires some adaptations in the definition. The formal definition of an extensive-form representation of a game can be extended to those infinite cases without much difficulty. We do not extend the definition here but we will adapt it when needed. ecture 1: epresentation of Games 17
Strategies in normal-form games: A strategy for a player in a normal-form game is simply one of the choices available to her in the game. in extensive-form games: Definition 4a (informal version): A strategy for a player in an extensive-form game is a complete contingent plan, or decision rule, that specifies how the player will act in every possible distinguishable circumstance in which she might be called upon to move. Definition 4b (formal version 1): A strategy for player i N in the extensive-form game G E = [N, H, P, f, {I i } i N, {u i } i N ] is a function a i (.) that assigns an action a i (h) to each h H \ T where P(h) = i with a i (h) = a i (h ) whenever h, h I i,so that (h, a i (h)) H. Definition 4c (formal version 2): Consider the extensive-form game G E = [N, H, P, f, {I i } i N, {u i } i N ]. et A denote the set of possible actions in the game and A(I i ) the set of possible actions at information set I i I i. A strategy for player i in G E is a function s i (.) that assigns an action s i (I i ) A(I i ) to each I i I i. Note: A strategy is a complete plan of action specifying a move after every history (in version 1) or at every info set (in version 2) where the player makes a choice. Moves are specified even for histories (or information sets) that are never reached if that strategy is played! Apply definition to extensive-form games on previous slides. ecture 1: epresentation of Games 18
Extensive-Form and Normal-Form epresentation Definition 5: An outcome in an extensive-form game G E = [N, H, P, f, {I i } i N, {u i } i N ] is one of the terminal histories (in T) of the game. Note: Payoffs are defined over outcomes. In extensive-form games without chance moves a strategy profile s = (s 1,,s n ) results in an unique outcome. Thus, in such games there is an unique payoff vector associated with each strategy profile. In extensive-form games with chance moves a strategy profile s = (s 1,,s n ) results in a probability distribution over outcomes. To get to the payoff vector associated with s calculate expected payoffs. This yields again an unique payoff vector for each strategy profile. From previous discussion it is clear that for any extensive-form game representation of a game, there is an unique normal-form representation (more precisely, it is unique up to any renaming or renumbering of strategies). The converse is not true, however. Many different extensiveforms may be represented by the same normal-form (see below). ecture 1: epresentation of Games 19
Transforming an Extensive-Form Game without Chance Moves into a Normal-Form Game l l 5, 0 5, 0 5, 0 5, 0 1, 4 1, 4 1, 4 1, 4 l r 5, 0 5, 0 5, 0 5, 0..,.. 1, 4 1, 4 1, 4 r l 6, 3 6, 3...,....,....,.. 6, 3 4, 5 6, 2 r r 6, 3 6, 3 2, 1 6, 2 6, 3 6, 3 2, 1 6, 2 ecture 1: epresentation of Games 20
Transforming an Extensive-Form Game with Chance Moves into a Normal-Form Game H H T T H T H T H 2, 2..,....,....,.. T..,....,....,....,.. ecture 1: epresentation of Games 21
Transforming a Normal-Form Game into an Extensive-Form Game player B player A l 1, 1 1, 1 r -1, -1 2, 0 ecture 1: epresentation of Games 22
Mixed Strategies Up to now, we have assumed that players make their choices with certainty. There is no a priori reason to exclude the possibility that a player could randomize when faced with a choice. Definition 6. Given player i s (finite) set of pure strategies S i, a mixed strategy for player i, σ i : S i [0, 1] assigns to each pure strategy s i S i a probability σ i (s i ) 0 that it will be played, where σ ( ) = 1 s S i si i i Notation. (S i ), the set of probability distributions over S i with typical element σ i, is called the mixed extensions of S i. Note: If player i has M pure strategies in the set S i = {s i1,,s im } and σ im = σ i (s im ) then (S i ) = {(σ i1,, σ im ) M : σ im 0 for all m = 1,,M and M m=1 σ im = 1} Note: A pure strategy can be viewed as a special case of a mixed strategy in which the probability distribution over S i is degenerate. Notation: Define σ = (σ 1,, σ N )and σ -i (S -i ) = x j i (S j ) analogously to the pure strategy case. Apply definitions to Examples 1 and 2. ecture 1: epresentation of Games 23
Mixed Strategies and Expected Utilities When players randomize over their pure strategies, the induced outcome is itself random. Since each player s payoff function u i (s) is of the von Neumann Morgenstern type, player i s payoff given a profile of mixed strategies σ = (σ 1,,σ n ) for the n player is her expected utility, the expectation being taken with respect to the probabilities induced by σ on pure strategy profiles s = (s 1,,s n ). Notation: U i : (S) is a vnm expected utility function that assigns to each σ (S) the expected utility (using u i ) of the lottery over S induced by σ. Note: If players mix according to σ then U ( σ ) = u ( s) σ ( s ). i s S Notation: The game Γ N =[N, { (S i )} i N, {U i } i N ], where (S i ) is the set of probability distributions over S i and where U i is derived from σ and u i as stated above, is called the mixed extension of G N = [N, {S i } i N, {u i } i N ] i j N j j ecture 1: epresentation of Games 24