Source.

Transcription

1 AI of poker game 1 C H U N F U N G L E E C S E A R T I F I C I A L I N T E L L I G E N C E P R O. A N I T A W A S I L E W S K A

2 Source CAWSEY, ALISON. THE ESSENCE OF ARTIFICAL INTELLIGENCE. PRENTICE HALL

3 Overview INTRODUTION DATA TYPES ENCODING HAND VALUES HAND VALUES HAND STRENGTH POT ODDS RATE OF RETURN DECISION TESTING POKER AI 3

4 AI of poker game What is Artificial Intelligence? It is concerned with getting computers to do tasks that require human intelligence. 4 The Essence of ARTIFICIAL INTELLIGENCE chapter one page one

5 POKER It was played in a variety of forms, with 52 cards RANK(The number appear on the card) included 2,3,4,5,6,7,8,9,10,jack,queen,king and ace.(ace is the largest)we have 13 different number cards here. Suit(the style of the card) included diamond,club,heart and spade.(spade is the largest) we have 4 different suits here. 4*13=52 5

6 AI of poker game How does AI relates to poker game? 6

7 AI of poker game How Computers make decision? Hand Strength Return rate 7

8 Poker Variants 8 There are many different poker rule.(depend on what game you are playing. Example: Have a Heart Howdy doody TexasHold em

9 Texas Hold em 9 Players: 3-10 Initial deal: 2 cards down to each player, five cards down to the table. Play: A round of betting is held after the deal, then three of the table cards are turned up. Another round of betting follows. One more table card is flipped, followed by another round of betting. The last card is flipped, a final round if betting ensues, and finally a showdown in which players make their best hands using their 2 and the table's 5. Winner: High hand

10 Texas Hold em In Texas hold 'em, like all variants of poker, individuals compete for an amount of money contributed by the players themselves (called the pot). Because the cards are dealt randomly and outside the control of the players, each player attempts to control the amount of money in the pot based on the hand the player holds. 10

11 DATA TYPES A "suit" is an integer in the range 0..3, where 0=Clubs, 1=Diamonds, 2=Hearts, 3=Spades A "rank" is an integer in the range 0..12, where 0 = 2, 1 = 3, 11 = King, 12 = Ace. A "card" is an integer in the range 0..51, hence card = suit*13 + rank. Suit = card/13 Rank = card%13 A "Hand" is a 52 bit data type, where each bit represents a single card. This can be stored as four 16 bit words for ease of use, where each 16 bit word represents the potential cards in one suit 11

12 DATA TYPES A "Hand Type" is an integer representing the type of poker hand you have, where 0= no pair, 1=pair, 2=two pair, 3=trips, 4=straight, 5=flush, 6=full house, 7=quads, 8=straight flush. 12

13 HAND VALUES 13 A "Hand Value" is a 32 bit integer representing the relative value or strength of any hand of cards. By comparing two hand values, you can see which hand is stronger in a game of poker. A Hand Value is made up of six 4-bit integers. Left to Right: Type-Card1-Card2-Card3-Card4-Card5

14 ENCODING HAND VALUES Example: 3D 4H QS 2C 5C Gives a 32 bit integer: 0X000A

15 CALCULATING HAND VALUES Now we need a function that takes a hand, and returns a hand value. This involves determining the hand type, then inserting the address for the hand ranks, as previous slide. 15

16 CALCULATING HAND STRENGTH 16 Hand strength is the probability that you will win the hand, given your hole cards, the community cards, and the opponents who remain in the hand. Hand strength is a floating point number between 0.0 (certain loss) and 1.0 (certain win). For example, a HS of 0.33 means you have a 33% chance of winning.

17 CALCULATING HAND STRENGTH EXAMPLE: you win 300 games out of 1000, then you have HS of 300/1000=0.3 17

18 POT ODDS The pot odds number is the ratio of your bet or call to the size of the pot after you bet (the amount you will win). For example, if the bet is $10, and there is $60 in the pot, then the pot odds are 10/(10+60) =

19 RATE OF RETURN Rate of Return = Hand Strength / Pot Odds. 19

20 DECISION SINCE WE HAVE RR THEN WE CAN DECIDE fold, call and raise as below.(you can change the persentage) If RR < 0.8 then 95% fold, 0 % call, 5% raise (bluff) If RR < 1.0 then 80%, fold 5% call, 15% raise (bluff) If RR <1.3 the 0% fold, 60% call, 40% raise Else (RR >= 1.3) 0% fold, 30% call, 70% raise If fold and amount to call is zero, then call. 20

21 TESTING AI The AI should be set up so that different variants of AI can play against each other in a very high speed set of games. You should also code a few simplistic poker AI's into the mix, such as an AI that always goes all in. And then you record and evaluate the result appropriately. 21

22 MORE POWERFUL AI IMPLEMENT: 1. Probability space 2. Game theory and Nash Equilibrium 22

23 23 THANK YOU!