THE LOGIC OF ADAPTIVE BEHAVIOR
|
|
- Hubert Lane
- 8 years ago
- Views:
Transcription
1 THE LOGIC OF ADAPTIVE BEHAVIOR Knowledge Representation and Algorithms for Adaptive Sequential Decision Making under Uncertainty in First-Order and Relational Domains Martijn van Otterlo Department of Computer Science Katholieke Universiteit Leuven, Belgium IOS Press Amsterdam Berlin Oxford Tokyo Washington, DC
2 Contents Preface vii CHAPTER 1 introduction l 1.1. Science and Engineering of Adaptive Behavior Artificial Intelligence Constructing Artificial Behavior The Reinforcement Learning Paradigm You Can Only Learn What You Can Represent Generalization, Abstraction and Representation Formation CANTOR: Representing the World in Snapshots BOOLE: Representing the World in Twenty Questions FREGE: Representing the World in Terms of Objects and Relations The World Might be Larger than We See About the Contents and Structure of this Book Main Theme of This Book A Road Map Other Main Themes and Contributions 28 I Learning Sequential Decision Making under Uncertainty 29 CHAPTER 2 Markov Decision Processes: Concepts and Algorithms Learning Sequential Decision Making A Formal Framework Markov Decision Processes " Policies Optimality Criteria and Discounting Value Functions and Bellman Equations Solving Markov decision processes Dynamic Programming: Model-Based Solution Techniques Fundamental DP Algorithms Efficient DP Algorithms Reinforcement Learning: Model-Free Solution Techniques Temporal Difference Learning 54
3 Monte Carlo Methods Efficient Exploration and Value Updating Beyond the Markov Assumption Partially Observable Markov Decision Processes Discussion 66 CHAPTER 3 Generalization and Abstraction in Markov Decision Processes From Algorithmic to Representational Algorithmic Aspects Fundamental Problems of Huge State Spaces Representational Aspects..".' The Essence of Abstraction Knowledge Representation Definitions and Theories of Abstraction Representation Change Abstraction in the MDP Setting Dimensions of MDP Abstractions The PIAGET-Principle Representations in MDP Abstractions ABSTRACTION TYPE I: State Spaces Model-Based State Abstractions Model-Free State Abstractions ABSTRACTION TYPE II: Factored Markov Decision Processes Structured Representation Structured Algorithms ABSTRACTION TYPE III: Value Function Approximation Fundamentals of Value Function Approximation Architectures for VFA ABSTRACTION TYPE IV: Searching in Policy Space ABSTRACTION TYPE V: Hierarchical and Temporal Abstraction Semi-Markov Decision Processes Fixed Hierarchical Abstractions Model-Minimization for SMDPs Dynamic Hierarchical Abstractions An Abstraction Case Study: Fingerprint Recognition Reinforcement Learning for Minutiae Detection Experimental Results Benefits of Various Abstractions Discusssion 144 II Sequential Decisions in the First-Order Setting 151 CHAPTER 4 Reasoning, Learning and Acting in Worlds with Objects The World Consists of Objects Objects are Omnipresent and Indispensable A Relational Domain: BLOCKS WORLD 163 XII
4 Representing a World of Objects and Relations Representation and Inference in First-Order Domains First-Order Logic Fragments and Extensions of FOL First-Order Abstraction and Generalization Learning in First-Order Domains Obtaining Logical Abstractions Inductive Logic Programming Statistical Relational Learning..' Acting in First-Order Domains S Formalizing and Modeling First-Order Domains Two Characteristic Systems Beyond Basic Action Theories Learning Sequential Decision Making in Relational Domains Lifting the MDP Framework to First-Order Domains The PIAGET-Principle in First-Order Domains Learning and Representation Tasks in Relational RL What is Relational RL?: Different Viewpoints Conclusions 243 CHAPTER 5 Model-Free Algorithms for Relational MDPs Model-Free Relational Reinforcement Learning Sampling and Structural Induction Representations, and Value Functions vs. Policies CARCASS: A Model-Free, Value-Based Approach Relational Abstractions over RMDPs Q-LearningforCARCASSs Indirect Value Learning for CARCASSs using Approximate Models Analysis and Experiments Discussion A Survey of Model-Free, Value-Based Approaches Value-Based Learning on Fixed Abstraction Levels Value-Based Learning using Dynamic Generalization Discussion of Model-Free, Value-Based Techniques GREY: Evolutionary Policy Search in Relational Domains Evolutionary Search and ILP GREY'S Anatomy Experimental Evaluation A Survey of Policy-Based Model-Free Relational RL Evolutionary Policy Search Policy Search as Classification Policy Gradient Approaches Discussion 301 CHAPTER 6 Model-Based Algorithms for Relational MDPs Intensional Dynamic Programming in Five Easy Steps STEP I: Classical Dynamic Programming 310 XIII
5 STEP II: Replacing Tables by Sets STEP III: Set-Based Value Functions STEP IV: Set-Based Dynamic Programming STEP V: Intensional Dynamic Programming A Relational State Description Language Abstract States Abstract Actions Rewards Domain Theory and Constraint Handling Markov Decision Programs, Value Functions and Policies REBEL: Value Iteration for Markov Decision Programs Overlaps, Regression and Weakest Preconditions Combination and First-Order Decision-Theoretic Regression Maximization: Computing Abstract State Values Relational Bellman Backup Operator Experiments Logic Programming meets Dynamic Programming Tabling Policy Induction in REBEL Other Extensions and Domain Theories A Survey of Model-Based Approaches Methods for exact IDP in First-Order Domains Approximate Model-Based Methods for First-Order MDPs Beyond the Markov Assumption Discussion 392 III Implications, Challenges and Conclusions 395 CHAPTER 7 Sapience, Models and Hierarchy Scaling Up... ; Extending Mental States Declarative versus Procedural Representations Learning vs. Reasoning Examples of Existing Formalisms Characterizing Sapient Agents Cognitive Agents Learning in Cognitive Agents The Social Environment Discussion of the Sapient Model of Agents A Survey of Hierarchies, Models, Guidance and Transfer Learning World Models Bias, Guidance and Heuristics Hierarchies Transfer Multi-Agent Approaches 419 XIV
6 7.4. Discussion 420 CHAPTER 8 Conclusions and Future Directions Conclusions and Reflections Main Argument Contributions Dimensions of First-Order MDPs and Solution Algorithms Future Challenges Upgrading the Complete Spectrum of RL Methods Techniques Developed in this Book i v.._._ Representational Aspects Algorithmic Aspects Theory Agents, Cognitive Architectures, Reasoning and Transfer Applications, Actions, Robots and Activities Benchmarks and Toolboxes Beyond the Markov Assumption Concluding Remarks 442 Bibliography 443 List of Acronyms 477 Author Index 479 XV
Learning is a very general term denoting the way in which agents:
What is learning? Learning is a very general term denoting the way in which agents: Acquire and organize knowledge (by building, modifying and organizing internal representations of some external reality);
More informationDATA MINING IN FINANCE
DATA MINING IN FINANCE Advances in Relational and Hybrid Methods by BORIS KOVALERCHUK Central Washington University, USA and EVGENII VITYAEV Institute of Mathematics Russian Academy of Sciences, Russia
More informationDetection. Perspective. Network Anomaly. Bhattacharyya. Jugal. A Machine Learning »C) Dhruba Kumar. Kumar KaKta. CRC Press J Taylor & Francis Croup
Network Anomaly Detection A Machine Learning Perspective Dhruba Kumar Bhattacharyya Jugal Kumar KaKta»C) CRC Press J Taylor & Francis Croup Boca Raton London New York CRC Press is an imprint of the Taylor
More informationMachine Learning. 01 - Introduction
Machine Learning 01 - Introduction Machine learning course One lecture (Wednesday, 9:30, 346) and one exercise (Monday, 17:15, 203). Oral exam, 20 minutes, 5 credit points. Some basic mathematical knowledge
More informationData Warehouse Design
Data Warehouse Design Modern Principles and Methodologies Matteo Golfarelli Stefano Rizzi Translated by Claudio Pagliarani Mc Grauu Hill New York Chicago San Francisco Lisbon London Madrid Mexico City
More informationLecture 1: Introduction to Reinforcement Learning
Lecture 1: Introduction to Reinforcement Learning David Silver Outline 1 Admin 2 About Reinforcement Learning 3 The Reinforcement Learning Problem 4 Inside An RL Agent 5 Problems within Reinforcement Learning
More informationNEURAL NETWORKS A Comprehensive Foundation
NEURAL NETWORKS A Comprehensive Foundation Second Edition Simon Haykin McMaster University Hamilton, Ontario, Canada Prentice Hall Prentice Hall Upper Saddle River; New Jersey 07458 Preface xii Acknowledgments
More informationData Mining: Concepts and Techniques. Jiawei Han. Micheline Kamber. Simon Fräser University К MORGAN KAUFMANN PUBLISHERS. AN IMPRINT OF Elsevier
Data Mining: Concepts and Techniques Jiawei Han Micheline Kamber Simon Fräser University К MORGAN KAUFMANN PUBLISHERS AN IMPRINT OF Elsevier Contents Foreword Preface xix vii Chapter I Introduction I I.
More informationCSC384 Intro to Artificial Intelligence
CSC384 Intro to Artificial Intelligence What is Artificial Intelligence? What is Intelligence? Are these Intelligent? CSC384, University of Toronto 3 What is Intelligence? Webster says: The capacity to
More informationİZMİR INSTITUTE OF TECHNOLOGY GRADUATE SCHOOL OF ENGINEERING AND SCIENCES DEPARTMENT OF COMPUTER ENGINEERING DOCTORAL PROGRAM IN COMPUTER ENGINEERING
İZMİR INSTITUTE OF TECHNOLOGY GRADUATE SCHOOL OF ENGINEERING AND SCIENCES DEPARTMENT OF COMPUTER ENGINEERING DOCTORAL PROGRAM IN COMPUTER ENGINEERING Core Courses CENG 590 CENG 600 CENG 8XX Seminar (0-2)
More informationMotivation. Motivation. Can a software agent learn to play Backgammon by itself? Machine Learning. Reinforcement Learning
Motivation Machine Learning Can a software agent learn to play Backgammon by itself? Reinforcement Learning Prof. Dr. Martin Riedmiller AG Maschinelles Lernen und Natürlichsprachliche Systeme Institut
More informationComputing Near Optimal Strategies for Stochastic Investment Planning Problems
Computing Near Optimal Strategies for Stochastic Investment Planning Problems Milos Hauskrecfat 1, Gopal Pandurangan 1,2 and Eli Upfal 1,2 Computer Science Department, Box 1910 Brown University Providence,
More informationMaster Data Management
Master Data Management David Loshin AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS SAN DIEGO Ик^И V^ SAN FRANCISCO SINGAPORE SYDNEY TOKYO W*m k^ MORGAN KAUFMANN PUBLISHERS IS AN IMPRINT OF ELSEVIER
More informationJae Won idee. School of Computer Science and Engineering Sungshin Women's University Seoul, 136-742, South Korea
STOCK PRICE PREDICTION USING REINFORCEMENT LEARNING Jae Won idee School of Computer Science and Engineering Sungshin Women's University Seoul, 136-742, South Korea ABSTRACT Recently, numerous investigations
More informationTABLE OF CONTENTS ABSTRACT ACKNOWLEDGEMENT LIST OF FIGURES LIST OF TABLES
TABLE OF CONTENTS ABSTRACT ACKNOWLEDGEMENT LIST OF FIGURES LIST OF TABLES ii iii x xiv CHAPTER 1: INTRODUCTION 1 1.0 Background 1 1.1 Research Motivation 4 1.2 Research Objectives 5 1.3 Project Scope 6
More informationCS Master Level Courses and Areas COURSE DESCRIPTIONS. CSCI 521 Real-Time Systems. CSCI 522 High Performance Computing
CS Master Level Courses and Areas The graduate courses offered may change over time, in response to new developments in computer science and the interests of faculty and students; the list of graduate
More informationEffect of Using Neural Networks in GA-Based School Timetabling
Effect of Using Neural Networks in GA-Based School Timetabling JANIS ZUTERS Department of Computer Science University of Latvia Raina bulv. 19, Riga, LV-1050 LATVIA janis.zuters@lu.lv Abstract: - The school
More informationReusable Knowledge-based Components for Building Software. Applications: A Knowledge Modelling Approach
Reusable Knowledge-based Components for Building Software Applications: A Knowledge Modelling Approach Martin Molina, Jose L. Sierra, Jose Cuena Department of Artificial Intelligence, Technical University
More informationCourse Outline Department of Computing Science Faculty of Science. COMP 3710-3 Applied Artificial Intelligence (3,1,0) Fall 2015
Course Outline Department of Computing Science Faculty of Science COMP 710 - Applied Artificial Intelligence (,1,0) Fall 2015 Instructor: Office: Phone/Voice Mail: E-Mail: Course Description : Students
More informationMachine Learning: Overview
Machine Learning: Overview Why Learning? Learning is a core of property of being intelligent. Hence Machine learning is a core subarea of Artificial Intelligence. There is a need for programs to behave
More informationPreliminaries: Problem Definition Agent model, POMDP, Bayesian RL
POMDP Tutorial Preliminaries: Problem Definition Agent model, POMDP, Bayesian RL Observation Belief ACTOR Transition Dynamics WORLD b Policy π Action Markov Decision Process -X: set of states [x s,x r
More informationDynamic Modeling, Predictive Control and Performance Monitoring
Biao Huang, Ramesh Kadali Dynamic Modeling, Predictive Control and Performance Monitoring A Data-driven Subspace Approach 4y Spri nnger g< Contents Notation XIX 1 Introduction 1 1.1 An Overview of This
More informationAn Application of Inverse Reinforcement Learning to Medical Records of Diabetes Treatment
An Application of Inverse Reinforcement Learning to Medical Records of Diabetes Treatment Hideki Asoh 1, Masanori Shiro 1 Shotaro Akaho 1, Toshihiro Kamishima 1, Koiti Hasida 1, Eiji Aramaki 2, and Takahide
More information10-601. Machine Learning. http://www.cs.cmu.edu/afs/cs/academic/class/10601-f10/index.html
10-601 Machine Learning http://www.cs.cmu.edu/afs/cs/academic/class/10601-f10/index.html Course data All up-to-date info is on the course web page: http://www.cs.cmu.edu/afs/cs/academic/class/10601-f10/index.html
More informationOnline Learning and Exploiting Relational Models in Reinforcement Learning
Online Learning and Exploiting Relational Models in Reinforcement Learning Tom Croonenborghs, Jan Ramon, Hendrik Blockeel and Maurice Bruyoghe K.U.Leuven, Dept. of Computer Science Celestijnenlaan 200A,
More informationMachine Learning in Hospital Billing Management. 1. George Mason University 2. INOVA Health System
Machine Learning in Hospital Billing Management Janusz Wojtusiak 1, Che Ngufor 1, John M. Shiver 1, Ronald Ewald 2 1. George Mason University 2. INOVA Health System Introduction The purpose of the described
More informationMaterials Management and Inventory Systems
Materials Management and Inventory Systems Richard J.Tersine Old Dominion University 'C & North-Holland PUBLISHING COMPANY NEW YORK AMSTERDAM Contents Preface Chapter 1 INTRODUCTION 1 Inventory 4 Types
More informationThe MultiAgent Decision Process toolbox: software for decision-theoretic planning in multiagent systems
The MultiAgent Decision Process toolbox: software for decision-theoretic planning in multiagent systems Matthijs T.J. Spaan Institute for Systems and Robotics Instituto Superior Técnico Lisbon, Portugal
More informationMaster s Program in Information Systems
The University of Jordan King Abdullah II School for Information Technology Department of Information Systems Master s Program in Information Systems 2006/2007 Study Plan Master Degree in Information Systems
More informationAssignment #1. Example: tetris state: board configuration + shape of the falling piece ~2 200 states! Recap RL so far. Page 1
Generalization and function approximation CS 287: Advanced Robotics Fall 2009 Lecture 14: Reinforcement Learning with Function Approximation and TD Gammon case study Pieter Abbeel UC Berkeley EECS Represent
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Martin Lauer AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg martin.lauer@kit.edu
More informationHigh-Mix Low-Volume Flow Shop Manufacturing System Scheduling
Proceedings of the 14th IAC Symposium on Information Control Problems in Manufacturing, May 23-25, 2012 High-Mix Low-Volume low Shop Manufacturing System Scheduling Juraj Svancara, Zdenka Kralova Institute
More informationNeuro-Dynamic Programming An Overview
1 Neuro-Dynamic Programming An Overview Dimitri Bertsekas Dept. of Electrical Engineering and Computer Science M.I.T. September 2006 2 BELLMAN AND THE DUAL CURSES Dynamic Programming (DP) is very broadly
More informationAn Environment Model for N onstationary Reinforcement Learning
An Environment Model for N onstationary Reinforcement Learning Samuel P. M. Choi Dit-Yan Yeung Nevin L. Zhang pmchoi~cs.ust.hk dyyeung~cs.ust.hk lzhang~cs.ust.hk Department of Computer Science, Hong Kong
More informationCore Courses Seminar (0-2) Non-credit Ph.D. Thesis (0-1) Non-credit Special Studies (8-0) Non-credit. Elective Courses
İZMİR INSTITUTE OF TECHNOLOGY GRADUATE SCHOOL OF ENGINEERING AND SCIENCES DEPARTMENT OF COMPUTER ENGINEERING JOINT DOCTORAL PROGRAM IN COMPUTER SCIENCE AND ENGINEERING Core Courses CENG 590 CENG 600 CENG
More informationSelf-Service Decision Intelligence
Self-Service Decision Intelligence Open Decision Computation: framework for implementing SSDI-based architecture for policy-based enterprise decision management [EARLY DRAFT FOR EXCHANGE] version: 29.04.2015
More informationData Mining - Evaluation of Classifiers
Data Mining - Evaluation of Classifiers Lecturer: JERZY STEFANOWSKI Institute of Computing Sciences Poznan University of Technology Poznan, Poland Lecture 4 SE Master Course 2008/2009 revised for 2010
More informationSolving Hybrid Markov Decision Processes
Solving Hybrid Markov Decision Processes Alberto Reyes 1, L. Enrique Sucar +, Eduardo F. Morales + and Pablo H. Ibargüengoytia Instituto de Investigaciones Eléctricas Av. Reforma 113, Palmira Cuernavaca,
More informationStudy Plan for the Master Degree In Industrial Engineering / Management. (Thesis Track)
Study Plan for the Master Degree In Industrial Engineering / Management (Thesis Track) Plan no. 2005 T A. GENERAL RULES AND CONDITIONS: 1. This plan conforms to the valid regulations of programs of graduate
More informationHow To Write A Diagram
Data Model ing Essentials Third Edition Graeme C. Simsion and Graham C. Witt MORGAN KAUFMANN PUBLISHERS AN IMPRINT OF ELSEVIER AMSTERDAM BOSTON LONDON NEW YORK OXFORD PARIS SAN DIEGO SAN FRANCISCO SINGAPORE
More informationFundamentals of Business Process Management
Marlon Dumas Marcello La Rosa Jan Mendling Hajo A. Reijers Fundamentals of Business Process Management Springer 1 Introduction to Business Process Management 1 1.1 Processes Everywhere 1 1.2 Ingredients
More informationData Isn't Everything
June 17, 2015 Innovate Forward Data Isn't Everything The Challenges of Big Data, Advanced Analytics, and Advance Computation Devices for Transportation Agencies. Using Data to Support Mission, Administration,
More informationIMPROVING RESOURCE LEVELING IN AGILE SOFTWARE DEVELOPMENT PROJECTS THROUGH AGENT-BASED APPROACH
IMPROVING RESOURCE LEVELING IN AGILE SOFTWARE DEVELOPMENT PROJECTS THROUGH AGENT-BASED APPROACH Constanta Nicoleta BODEA PhD, University Professor, Economic Informatics Department University of Economics,
More informationStatistical Rules of Thumb
Statistical Rules of Thumb Second Edition Gerald van Belle University of Washington Department of Biostatistics and Department of Environmental and Occupational Health Sciences Seattle, WA WILEY AJOHN
More informationDynamic Pricing and Automated Resource Allocation for Complex Information Services
Lecture Notes in Economics and Mathematical Systems 589 Dynamic Pricing and Automated Resource Allocation for Complex Information Services Reinforcement Learning and Combinatorial Auctions Bearbeitet von
More informationWhat is Artificial Intelligence?
CSE 3401: Intro to Artificial Intelligence & Logic Programming Introduction Required Readings: Russell & Norvig Chapters 1 & 2. Lecture slides adapted from those of Fahiem Bacchus. 1 What is AI? What is
More informationHi iv. Declaration Certificate Acknowledgement Preface. List o f Table. List o f Figures. viii xvi xvii. 1.1 Introduction 1
Declaration Certificate Acknowledgement Preface. List o f Table. List o f Figures Hi iv V viii xvi xvii Chapter 1 Introduction 1-13 1.1 Introduction 1 1.2 Statement of the Problem 3 1.2.1 Terms used in
More informationOptimized Scheduling in Real-Time Environments with Column Generation
JG U JOHANNES GUTENBERG UNIVERSITAT 1^2 Optimized Scheduling in Real-Time Environments with Column Generation Dissertation zur Erlangung des Grades,.Doktor der Naturwissenschaften" am Fachbereich Physik,
More informationContents. Dedication List of Figures List of Tables. Acknowledgments
Contents Dedication List of Figures List of Tables Foreword Preface Acknowledgments v xiii xvii xix xxi xxv Part I Concepts and Techniques 1. INTRODUCTION 3 1 The Quest for Knowledge 3 2 Problem Description
More informationGlobal Project Management
Global Project Management Communication, Collaboration and Management Across Borders Jean binder Contents List of Figures List of Tables Acknowledgements Preface xiii xv xvii xix Introduction 1 Traditional,
More informationPrinciples of Data Mining by Hand&Mannila&Smyth
Principles of Data Mining by Hand&Mannila&Smyth Slides for Textbook Ari Visa,, Institute of Signal Processing Tampere University of Technology October 4, 2010 Data Mining: Concepts and Techniques 1 Differences
More informationvii TABLE OF CONTENTS CHAPTER TITLE PAGE DECLARATION DEDICATION ACKNOWLEDGEMENT ABSTRACT ABSTRAK
vii TABLE OF CONTENTS CHAPTER TITLE PAGE DECLARATION DEDICATION ACKNOWLEDGEMENT ABSTRACT ABSTRAK TABLE OF CONTENTS LIST OF TABLES LIST OF FIGURES LIST OF ABBREVIATIONS LIST OF SYMBOLS LIST OF APPENDICES
More informationMining. Practical. Data. Monte F. Hancock, Jr. Chief Scientist, Celestech, Inc. CRC Press. Taylor & Francis Group
Practical Data Mining Monte F. Hancock, Jr. Chief Scientist, Celestech, Inc. CRC Press Taylor & Francis Group Boca Raton London New York CRC Press is an imprint of the Taylor Ei Francis Group, an Informs
More informationPrinciples of Inventory and Materials Management
Principles of Inventory and Materials Management Second Edition Richard J. Tersine The University of Oklahoma m North Holland New York Amsterdam Oxford TECHNISCHE HOCHSCHULE DARMSTADT Fochbereich 1 Gesamthiblio-thek
More informationPARALLEL PROGRAMMING
PARALLEL PROGRAMMING TECHNIQUES AND APPLICATIONS USING NETWORKED WORKSTATIONS AND PARALLEL COMPUTERS 2nd Edition BARRY WILKINSON University of North Carolina at Charlotte Western Carolina University MICHAEL
More informationContents RELATIONAL DATABASES
Preface xvii Chapter 1 Introduction 1.1 Database-System Applications 1 1.2 Purpose of Database Systems 3 1.3 View of Data 5 1.4 Database Languages 9 1.5 Relational Databases 11 1.6 Database Design 14 1.7
More informationWhat is Learning? CS 391L: Machine Learning Introduction. Raymond J. Mooney. Classification. Problem Solving / Planning / Control
What is Learning? CS 391L: Machine Learning Introduction Herbert Simon: Learning is any process by which a system improves performance from experience. What is the task? Classification Problem solving
More information^lxlt Scientific 2^Vl I Publishing
Automated Experiments for Deriving Performance-relevant Properties of Software Execution Environments by Michael Hauck ^lxlt Scientific 2^Vl I Publishing Contents 1. Introduction I l.l. Motivation I l.2.
More informationQuotes from Object-Oriented Software Construction
Quotes from Object-Oriented Software Construction Bertrand Meyer Prentice-Hall, 1988 Preface, p. xiv We study the object-oriented approach as a set of principles, methods and tools which can be instrumental
More informationImplementation of hybrid software architecture for Artificial Intelligence System
IJCSNS International Journal of Computer Science and Network Security, VOL.7 No.1, January 2007 35 Implementation of hybrid software architecture for Artificial Intelligence System B.Vinayagasundaram and
More informationTDWI strives to provide course books that are content-rich and that serve as useful reference documents after a class has ended.
Previews of TDWI course books are provided as an opportunity to see the quality of our material and help you to select the courses that best fit your needs. The previews can not be printed. TDWI strives
More informationBranch-and-Price Approach to the Vehicle Routing Problem with Time Windows
TECHNISCHE UNIVERSITEIT EINDHOVEN Branch-and-Price Approach to the Vehicle Routing Problem with Time Windows Lloyd A. Fasting May 2014 Supervisors: dr. M. Firat dr.ir. M.A.A. Boon J. van Twist MSc. Contents
More informationRELIABILITY AND AVAILABILITY OF CLOUD COMPUTING. Eric Bauer. Randee Adams IEEE IEEE PRESS WILEY A JOHN WILEY & SONS, INC.
RELIABILITY AND AVAILABILITY OF CLOUD COMPUTING Eric Bauer Randee Adams IEEE IEEE PRESS WILEY A JOHN WILEY & SONS, INC., PUBLICATION CONTENTS Figures Tables Equations Introduction xvii xxi xxiii xxv I
More informationINFORMATION FILTERS SUPPLYING DATA WAREHOUSES WITH BENCHMARKING INFORMATION 1 Witold Abramowicz, 1. 2. 3. 4. 5. 6. 7. 8.
Contents PREFACE FOREWORD xi xiii LIST OF CONTRIBUTORS xv Chapter 1 INFORMATION FILTERS SUPPLYING DATA WAREHOUSES WITH BENCHMARKING INFORMATION 1 Witold Abramowicz, 1 Data Warehouses 2 The HyperSDI System
More informationIntroduction. Acknowledgments Support & Feedback Preparing for the Exam. Chapter 1 Plan and deploy a server infrastructure 1
Introduction Acknowledgments Support & Feedback Preparing for the Exam xv xvi xvii xviii Chapter 1 Plan and deploy a server infrastructure 1 Objective 1.1: Design an automated server installation strategy...1
More informationReinforcement Learning
Reinforcement Learning LU 2 - Markov Decision Problems and Dynamic Programming Dr. Joschka Bödecker AG Maschinelles Lernen und Natürlichsprachliche Systeme Albert-Ludwigs-Universität Freiburg jboedeck@informatik.uni-freiburg.de
More informationFigure 1: Cost and Speed of Access of different storage components. Page 30
Reinforcement Learning Approach for Data Migration in Hierarchical Storage Systems T.G. Lakshmi, R.R. Sedamkar, Harshali Patil Department of Computer Engineering, Thakur College of Engineering and Technology,
More informationTrading. Theory and Practice
Professional Automated Trading Theory and Practice EUGENE A. DURENARD WILEY Contents Preface xv CHAPTffi 1 introductiofl to Systematic Tradlns 1 1.1 Definition of Systematic Trading 2 1.2 Philosophy of
More informationGraduate Co-op Students Information Manual. Department of Computer Science. Faculty of Science. University of Regina
Graduate Co-op Students Information Manual Department of Computer Science Faculty of Science University of Regina 2014 1 Table of Contents 1. Department Description..3 2. Program Requirements and Procedures
More informationTeaching Introductory Artificial Intelligence with Pac-Man
Teaching Introductory Artificial Intelligence with Pac-Man John DeNero and Dan Klein Computer Science Division University of California, Berkeley {denero, klein}@cs.berkeley.edu Abstract The projects that
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More information01219211 Software Development Training Camp 1 (0-3) Prerequisite : 01204214 Program development skill enhancement camp, at least 48 person-hours.
(International Program) 01219141 Object-Oriented Modeling and Programming 3 (3-0) Object concepts, object-oriented design and analysis, object-oriented analysis relating to developing conceptual models
More informationOnline Tuning of Artificial Neural Networks for Induction Motor Control
Online Tuning of Artificial Neural Networks for Induction Motor Control A THESIS Submitted by RAMA KRISHNA MAYIRI (M060156EE) In partial fulfillment of the requirements for the award of the Degree of MASTER
More informationTheoretical Perspective
Preface Motivation Manufacturer of digital products become a driver of the world s economy. This claim is confirmed by the data of the European and the American stock markets. Digital products are distributed
More informationWinter 2016 Course Timetable. Legend: TIME: M = Monday T = Tuesday W = Wednesday R = Thursday F = Friday BREATH: M = Methodology: RA = Research Area
Winter 2016 Course Timetable Legend: TIME: M = Monday T = Tuesday W = Wednesday R = Thursday F = Friday BREATH: M = Methodology: RA = Research Area Please note: Times listed in parentheses refer to the
More informationCOPYRIGHTED MATERIAL. Contents. List of Figures. Acknowledgments
Contents List of Figures Foreword Preface xxv xxiii xv Acknowledgments xxix Chapter 1 Fraud: Detection, Prevention, and Analytics! 1 Introduction 2 Fraud! 2 Fraud Detection and Prevention 10 Big Data for
More informationSoftware and Hardware Solutions for Accurate Data and Profitable Operations. Miguel J. Donald J. Chmielewski Contributor. DuyQuang Nguyen Tanth
Smart Process Plants Software and Hardware Solutions for Accurate Data and Profitable Operations Miguel J. Bagajewicz, Ph.D. University of Oklahoma Donald J. Chmielewski Contributor DuyQuang Nguyen Tanth
More informationOperating Systems Principles
bicfm page i Operating Systems Principles Lubomir F. Bic University of California, Irvine Alan C. Shaw University of Washington, Seattle PEARSON EDUCATION INC. Upper Saddle River, New Jersey 07458 bicfm
More informationBusiness Rules and Decision Processes in Mediated Business Coordination
Business Rules and Decision Processes in Mediated Business Coordination Zheng Zhao and Virginia Dignum and Frank Dignum Department of Information and Computing Sciences Utrecht University The Netherlands
More informationNAVIGATING SCIENTIFIC LITERATURE A HOLISTIC PERSPECTIVE. Venu Govindaraju
NAVIGATING SCIENTIFIC LITERATURE A HOLISTIC PERSPECTIVE Venu Govindaraju BIOMETRICS DOCUMENT ANALYSIS PATTERN RECOGNITION 8/24/2015 ICDAR- 2015 2 Towards a Globally Optimal Approach for Learning Deep Unsupervised
More informationMaster of Science Service Oriented Architecture for Enterprise. Courses description
Master of Science Service Oriented Architecture for Enterprise Courses description SCADA and PLC networks The course aims to consolidate and transfer of extensive knowledge regarding the architecture,
More informationSome Research Challenges for Big Data Analytics of Intelligent Security
Some Research Challenges for Big Data Analytics of Intelligent Security Yuh-Jong Hu hu at cs.nccu.edu.tw Emerging Network Technology (ENT) Lab. Department of Computer Science National Chengchi University,
More informationThe Basics of Graphical Models
The Basics of Graphical Models David M. Blei Columbia University October 3, 2015 Introduction These notes follow Chapter 2 of An Introduction to Probabilistic Graphical Models by Michael Jordan. Many figures
More informationThe Designer's Guide to VHDL
The Designer's Guide to VHDL Third Edition Peter J. Ashenden EDA CONSULTANT, ASHENDEN DESIGNS PTY. LTD. ADJUNCT ASSOCIATE PROFESSOR, ADELAIDE UNIVERSITY AMSTERDAM BOSTON HEIDELBERG LONDON m^^ yj 1 ' NEW
More informationJOHN STUART MILL. John Skorupski. m London and New York
JOHN STUART MILL John Skorupski m London and New York Contents Preface Abbreviations xi xv 1 THE MILLIAN PHILOSOPHY 1 1 Philosophy and its past 1 2 Logic and metaphysics 5 3 Ethics and politics 12 4 The
More informationIntellectual Development
Intellectual Development Birth to Adulthood Robbie Case Centre for Applied Cognitive Science The Ontario Institute for Studies in Education Toronto, Ontario, Canada Technische Hochschule Darmstadt Fachbereich
More informationRapid System Prototyping with FPGAs
Rapid System Prototyping with FPGAs By R.C. Coferand Benjamin F. Harding AMSTERDAM BOSTON HEIDELBERG LONDON NEW YORK OXFORD PARIS SAN DIEGO SAN FRANCISCO SINGAPORE SYDNEY TOKYO Newnes is an imprint of
More informationML for the Working Programmer
ML for the Working Programmer 2nd edition Lawrence C. Paulson University of Cambridge CAMBRIDGE UNIVERSITY PRESS CONTENTS Preface to the Second Edition Preface xiii xv 1 Standard ML 1 Functional Programming
More informationLearning the Structure of Factored Markov Decision Processes in Reinforcement Learning Problems
Learning the Structure of Factored Markov Decision Processes in Reinforcement Learning Problems Thomas Degris Thomas.Degris@lip6.fr Olivier Sigaud Olivier.Sigaud@lip6.fr Pierre-Henri Wuillemin Pierre-Henri.Wuillemin@lip6.fr
More informationHierarchical Reinforcement Learning in Computer Games
Hierarchical Reinforcement Learning in Computer Games Marc Ponsen, Pieter Spronck, Karl Tuyls Maastricht University / MICC-IKAT. {m.ponsen,p.spronck,k.tuyls}@cs.unimaas.nl Abstract. Hierarchical reinforcement
More informationFeature Selection with Monte-Carlo Tree Search
Feature Selection with Monte-Carlo Tree Search Robert Pinsler 20.01.2015 20.01.2015 Fachbereich Informatik DKE: Seminar zu maschinellem Lernen Robert Pinsler 1 Agenda 1 Feature Selection 2 Feature Selection
More informationIAI : Expert Systems
IAI : Expert Systems John A. Bullinaria, 2005 1. What is an Expert System? 2. The Architecture of Expert Systems 3. Knowledge Acquisition 4. Representing the Knowledge 5. The Inference Engine 6. The Rete-Algorithm
More informationSimilarity Search and Mining in Uncertain Spatial and Spatio Temporal Databases. Andreas Züfle
Similarity Search and Mining in Uncertain Spatial and Spatio Temporal Databases Andreas Züfle Geo Spatial Data Huge flood of geo spatial data Modern technology New user mentality Great research potential
More informationActive Sensing for Robotics A Survey
Active Sensing for Robotics A Survey L. Mihaylova, T. Lefebvre, H. Bruyninckx, K. Gadeyne and J. De Schutter Katholieke Universiteit Leuven, Department of Mechanical Engineering, Division PMA, Celestijnenlaan
More informationUsing Data Mining for Mobile Communication Clustering and Characterization
Using Data Mining for Mobile Communication Clustering and Characterization A. Bascacov *, C. Cernazanu ** and M. Marcu ** * Lasting Software, Timisoara, Romania ** Politehnica University of Timisoara/Computer
More informationBayesian Statistics: Indian Buffet Process
Bayesian Statistics: Indian Buffet Process Ilker Yildirim Department of Brain and Cognitive Sciences University of Rochester Rochester, NY 14627 August 2012 Reference: Most of the material in this note
More informationProfessor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia
Professor, D.Sc. (Tech.) Eugene Kovshov MSTU «STANKIN», Moscow, Russia As of today, the issue of Big Data processing is still of high importance. Data flow is increasingly growing. Processing methods
More informationSchool of Computer Science
School of Computer Science Computer Science - Honours Level - 2014/15 October 2014 General degree students wishing to enter 3000- level modules and non- graduating students wishing to enter 3000- level
More informationPRINCIPLES OF INVENTORY AND MATERIALS MANAGEMENT
PRINCIPLES OF INVENTORY AND MATERIALS MANAGEMENT Fourth Edition Richard J. Tersine The University of Oklahoma TEGHNISCHE HOCHSCHULE DARMSTADT Fochbereich 1 Gesonr> 11-. ib I iothek Betiier >wi rtschottsiehre
More information