Table of Contents


     To Adapt or Not to Adapt - Consequences of Adapting Driver and
     Traffic Light Agents                                                         1
        Ana L.C. Bazzan, Denise de Oliveira, Franziska Kliigl, and Kai Nagel

     Optimal Control in Large Stochastic Multi-agent Systems                     15
       Bart van den Broek, Wim Wiegerinck, and Bert Kappen

     Continuous-State Reinforcement Learning with Fuzzy Approximation...         27
         Lucian Busoniu, Damien Ernst, Bart De Schutter, and
         Robert Babuska

     Using Evolutionary Game-Theory to Analyse the Performance of
     Trading Strategies in a Continuous Double Auction Market                   44
        Kai Cai, Jinzhong Niu, and Simon Parsons

     Parallel Reinforcement Learning with Linear Function
     Approximation                                                              60
        Matthew Grounds and Daniel Kudenko

     Combining Reinforcement Learning with Symbolic Planning                     75
       Matthew Grounds and Daniel Kudenko

     Agent Interactions and Implicit Trust in IPD Environments                  87
       Enda Howley and Colm O'Riordan

     Collaborative Learning with Logic-Based Models                             102
        Michal Jakob, Jan Tozicka, and Michal Pechoucek

     Priority Awareness: Towards a Computational Model of Human
     Fairness for Multi-agent Systems                                           117
        Steven de Jong, Karl Tuyls, Katja Verbeeck, and Nico Roos

     Bifurcation Analysis of Reinforcement Learning Agents in the Selten's
     Horse Game                                                                 129
        Alessandro Lazaric, Enrique Munoz de Cote, Fabio Dercole, and
        Marcello Restelli

     Bee Behaviour in Multi-agent Systems: A Bee Foraging Algorithm             145
        Nyree Lemmens, Steven de Jong. Karl Tuyls, and Ann Nowe

     Stable Cooperation in the N-Player Prisoner's Dilemma: The
     Importance of Community Structure                                          157
        Colm O 'Riordan and Hurnphrey Sorensen




VIII   Table of Contents

Solving Multi-stage Games with Hierarchical Learning Automata That
Bootstrap                                                            169
   Maarten Peeters, Katja Verbeeck, and Ann Nowe

Auctions. Evolution, and Multi-agent Learning                        188
  Steve Phelps, Kai Cai, Peter McBurney, Jinzhong Niu,
  Simon Parsons, and Elizabeth Sklar
Multi-agent Reinforcement Learning for Intrusion Detection           211
  Arturo Servin and Daniel Kudenko

Networks of Learning Automata and Limiting Games                     224
   Peter Vrancx, Katja Verbeeck, and Ann Nowe
Multi-agent Learning by Distributed Feature Extraction               239
  Michael Wurst


Author Index                                                         255