Learning when and how to coordinate

Article type: Research Article

Authors: Excelente-Toledo, Cora B. | Jennings, Nicholas R.

Affiliations: National Laboratory of Advanced Computer Science, LANIA, Rébsamen No. 80, Col. Isleta, C.P. 91090, Xalapa, Veracruz, Mexico. E-mail: [email protected] | School of Electronics and Computer Science, University of Southampton, Southampton, SO17 1BJ, UK. E-mail: [email protected]

Note: [] This work was done while the first author was a member of the Intelligence, Agents, Multimedia Group at the University of Southampton

Abstract: This paper examines the potential and the impact of introducing learning capabilities into autonomous agents that make decisions at run-time about which mechanism to exploit in order to coordinate their activities. Specifically, the efficacy of learning is evaluated for making the decisions that are involved in determining when and how to coordinate. Our motivating hypothesis is that to deal with dynamic and unpredictable environments it is important to have agents that can learn the right situations in which to attempt to coordinate and the right method to use in those situations. This hypothesis is evaluated empirically, using reinforcement based algorithms, in a grid-world scenario in which a) an agent's predictions about the other agents in the environment are approximately correct and b) an agent can not correctly predict the others' behaviour. The results presented show when, where and why learning is effective when it comes to making a decision about selecting a coordination mechanism.

Journal: Web Intelligence and Agent Systems: An international journal, vol. 1, no. 3-4, pp. 203-218, 2003