Paper Info
Title
An online POMDP algorithm used by the policeforce agents in the robocuprescue simulation
Abstract
In the RoboCupRescue simulation, the PoliceForce agents have to decide which roads to clear to help other agents to navigate in the city. In this article, we present how we have modelled their environment as a POMDP and more importantly we present our new online POMDP algorithm enabling them to make good decisions in real-time during the simulation. Our algorithm is based on a look-ahead search to find the best action to execute at each cycle. We thus avoid the overwhelming complexity of computing a policy for each possible situation. To show the efficiency of our algorithm, we present some results on standard POMDPs and in the RoboCupRescue simulation environment.
Year
DOI
Venue
2005
10.1007/11780519_18
RoboCup 2009
Keywords
Field
DocType
good decision,best action,policeforce agent,online pomdp algorithm,possible situation,standard pomdps,overwhelming complexity,look-ahead search,robocuprescue simulation,robocuprescue simulation environment,look ahead,real time
Online algorithm,Simulation,Partially observable Markov decision process,Computer science,Algorithm,Markov decision process,Artificial intelligence,Machine learning,Robotics,Computational complexity theory
Conference
Volume
ISSN
ISBN
4020
0302-9743
3-540-35437-9
Citations 
PageRank 
References 
0
0.34
10
Authors
3
Name
Order
Citations
PageRank
Sébastien Paquet125317.43
Ludovic Tobin2574.22
Chaib-draa, Brahim31190113.23