Paper Info
Title
A markov decision process model for strategic decision making in sailboat racing
Abstract
We consider the problem of strategic decision-making for inshore sailboat racing. This sequential decision-making problem is complicated by the yacht's dynamics which prevent it from sailing directly into the wind but allow it to sail close to the wind following a zigzag trajectory towards an upwind race marker. A skipper is faced with the problem of sailing the most direct route to this marker whilst minimizing the number of steering manoeuvres that slow down the boat. In this paper, we present a Decision Theoretic model for this decision-making process assuming a fully observable environment and uncertain boat dynamics. We develop a numerical Velocity Prediction Program (VPP) which allows us to predict the yacht's speed and direction of sail given the wind's strength and direction as well as the yacht's angle of attack with respect to the wind. We specify and solve a Markov Decision Process (MPD) using our VPP to estimate the rewards and transition probabilities. We also present a method for modelling the wind flow around landmasses allowing for the computation of strategies in realistic situations. Finally, we evaluate our approach in simulation showing that we can estimate optimal routes for different kinds of yachts and crew performance.
Year
DOI
Venue
2011
10.1007/978-3-642-21043-3_14
Canadian Conference on AI
Keywords
Field
DocType
wind flow,markov decision process,markov decision process model,sailboat racing,sequential decision-making problem,decision-making process,crew performance,upwind race marker,decision theoretic model,strategic decision-making,marker whilst,uncertain boat dynamic
Mathematical optimization,Angle of attack,Crew,Wind flow,Strategic decision making,Computer science,Operations research,Markov decision process,Artificial intelligence,Machine learning,Trajectory,Computation
Conference
Volume
ISSN
Citations 
6657.0
0302-9743
0
PageRank 
References 
Authors
0.34
4
2
Name
Order
Citations
PageRank
Daniel S. Ferguson100.34
Pantelis Elinas217513.21