MDPtoolbox: Markov Decision Processes toolbox

The Markov Decision Processes (MDP) toolbox proposes functions related to the resolution of discrete-time Markov Decision Processes: finite horizon, value iteration, policy iteration, linear programming algorithms with some variants and also proposes some functions related to Reinforcement Learning.

Version: 4.0.1
Depends: Matrix, linprog
Published: 2012-12-31
Author: Iadine Chades, Guillaume Chapron, Marie-Josee Cros, Frederick Garcia, Regis Sabbadin
Maintainer: Guillaume Chapron <gchapron at>
License: BSD
NeedsCompilation: no
CRAN checks: MDPtoolbox results


Reference manual: MDPtoolbox.pdf
Package source: MDPtoolbox_4.0.1.tar.gz
OS X binary: MDPtoolbox_4.0.1.tgz
Windows binary:
Old sources: MDPtoolbox archive