MDPs simple program which:

1.capture and store a Markov decision process (MDP) at runtime;
2. given a policy, evaluate the policy and improve it to get a solution.

Hi there! Since this is your first post, you should read

If you want to solve MDPs, take a look at POMDPs.jl · POMDPs.jl