Hi there! Since this is your first post, you should read
If you want to solve MDPs, take a look at POMDPs.jl · POMDPs.jl