# MDPs simple program which:

**URL:** https://discourse.julialang.org/t/mdps-simple-program-which/64048
**Category:** Tooling
**Tags:** juliapro
**Created:** [July 4, 2021, 5:45pm UTC](https://discourse.julialang.org/t/mdps-simple-program-which/64048 "2021-07-04T17:45:54Z")
**Posts on this page:** 3
**Page:** 1

<div class="post-metadata">

### Author: ![Ernstkandombo](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ernstkandombo/32/26110_2.png) [@Ernstkandombo](https://discourse.julialang.org/u/Ernstkandombo)
#### Post date: [July 4, 2021, 5:45pm UTC](https://discourse.julialang.org/t/mdps-simple-program-which/64048/1 "2021-07-04T17:45:54Z")

</div>

1.capture and store a Markov decision process (MDP) at runtime;  
2. given a policy, evaluate the policy and improve it to get a solution.

---

<div class="post-metadata">

### Author: ![odow](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/odow/32/28685_2.png) [@odow](https://discourse.julialang.org/u/odow)
#### Post date: [July 4, 2021, 8:17pm UTC](https://discourse.julialang.org/t/mdps-simple-program-which/64048/2 "2021-07-04T20:17:42Z")

</div>

Hi there! Since this is your first post, you should read

> [@Please read: make it easier to help you](https://discourse.julialang.org/t/please-read-make-it-easier-to-help-you/14757):
>
> Welcome to the Julia Discourse! We are enthusiastic about helping Julia programmers, both beginner and experienced. This public service announcement (PSA) outlines best practices when asking for help. Following these points makes it easier for us to help you and more likely you’ll get a prompt, useful answer. Keywords are highlighted to make it easier to refer to specific points. Choose a descriptive title that captures the key part of your question, eg “plots with multiple axes” instead of …

If you want to solve MDPs, take a look at [POMDPs.jl · POMDPs.jl](https://juliapomdp.github.io/POMDPs.jl/latest/)

---

<div class="post-metadata">

### Author: ![mbauman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mbauman/32/31082_2.png) [@mbauman](https://discourse.julialang.org/u/mbauman)
#### Post date: [September 12, 2023, 4:41pm UTC](https://discourse.julialang.org/t/mdps-simple-program-which/64048/3 "2023-09-12T16:41:34Z")

</div>


