SF Bay Area Oct 12 event: (1) Partially Observable Markov Decision Processes in Julia; (2) Boxed Variables


#1

After a long break, we’re happy to have have a Julia meetup in the SF area on Oct 12; see below for the title, description and a link to the event. Many of you will visit the San Francisco area in the next six months; we’d love to hear a talk from you! Please contact me now so that we can make plans.

— Event title and description—
(1) Partially Observable Markov Decision Processes in Julia; (2) Boxed Variables

We’re very happy to have Zach Sunberg from the Stanford Intelligent Systems Lab (SISL) speak to us on partially observable Markov decision processes in Julia. Before Zach’s talk, we will have an introduction to boxed variables and how to get around them from Vishal Kasliwal. Finally, we will briefly review the roadmap to Julia 1.0.

Zach’s abstract: Safe and flexible autonomy, especially in systems like self-driving cars, is one of the most immediately important goals in artificial intelligence. The partially observable Markov decision process (POMDP) is a tool for modeling decision making problems with uncertainty. In a POMDP, an agent must make a series of decisions based on stochastic observations to try to maximize a reward function. Though a POMDP is a very expressive tool for formalizing a real world problem, the approach is rarely used in practice because of extreme computational demands. Julia is an ideal tool for studying and solving POMDPs because it simultaneously provides the computational power to tackle large problems and the expressiveness to easily implement a wide range of problems and solution techniques. However, it also lacks some features (e.g. interfaces) that would make communication between programmers easier. This talk will focus on SISL’s POMDPs.jl package and the challenges and successes we have had in building it and other related packages.

Come 15 min early for pizza


Event link: https://www.meetup.com/Bay-Area-Julia-Users/events/243812111/