How to host your deep learning model trained in flux

How to host your saved julia flux model on web? Like Pytorch and Flask are used

1 Like
function predict(req)
    io = IOBuffer(HTTP.payload(req))
    x = JSON3.read(io)
    y = model(x)
    HTTP.Response(200, JSON3.write(y))
end

router = HTTP.Router()
HTTP.@register(router, "POST", "predict", predict)
HTTP.serve(router, "0.0.0.0", port)
1 Like

There is also Dash.jl

1 Like

I find a lot of features missing in Dash. I would rather use Genie.jl

1 Like

But your example was just HTTP right, not genie?

This makes me wonder. Are there any ‘example’ pages out there which are based on Genie.jl?

Yes I’m working on Genie example/tutorial. This was a quick snippet meanwhile

1 Like