Debugging Julia HTTP Package Performance bottleneck

[dilipjain]

I was doing performance analysis of Julia HTTP server. A simple HelloWorld API gives around 4K Request/second(1 Core, Max CPU Utilization = 50%). Since the CPU utilisation of Julia process is not 100% I suspect there is some other bottleneck in the HTTP library code. Any pointers on how to go about debugging this?

Code

using HTTP

HTTP.serve() do request::HTTP.Request
    return HTTP.Response("Hello")
end

wrk load test

[pixel27]

You might want to take a look at:

HTTP.jl doesn't seem to be good at handling over 1k concurrent requests, in comparison to an alternative in Python?

I’m implementing an simple API server that is supposed to handle over concurrent 1k requests at a time. I have a code like below: using HTTP: @register, Response, handle const HEADERS = ["Content-Type" => "application/json"] bench_start_handler(req) = nothing hoge_handler(req, body) = ... # return JSON string ... # another handler body bench_end_handler(req) = nothing const router = HTTP.Router() @register(router, "GET", "/bench_start", bench_start_handler) @register(router, "POST", "/hoge"…

That goes with threading, not sure if want to go there, but some of the concepts might work well for the single thread case.