Visualizing another process with Pluto notebook

General Usage
, ,
1

I’m considering to use Pluto as an internal dash boarding application. This seems like a natural progression to me because I’ve been using Pluto for offline analysis, and I want to make it possible to monitor real-time activity from Pluto.

I looked at Distributed.jl for its serialization and RPC capability. But I didn’t want Pluto to be ClusterManager, where it would bring down the worker process if the notebook process ended. I’m looking for a client/server setup where Pluto is the visualization server, and an independently managed client uses it for visualization.

Pluto itself uses Malt.jl for RPC with workers, but it still behaves as a singular cluster.

Anything involving HTTP/Websockets seems like terrible overhead for my use case of large data, single machine.

MsgPackRpcServer.jl seems to be basic and no longer under development. I’m not sure what would be the utility or consequence of bring in the MessagePack format when I only need Julia serialization.

Is custom solution the only way to do this? Using some combination of Julia Sockets, Serialization and perhaps SharedArray? Is there any fast RPC mechanism that’s not tied to a cluster architecture but allows for client-server?

2

I went with RPC over HTTP.Websockets. It seems to have very little overhead over TCP for long conversations, which is what Distributed.jl uses anyway. Websockets may also be useful for authentication down the line.

I wrote most of this with Claude. If there’s interest it can be made into a package or part of HTTP.jl itself.

mind6/RPC.jl

1 Like