GitHub - ashwani-rathee/Miner.jl: Voxel World Simulator written with Makie in Julia is a basic Minecraft-esque game made with GLMakie - not sure if something like this is what you’re looking for!
Generally, only the positions and textures of objects would be passed to the graphical backend, and it would be annoying to synchronize per-frame computations for example.