Getting that to work is certainly possible with LocalRegistry but is mostly a question of setting up CI jobs and authorizations. What git/CI environment are you using?
If it happens to be GitLab you can find some relevant information in
Julia and Gitlab self-hosted : a state-of-the-art? - #6 by GunnarFarneback and the rest of that thread.