The long-term best solution is for someone to update the build script in Yggdrasil to build a newer version of OpenSSL_jll. That someone could be you!
And then preferably for Julia to ship with it by default.
A solution that CondaPkg could offer is to add a setting to override this behaviour. I’ve been meaning to add various overrides for a while.