CategoricalArrays forces OpenSpecFun_jll recompilation

Yes, because the only non-erroring conversion to nothing is the one in Base, so :sweat_smile: many times these invalidation fixes are just improvements.