It sounds like you’re asking for compatibility fuzz testing. I don’t know of a CI script for that but it sounds reasonable. However, I’d suggest using a form of Downgrade CI to more directly do this rather than random sampling, see:
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| PSA: Add Downgrade CI to Better Check Version Compatibility | 35 | 2408 | March 14, 2024 | |
| Why do packages run continuous integration tests on Julia nightly? | 48 | 1811 | July 12, 2023 | |
| About checking a package/library `Manifest.toml` into control version (again) | 22 | 566 | May 13, 2025 | |
| Please be mindful of version bounds and semantic versioning when tagging your packages | 143 | 8163 | November 18, 2019 | |
| Package manager: what are "explicit requirements"? | 24 | 3509 | April 25, 2019 |