The fact that Julia CI is so flakey is a big problem that we need to work on. And, if you are willing, you can help!
- Find a test that has recently failed in master (click on the red x’s on this page for details of test failures on master)
- Search existing issues for one that tracks that test failure
- If there isn’t already an issue filed, file one, linking to a test failure or two
- Open a PR to skip the flakey test, and link to the issue you opened in that PR. (Feel free to @ me in this PR)
Failing tests on CI on master typically represent Julia bugs, but we try to track julia bugs in the issue tracker, not with failing CI. Shifting flaky tests to issues helps streamline reviewing all unrelated PRs.
If you have a PR with an unrelated test failure and can find that same failure on a recent commit to master, then you can skip straight to step 2.