# \#testing

**URL:** https://discourse.julialang.org/tag/testing/8.md

[Latest](https://discourse.julialang.org/latest.md) · [Categories](https://discourse.julialang.org/categories.md) · [Tags](https://discourse.julialang.org/tags.md)

---

## [A REPL mode for ReTest.jl](https://discourse.julialang.org/t/a-repl-mode-for-retest-jl/139446)

<div class="topic-metadata">

**Author:** [@JamesNZ](https://discourse.julialang.org/u/JamesNZ)\
**Replies:** 0\
**Last updated:** [September 13, 2026, 5:21pm UTC](https://discourse.julialang.org/t/a-repl-mode-for-retest-jl/139446 "2026-09-13T17:21:20Z")

</div>

I’ve wanted a REPL mode for running tests for a while now to get a more pytest-like experience with Julia, so over the weekend I added one to ReTest.jl: ReTest.jl · ReTest.jl Example usage from the docs where Julia is s…

---

## [Skipping precompilation in VSCode test item framework](https://discourse.julialang.org/t/skipping-precompilation-in-vscode-test-item-framework/132147)

<div class="topic-metadata">

**Author:** [@franckgaga](https://discourse.julialang.org/u/franckgaga)\
**Replies:** 3\
**Last updated:** [August 10, 2026, 3:01pm UTC](https://discourse.julialang.org/t/skipping-precompilation-in-vscode-test-item-framework/132147 "2026-08-10T15:01:35Z")

</div>

My current workflow is having a project environnement in which I dev the package that I currently develop, ModelPredictiveControl.jl, and I include additional dependencies for the development. I also use the test item fr…

---

## [Does it make sense to define compat bounds in the test/Project.toml?](https://discourse.julialang.org/t/does-it-make-sense-to-define-compat-bounds-in-the-test-project-toml/138466)

<div class="topic-metadata">

**Author:** [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Replies:** 11\
**Last updated:** [July 30, 2026, 10:36am UTC](https://discourse.julialang.org/t/does-it-make-sense-to-define-compat-bounds-in-the-test-project-toml/138466 "2026-07-30T10:36:09Z")

</div>

The question is in the title

---

## [Running a single test script](https://discourse.julialang.org/t/running-a-single-test-script/136623)

<div class="topic-metadata">

**Author:** [@ufechner7](https://discourse.julialang.org/u/ufechner7)\
**Replies:** 7\
**Last updated:** [April 8, 2026, 5:39pm UTC](https://discourse.julialang.org/t/running-a-single-test-script/136623 "2026-04-08T17:39:15Z")

</div>

I want to be able to run a single test just by including it. For example, imagine the following test file: using Test, BenchmarkTools @test 1+1 == 2 If I include it directly, it fails: include("test/test\_example.jl" …

---

## [Test data as Artifact](https://discourse.julialang.org/t/test-data-as-artifact/136239)

<div class="topic-metadata">

**Author:** [@yakir12](https://discourse.julialang.org/u/yakir12)\
**Replies:** 11\
**Last updated:** [April 7, 2026, 7:02pm UTC](https://discourse.julialang.org/t/test-data-as-artifact/136239 "2026-04-07T19:02:46Z")

</div>

My package’s tests require ~20 MB of data. Currently, this data is regenerated on every test run. I’d like to generate it once (e.g., per release) and fetch it at test time instead. The Julia Artifacts framework seems l…

---

## [Testing for warnings emitted at macro expansion time](https://discourse.julialang.org/t/testing-for-warnings-emitted-at-macro-expansion-time/136091)

<div class="topic-metadata">

**Author:** [@impact-basin](https://discourse.julialang.org/u/impact-basin)\
**Replies:** 2\
**Last updated:** [March 8, 2026, 9:07pm UTC](https://discourse.julialang.org/t/testing-for-warnings-emitted-at-macro-expansion-time/136091 "2026-03-08T21:07:56Z")

</div>

Hi all, I’m working on some macros for PikaParser.jl grammars (very WIP!), and I had a question regarding their testing. One thing I’m trying to do is build the grammar at macro-time; this allows us to return a lambda …

---

## [Best practices for testing numerical results that are unstable across package versions](https://discourse.julialang.org/t/best-practices-for-testing-numerical-results-that-are-unstable-across-package-versions/135847)

<div class="topic-metadata">

**Author:** [@jakobjpeters](https://discourse.julialang.org/u/jakobjpeters)\
**Replies:** 30\
**Last updated:** [March 2, 2026, 12:37pm UTC](https://discourse.julialang.org/t/best-practices-for-testing-numerical-results-that-are-unstable-across-package-versions/135847 "2026-03-02T12:37:47Z")

</div>

My team is using OrdinaryDiffEq.jl and several other numerical packages, where we are testing a variety of solver results to be within some tolerance. On multiple occasions, some of these tests have begun to fail after u…

---

## [How to test multiple dependency version ranges (\< v"1" and ≥ v"1") in GitHub CI?](https://discourse.julialang.org/t/how-to-test-multiple-dependency-version-ranges-v-1-and-v-1-in-github-ci/135857)

<div class="topic-metadata">

**Author:** [@singularitti](https://discourse.julialang.org/u/singularitti)\
**Replies:** 2\
**Last updated:** [February 26, 2026, 9:46pm UTC](https://discourse.julialang.org/t/how-to-test-multiple-dependency-version-ranges-v-1-and-v-1-in-github-ci/135857 "2026-02-26T21:46:28Z")

</div>

I maintain a Julia package that supports multiple major versions of one of its dependencies. The dependency defines: get\_version()::VersionNumber and my tests contain logic like: if get\_version() \>= v"1" # test ne…

---

## [Test package with dev-ed dependency](https://discourse.julialang.org/t/test-package-with-dev-ed-dependency/135740)

<div class="topic-metadata">

**Author:** [@nsajko](https://discourse.julialang.org/u/nsajko)\
**Replies:** 1\
**Last updated:** [February 20, 2026, 12:54am UTC](https://discourse.julialang.org/t/test-package-with-dev-ed-dependency/135740 "2026-02-20T00:54:50Z")

</div>

Package P depends on package D. I want to run the test suite of package P with a specific version of package D in the manifest. To be specific, I have D dev-ed, I want the dev-ed variant to be loaded for the test suite. …

---

## [\[ANN\] GenieTest.jl](https://discourse.julialang.org/t/ann-genietest-jl/135350)

<div class="topic-metadata">

**Author:** [@hhaensel](https://discourse.julialang.org/u/hhaensel)\
**Replies:** 0\
**Last updated:** [January 30, 2026, 3:53pm UTC](https://discourse.julialang.org/t/ann-genietest-jl/135350 "2026-01-30T15:53:54Z")

</div>

Happy to announce GenieTest.jl for testing, debugging and development of GenieFramework Apps GenieTest A Julia package for testing Stipple/Genie applications with integrated frontend support. Overview GenieTest provide…

---

## [Unit testing iterators](https://discourse.julialang.org/t/unit-testing-iterators/135078)

<div class="topic-metadata">

**Author:** [@Tamas\_Papp](https://discourse.julialang.org/u/Tamas_Papp)\
**Replies:** 0\
**Last updated:** [January 15, 2026, 1:49pm UTC](https://discourse.julialang.org/t/unit-testing-iterators/135078 "2026-01-15T13:49:12Z")

</div>

Is there a package to test that a type implements the iteration interface correctly? Just some basic sanity checks, eg if get the size/eltype traits, check that they are consistent, compare repeatedly calling iterate un…

---

## [Test item runner doesn't work in vscode](https://discourse.julialang.org/t/test-item-runner-doesnt-work-in-vscode/134970)

<div class="topic-metadata">

**Author:** [@brianguenter](https://discourse.julialang.org/u/brianguenter)\
**Replies:** 1\
**Last updated:** [January 10, 2026, 3:41am UTC](https://discourse.julialang.org/t/test-item-runner-doesnt-work-in-vscode/134970 "2026-01-10T03:41:43Z")

</div>

I recently switched one of my projects to use the new Workspace organization with the main project and test as separate projects in the workspace. Now I get an error when I try to run the tests using the test item runner…

---

## [SomePackage/test\> test](https://discourse.julialang.org/t/somepackage-test-test/134839)

<div class="topic-metadata">

**Author:** [@Tamas\_Papp](https://discourse.julialang.org/u/Tamas_Papp)\
**Replies:** 1\
**Last updated:** [January 2, 2026, 10:26am UTC](https://discourse.julialang.org/t/somepackage-test-test/134839 "2026-01-02T10:26:19Z")

</div>

Suppose I am using Julia 1.12, have \[workspace\] projects = \["test"\] in my Project.toml, and currently the test is my active project. Is there a one-linear solution for running the tests from the REPL, equivalent to S…

---

## [Prevent Pkg.test from executing parent's \`@main\` function](https://discourse.julialang.org/t/prevent-pkg-test-from-executing-parents-main-function/134617)

<div class="topic-metadata">

**Author:** [@alametti](https://discourse.julialang.org/u/alametti)\
**Replies:** 3\
**Last updated:** [December 17, 2025, 7:28pm UTC](https://discourse.julialang.org/t/prevent-pkg-test-from-executing-parents-main-function/134617 "2025-12-17T19:28:06Z")

</div>

When I test a local package using the test instruction in the Pkg REPL, the function called by the @main macro gets executed after the tests. For example: src/Foo.jl: module Foo main() = println("hello from main func…

---

## [A curated list of GH actions that improve the quality of your package](https://discourse.julialang.org/t/a-curated-list-of-gh-actions-that-improve-the-quality-of-your-package/134466)

<div class="topic-metadata">

**Author:** [@yakir12](https://discourse.julialang.org/u/yakir12)\
**Replies:** 10\
**Last updated:** [December 10, 2025, 8:43pm UTC](https://discourse.julialang.org/t/a-curated-list-of-gh-actions-that-improve-the-quality-of-your-package/134466 "2025-12-10T20:43:52Z")

</div>

I recently looked at the new SolarPosition.jl package and was impressed by the GH Actions that helped improve its quality. This got me wondering if there’s a maintained, opinionated, and complete list of quality-improvem…

---

## [Testing and tolerances for implicitly calculated functions and their AD](https://discourse.julialang.org/t/testing-and-tolerances-for-implicitly-calculated-functions-and-their-ad/133575)

<div class="topic-metadata">

**Author:** [@Tamas\_Papp](https://discourse.julialang.org/u/Tamas_Papp)\
**Replies:** 3\
**Last updated:** [December 2, 2025, 12:49pm UTC](https://discourse.julialang.org/t/testing-and-tolerances-for-implicitly-calculated-functions-and-their-ad/133575 "2025-12-02T12:49:17Z")

</div>

To fix ideas, suppose we have a function x = g(p) defined by f(x(p), p) = 0, both arguments are scalars. The numerical implementation involves finding an x such that | f(x, p)| \\le \\mathrm{tol}, either by Newton’s metho…

---

## [Mock.jl - mocking any function without annotations](https://discourse.julialang.org/t/mock-jl-mocking-any-function-without-annotations/133918)

<div class="topic-metadata">

**Author:** [@tz-lom](https://discourse.julialang.org/u/tz-lom)\
**Replies:** 4\
**Last updated:** [November 29, 2025, 1:43am UTC](https://discourse.julialang.org/t/mock-jl-mocking-any-function-without-annotations/133918 "2025-11-29T01:43:49Z")

</div>

I could not find a package that would allow to temporary override function implementation, so I’ve made one: Mock.jl. I’ve checked other packages before, here what I could find: Closest to the concept would be Pretend.…

---

## [CI Testing hangs on MacOS nightly](https://discourse.julialang.org/t/ci-testing-hangs-on-macos-nightly/133909)

<div class="topic-metadata">

**Author:** [@TimG](https://discourse.julialang.org/u/TimG)\
**Replies:** 5\
**Last updated:** [November 21, 2025, 10:25pm UTC](https://discourse.julialang.org/t/ci-testing-hangs-on-macos-nightly/133909 "2025-11-21T22:25:19Z")

</div>

How can I get any diagnostic information on why this one CI test seems to be hanging while all the others pass as expected? in progress checks CI / Julia nightly - macOS-latest - default - pull\_request (pull\_request)Sta…

---

## [Test deps with workspaces](https://discourse.julialang.org/t/test-deps-with-workspaces/133591)

<div class="topic-metadata">

**Author:** [@gdalle](https://discourse.julialang.org/u/gdalle)\
**Replies:** 2\
**Last updated:** [November 1, 2025, 3:10pm UTC](https://discourse.julialang.org/t/test-deps-with-workspaces/133591 "2025-11-01T15:10:29Z")

</div>

I have a few questions on the new workflow for test dependencies, which should be enabled in 1.12 thanks to the \[workspace\] section: Does the parent package have to be listed in test/Project.toml now? It didn’t have to…

---

## [Usability improvements in TestItemRunner.@testmodule](https://discourse.julialang.org/t/usability-improvements-in-testitemrunner-testmodule/132513)

<div class="topic-metadata">

**Author:** [@Ken\_Williams](https://discourse.julialang.org/u/Ken_Williams)\
**Replies:** 2\
**Last updated:** [October 9, 2025, 9:53pm UTC](https://discourse.julialang.org/t/usability-improvements-in-testitemrunner-testmodule/132513 "2025-10-09T21:53:29Z")

</div>

There are a couple of usability improvements I’d love to see in the @testmodule functionality from TestItemRunner: The ability to load a testing module from the REPL, so I could do something like TestEnv.activate() lo…

---

## [Test.jl seems to have problems catching ArgParse.jl's exceptions](https://discourse.julialang.org/t/test-jl-seems-to-have-problems-catching-argparse-jls-exceptions/131795)

<div class="topic-metadata">

**Author:** [@pkalaczynski](https://discourse.julialang.org/u/pkalaczynski)\
**Replies:** 6\
**Last updated:** [September 4, 2025, 3:35pm UTC](https://discourse.julialang.org/t/test-jl-seems-to-have-problems-catching-argparse-jls-exceptions/131795 "2025-09-04T15:35:36Z")

</div>

Hi, I’ve been implementing unit tests for my project, and generally I’m very happy with Test.jl, however I stumbled across a weird problem when trying to do tests for argument parsing. I handle it using ArgParse.jl and …

---

## [Error using TestItems in VSCode](https://discourse.julialang.org/t/error-using-testitems-in-vscode/120699)

<div class="topic-metadata">

**Author:** [@brianguenter](https://discourse.julialang.org/u/brianguenter)\
**Replies:** 21\
**Last updated:** [August 18, 2025, 9:41pm UTC](https://discourse.julialang.org/t/error-using-testitems-in-vscode/120699 "2025-08-18T21:41:47Z")

</div>

I get this error when I try to run tests using the TestItems framework in VSCode: An error occurred attempting to run tests: Error: Pending response rejected since connection got disposed The test runs fine from the VS…

---

## [Testing User Input in GitHub CI/Test Suites?](https://discourse.julialang.org/t/testing-user-input-in-github-ci-test-suites/130210)

<div class="topic-metadata">

**Author:** [@TheCedarPrince](https://discourse.julialang.org/u/TheCedarPrince)\
**Replies:** 8\
**Last updated:** [June 28, 2025, 5:13pm UTC](https://discourse.julialang.org/t/testing-user-input-in-github-ci-test-suites/130210 "2025-06-28T17:13:47Z")

</div>

Hi folks! How do you test user input for readline() in GitHub CI or your local test suite? I have a snippet of code that asks for user input in my package and am trying to test the input – kinda like this: function fin…

---

## [VS Code: clickable paths for unit test failures](https://discourse.julialang.org/t/vs-code-clickable-paths-for-unit-test-failures/130000)

<div class="topic-metadata">

**Author:** [@Ken\_Williams](https://discourse.julialang.org/u/Ken_Williams)\
**Replies:** 0\
**Last updated:** [June 18, 2025, 6:32pm UTC](https://discourse.julialang.org/t/vs-code-clickable-paths-for-unit-test-failures/130000 "2025-06-18T18:32:31Z")

</div>

In VS Code, having clickable and color-highlighted paths for stack traces is incredibly helpful in the REPL and some other contexts - but unfortunately for unit test failures (when running from the Testing pane), the err…

---

## [Navigation between tests & src/](https://discourse.julialang.org/t/navigation-between-tests-src/129390)

<div class="topic-metadata">

**Author:** [@Ken\_Williams](https://discourse.julialang.org/u/Ken_Williams)\
**Replies:** 14\
**Last updated:** [June 4, 2025, 3:50pm UTC](https://discourse.julialang.org/t/navigation-between-tests-src/129390 "2025-06-04T15:50:57Z")

</div>

This is a pretty minor thing, but I figured I’d ask about it anyway. In VS Code, when working on code in a package, I can command-click on a function call and be taken to its definition (although if there are multiple m…

---

## [Surprising test timings](https://discourse.julialang.org/t/surprising-test-timings/129437)

<div class="topic-metadata">

**Author:** [@TimG](https://discourse.julialang.org/u/TimG)\
**Replies:** 4\
**Last updated:** [June 1, 2025, 7:06am UTC](https://discourse.julialang.org/t/surprising-test-timings/129437 "2025-06-01T07:06:31Z")

</div>

When I run tests on a package I’ve been working on, the output shows (for a subset of tests): Test Summary: | Pass Total Time Styles | 775 775 49.0s Test Summary: | Pass Total Time Conditional For…

---

## [\[ANN\] TestPicker - Interactive tool for testing based on fzf and bat](https://discourse.julialang.org/t/ann-testpicker-interactive-tool-for-testing-based-on-fzf-and-bat/128273)

<div class="topic-metadata">

**Author:** [@theogf](https://discourse.julialang.org/u/theogf)\
**Replies:** 7\
**Last updated:** [May 14, 2025, 8:31am UTC](https://discourse.julialang.org/t/ann-testpicker-interactive-tool-for-testing-based-on-fzf-and-bat/128273 "2025-05-14T08:31:20Z")

</div>

We all know testing does not necessarily has the best support in Julia. And if there are great frameworks like ReTest.jl or TestItemRunner.jl to mention these only, they still rely on replacing the traditional Test.jl fr…

---

## [Simulating keystrokes to external program](https://discourse.julialang.org/t/simulating-keystrokes-to-external-program/128229)

<div class="topic-metadata">

**Author:** [@theogf](https://discourse.julialang.org/u/theogf)\
**Replies:** 3\
**Last updated:** [May 4, 2025, 12:08pm UTC](https://discourse.julialang.org/t/simulating-keystrokes-to-external-program/128229 "2025-05-04T12:08:39Z")

</div>

Hi! I have a package that makes a heavy use of fzf. I would like to test things more thoroughly but this requires interactive actions on fzf itself. I am aware of GitHub - Keno/VT100.jl: Terminal Emulation for terminal…

---

## [How to add additional dependencies to filtered test items?](https://discourse.julialang.org/t/how-to-add-additional-dependencies-to-filtered-test-items/125656)

<div class="topic-metadata">

**Author:** [@doit](https://discourse.julialang.org/u/doit)\
**Replies:** 3\
**Last updated:** [May 4, 2025, 12:06pm UTC](https://discourse.julialang.org/t/how-to-add-additional-dependencies-to-filtered-test-items/125656 "2025-05-04T12:06:49Z")

</div>

Hi, does anyone know if it is possible to add additional package dependencies to @testitems which are usually not executed due to filters in a @run\_package\_tests? To clarify: I do not want to burden users with too man…

---

## [Problem with running tests in VSCode under Ubuntu (any packages)](https://discourse.julialang.org/t/problem-with-running-tests-in-vscode-under-ubuntu-any-packages/128642)

<div class="topic-metadata">

**Author:** [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Replies:** 1\
**Last updated:** [May 2, 2025, 10:25pm UTC](https://discourse.julialang.org/t/problem-with-running-tests-in-vscode-under-ubuntu-any-packages/128642 "2025-05-02T22:25:48Z")

</div>

For example: (@v1.11) pkg\> test Revise Testing Revise ... Testing Running tests... ERROR: julia: -t,--threads=\<n\>\[,auto|\<m\>\]; n must be an integer \>= 1 ERROR: Package Revise errored during testing The same er…

[Next page](https://discourse.julialang.org/tag/testing/8.md?match_all_tags=true&page=1&tags%5B%5D=testing)