I have been reading a fair amount (a few references at end of post) about how to “correctly”, or better yet idiomatically, structure code in Julia. In general, there seems to be a strong sentiment that many submodules probably means the code could be better split into several packages. My question …

[image] erans: how to “correctly”, or better yet idiomatically, structure code in Julia You may not need to worry about this unless your codebase is relatively large. Up to 5–10 kLOC (and that’s a lot of code in Julia), a single module/package often works fine. [image] erans: wouldn’t br…

[image] erans: If I now make a change to B.jl wouldn’t only MyPkg and B need to be recompiled, while the already precompiled A can be used as is? I’m not 100% sure, but I don’t think so. As far as I understand, the precompilation unit is the “package”, so if anything changes within the packa…

Submodules → Several Packages [image] erans: In general, there seems to be a strong sentiment that many submodules probably means the code could be better split into several packages. I think you are correct in that the message being sent out in the community does sound the way you summarized…

[image] erans: wouldn’t breaking code into submodules help in terms of precompilation? (assuming that most of the submodules are not constantly updated). As @jebej mentionned, I’m pretty certain the precompilation unit is the “package”, not the “module”. That being said, from a practical sta…

Oh, and I realize that my suggestion of splitting out code that won’t be used by any other project/package/application goes directly against the post I wrote immediately above it. In this case however, you have a practical reason to do this (reduce development time), despite it being unnecessary fr…

[image] MA_Laforge: As @jebej mentionned, I’m pretty certain the precompilation unit is the “package”, not the “module”. Looking at the contents of ~/.julia/compiled/v1.5 the results are apparently stored per module. And a package as far as I can see is nothing more than a module structured i…

You are not using submodules here, you are just creating two individual “packages”, though because you are pushing to LOAD_PATH these things are less clear. A submodule must be defined within the scope of a parent module, like in the example here copied below, or by including the file containing th…

[image] jebej: You are not using submodules here, you are just creating two individual “packages”, though because you are pushing to LOAD_PATH these things are less clear. Doh! And it even works the same in Python, so silly of me not to realize that. I’ll ammend the comment above.

Thanks everyone for the input. This has cleared several things up for me. From looking at the results in the ~/.julia/compiled/v1.5/ folder I can see that indeed submodules are not precompiled separately. @paulmelis thank you very much for taking the time and effort to run that test. I believe @jeb…

[image] erans: I believe @jebej is correct though, that the issue is that you are using LOAD_PATH (btw, avoiding load path is the primary reason why I’ve fallen into this rabbit hole) Yep, see my updated comment above

Single module vs. submodules in a project

New to Julia

MA_Laforge February 16, 2021, 11:59pm 17

If that’s the case, I suggest you take a look at my post here (and those it links to):

Topic		Replies	Views
Proper way of organizing code into subpackages New to Julia packages , code-organization	48	8400	August 24, 2022
Best way to structure Julia code General Usage question	17	4695	July 31, 2019
Advice on structuring larger codebases General Usage code-organization	19	2043	March 19, 2020
Code organization to use precompilation with a tiny example New to Julia code-organization	0	441	August 5, 2021
Multiple Julia processes while using Modules General Usage modules , code-organization	6	830	October 26, 2024

Single module vs. submodules in a project

Related topics