# Too much time on my hands

**URL:** <https://discourse.julialang.org/t/too-much-time-on-my-hands/117816>\
**Category:** Community\
**Tags:** pkgtemplates\
**Created:** [August 4, 2024, 5:43pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816 "2024-08-04T17:43:04Z")\
**Posts on this page:** 20\
**Page:** 2

<div class="post-metadata">

**Author:** ![kevbonham](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/kevbonham/32/216165_2.png) [@kevbonham](https://discourse.julialang.org/u/kevbonham)\
**Post date:** [August 5, 2024, 12:32pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/21 "2024-08-05T12:32:29Z")

</div>

> [@TheCedarPrince](#):
>
> I would personally love something like the [targets](https://books.ropensci.org/targets/) R package within Julia for reproducible analysis pipelines.

If you’re interested in this, see also [this old thread](https://discourse.julialang.org/t/rfc-mr-phelps-a-distributed-workflow-orchestrator/32893). I’ve long had an interest in building this as well, and have made some abortive attempts here: [GitHub - kescobo/Hapi.jl: [WIP] Workflow software in julia](https://github.com/kescobo/Hapi.jl)

I even wrote a NumFocus small development grant to give me the excuse to actually spend time on it, but alas…

---

<div class="post-metadata">

**Author:** ![BenPH](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/benph/32/38619_2.png) [@BenPH](https://discourse.julialang.org/u/BenPH)\
**Post date:** [August 5, 2024, 7:38pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/22 "2024-08-05T19:38:26Z")

</div>

I made a PR for package creation through the VSCode UI a while ago [New project creation command by BenPH · Pull Request #2799 · julia-vscode/julia-vscode · GitHub](https://github.com/julia-vscode/julia-vscode/pull/2799). If anyone feels like bumping it or taking it over go right ahead!

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 10, 2024, 9:32am UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/23 "2024-08-10T09:32:10Z")

</div>

OK, that looks like a reasonable plan:

- Finish the current approach with a GUI for PkgTemplates.jl, supporting for the beginning just selected plugins, as in the current mockup. I’d estimate 30% to 50% as already has been done for that limited approach. Collect feedback (if any).
- Check if BestieTemplate.jl for the backend and/or Bonito.jl for GUI are better choices. If yes, then that would practically mean writing another package from the scratch.
- Check the possibility of integration as a VS Code plugin.

---

<div class="post-metadata">

**Author:** ![oOosys](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ooosys/32/209566_2.png) [@oOosys](https://discourse.julialang.org/u/oOosys)\
**Post date:** [August 11, 2024, 12:15am UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/24 "2024-08-11T00:15:31Z")

</div>

> [@Eben60](#):
>
> some project of general use

I suggest you leave the path of considering things from the point of view of programming in a specific language which needs to restrict your freedom of creating solutions to it. All of the computing comes down to a choice you make using some language. Why not making choices using the spoken language or phrases which remind spoken language sentences to a degree to be understood without any prior experience with “programming”? This will shift your experience to a new level from which perspective most of the detailed programming efforts start to appear useless and move it towards what really matters. Are you ready for such a shift? It would be a much better investment of time as circling in what is there making one more round.

---

<div class="post-metadata">

**Author:** ![pszufe](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/pszufe/32/23452_2.png) [@pszufe](https://discourse.julialang.org/u/pszufe)\
**Post date:** [August 17, 2024, 10:24am UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/25 "2024-08-17T10:24:37Z")

</div>

Since @TheCedarPrince mentioned me, one thing that is definitely lacking in the Julia ecosystem is a Julia equivalent of Kedro (a package ecosystem for managing replicable data pipelines).  
Note that presence of frameworks like this is needed for higher industrial adoption of the language (that in turn would attract funding to the package development).

---

<div class="post-metadata">

**Author:** ![tecosaur](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tecosaur/32/23206_2.png) [@tecosaur](https://discourse.julialang.org/u/tecosaur)\
**Post date:** [August 17, 2024, 2:40pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/26 "2024-08-17T14:40:54Z")

</div>

> [@pszufe](#):
>
> replicable data pipelines

This absolutely overlaps with what I’m going for with DataToolkit.jl, and if I could interest you in helping that would be brilliant 😀.

At the very least, it would probably be worth us talking more if you’re thinking of pursing a project along these lines.

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 17, 2024, 3:44pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/27 "2024-08-17T15:44:50Z")

</div>

As replicable data pipelines, DataToolkit and all that is not something I can really help with, I’d suggest to continue that line of discussion (if there is a need to) in a separate topic.

---

<div class="post-metadata">

**Author:** ![oscarvdvelde](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/oscarvdvelde/32/202157_2.png) [@oscarvdvelde](https://discourse.julialang.org/u/oscarvdvelde)\
**Post date:** [August 17, 2024, 4:00pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/28 "2024-08-17T16:00:55Z")

</div>

[CSV.jl](https://github.com/JuliaData/CSV.jl/issues) has not seen much action for a year. I imagine a large part of the community is using it. I posted a bug recently about something breaking in Julia 1.11-rc, but has not received any response.

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 17, 2024, 4:59pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/29 "2024-08-17T16:59:17Z")

</div>

To be honest, I’m afraid writing PRs for a large and not well maintained project is a recipe for frustration, and despite having too much time on my hands, frustration is not what I’m looking for. Sorry for being that egoistic. Becoming a maintainer myself, on the other side, is beyond my qualification.

Specifically CSV.jl has e.g. a documentation (!) PR from Oct 22, 2022, waiting for a review.

---

<div class="post-metadata">

**Author:** ![nhz2](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/nhz2/32/44428_2.png) [@nhz2](https://discourse.julialang.org/u/nhz2)\
**Post date:** [August 18, 2024, 8:36pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/30 "2024-08-18T20:36:44Z")

</div>

Julia 1.11 still has some major issues due to the addition of `Memory` so I’m not sure if it is worth fixing CSV.jl until Julia itself is working correctly. For example I am waiting on a fix for [`String(v::Memory{UInt8})` doesn't make a copy · Issue #54369 · JuliaLang/julia · GitHub](https://github.com/JuliaLang/julia/issues/54369) to be able to fix my package ZipArchives.jl for Julia 1.11.

---

<div class="post-metadata">

**Author:** ![pszufe](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/pszufe/32/23452_2.png) [@pszufe](https://discourse.julialang.org/u/pszufe)\
**Post date:** [August 19, 2024, 5:48pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/31 "2024-08-19T17:48:04Z")

</div>

@tecosaur while this package is very useful, I feel it only addresses some standardization of providing a dataset along with preprocessing rules. I believe this is very useful for reproducible academic research projects.  
However, this does not address needs of an enterprise that requires running and controlling some daily or weekly replicable data pipelines (this includes data ingestion, ETL, running, updating and storing arbitrary ML models etc.). I believe such feature is not present in the ecosystem. But this of course falls under on a broader topic on how to gain Julia adoption among the enterprise users which would allow to maintain Julia in the long run.

---

<div class="post-metadata">

**Author:** ![tecosaur](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tecosaur/32/23206_2.png) [@tecosaur](https://discourse.julialang.org/u/tecosaur)\
**Post date:** [August 19, 2024, 7:18pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/32 "2024-08-19T19:18:43Z")

</div>

> [@pszufe](#):
>
> @tecosaur while this package is very useful, I feel it only addresses some standardization of providing a dataset along with preprocessing rules. I believe this is very useful for reproducible academic research projects.

Right, glad the focus of the project comes across – it is that 🙂

However, I think there’s also a fair bit of overlap between a project built for bespoke single-use reproducible analysis (DataToolkit) and something for reusable pipelines (Kedro, Snakemake, Cromwell, NextFlow).

If this is a conversation you’d be interested in having, I’d be happy to find a bit of time.

---

<div class="post-metadata">

**Author:** ![Jake](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/jake/32/46007_2.png) [@Jake](https://discourse.julialang.org/u/Jake)\
**Post date:** [August 19, 2024, 9:53pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/33 "2024-08-19T21:53:15Z")

</div>

I have very little knowledge of GUI’s but thought [MouseTrap](https://github.com/Clemapfel/Mousetrap.jl) and [MousetrapMakie](https://github.com/Clemapfel/MousetrapMakie.jl) to be interesting. I think the author went on leave for some health issues, and there were some things not working so I never followed up.

For something totally different, there are some nice cost effective [ADC boards](https://mccdaq.github.io/daqhats/overview.html) for the Raspberry Pi. I have [wrapped the MCC172 in Julia](https://github.com/Spectrum-Tec/MccDaqHats.jl) and used Clang to start the other boards, but they need to be finished. If this type of hardware interface is up your ally this would be a nice addition.

---

<div class="post-metadata">

**Author:** ![era127](https://avatars.discourse-cdn.com/v4/letter/e/eb8c5e/32.png) [@era127](https://discourse.julialang.org/u/era127)\
**Post date:** [August 19, 2024, 11:40pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/34 "2024-08-19T23:40:28Z")

</div>

Maybe support for developing Julia packages in the new Positron ide as discussed [here](https://github.com/posit-dev/positron/issues/3679).

---

<div class="post-metadata">

**Author:** ![kevbonham](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/kevbonham/32/216165_2.png) [@kevbonham](https://discourse.julialang.org/u/kevbonham)\
**Post date:** [August 21, 2024, 1:37am UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/35 "2024-08-21T01:37:55Z")

</div>

> [@tecosaur](#):
>
> I think there’s also a fair bit of overlap between a project built for bespoke single-use reproducible analysis (DataToolkit) and something for reusable pipelines (Kedro, Snakemake, Cromwell, NextFlow).

Yes and no. I remember @oxinabox talking about tweaking DataDepsGenerators to make it kinda snakemake-like, and you could certainly abuse the machinery of DataToolkit’s processing specifications to perform reproducible analysis, but I think the semantics are very different.

The point of DataToolkit in the end is to reproducibly **have** the same thing. The point of workflow managers is to reproducibly **do** the same thing on **different** data.

---

<div class="post-metadata">

**Author:** ![hz-xiaxz](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/hz-xiaxz/32/209585_2.png) [@hz-xiaxz](https://discourse.julialang.org/u/hz-xiaxz)\
**Post date:** [August 21, 2024, 4:48pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/36 "2024-08-21T16:48:11Z")

</div>

As you are experienced in JS developing, will it be a suitable project to write a vscode-extension to view `.jld2` type file? `.jld2` file is a binary file native in Julia [JLD2](https://github.com/JuliaIO/JLD2.jl)

FYI, here are some dicussions on it

> [@Jld2 preview in vscode?](https://discourse.julialang.org/t/jld2-preview-in-vscode/80050):
>
> I use JLD2.jl to store simulation results which I find pretty convenient. I wonder if there is a plan to add a preview/explorer feature for this type of file in vscode. Json files are nicer for a having a quick look on their content but, AFAIU, this format is not really suitable to store large numerical results (like large arrays of floats). Any thought ?

> <https://github.com/julia-vscode/julia-vscode/issues/2863>
>
> I use JLD2.jl to store simulation results which I find pretty convenient.
> 
> I w…onder if there is a plan to add a preview/explorer feature for this type of file in vscode.

---

<div class="post-metadata">

**Author:** ![mkitti](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mkitti/32/12459_2.png) [@mkitti](https://discourse.julialang.org/u/mkitti)\
**Post date:** [August 21, 2024, 4:56pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/37 "2024-08-21T16:56:35Z")

</div>

Note that you can use h5wasm to view JLD2 files in VSCode:

> **[H5Web - Visual Studio Marketplace](https://marketplace.visualstudio.com/items?itemName=h5web.vscode-h5web)**
>
> Extension for Visual Studio Code - Visualize HDF5 files in VS Code

> **[H5Web](https://h5web.panosc.eu/)**
>
> Web-based HDF5 file viewer.

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 21, 2024, 5:23pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/38 "2024-08-21T17:23:18Z")

</div>

Just installed H5Web, took a JLD2 file, containing just one object, renamed it to give it a suffix `.hdf5` - and got an error from H5Web. Or 17 errors, I’m not sure. The object was a `Dict{Symbol, CustomStruct}`.

On a very simple JLD2 file, containing just one small 1D array, the viewer worked OK.

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 21, 2024, 5:28pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/39 "2024-08-21T17:28:48Z")

</div>

> [@Eben60](#):
>
> **Not completely forgotten** are Python and JS/JQuery/CSS/HTML.

> [@hz-xiaxz](#):
>
> As you are **experienced** in JS developing,

😁 Thank you, should I look for an IT job, I’d use that phrasing 😁

---

<div class="post-metadata">

**Author:** ![Eben60](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/eben60/32/13475_2.png) [@Eben60](https://discourse.julialang.org/u/Eben60)\
**Post date:** [August 21, 2024, 5:33pm UTC](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816/40 "2024-08-21T17:33:04Z")

</div>

> [@Jake](#):
>
> I have [wrapped the MCC172 in Julia](https://github.com/Spectrum-Tec/MccDaqHats.jl) and used Clang to start the other boards, but they need to be finished.

Well, I was thinking about buying me a soldering station and a scope some day, and learning Arduino, RaspberryPi & Co. Will have to ask my wife 😉

[Previous page](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816.md?page=1)

[Next page](https://discourse.julialang.org/t/too-much-time-on-my-hands/117816.md?page=3)