# \#data

**URL:** https://discourse.julialang.org/tag/data/99.md

[Latest](https://discourse.julialang.org/latest.md) · [Categories](https://discourse.julialang.org/categories.md) · [Tags](https://discourse.julialang.org/tags.md)

---

## [\[ANN\] AgriDatasets.jl: Open agricultural datasets for Julia](https://discourse.julialang.org/t/ann-agridatasets-jl-open-agricultural-datasets-for-julia/139694)

<div class="topic-metadata">

**Author:** [@renzocaceresrossi](https://discourse.julialang.org/u/renzocaceresrossi)\
**Replies:** 3\
**Last updated:** [September 27, 2026, 10:31pm UTC](https://discourse.julialang.org/t/ann-agridatasets-jl-open-agricultural-datasets-for-julia/139694 "2026-09-27T22:31:36Z")

</div>

AgriDatasets.jl We are excited to announce the official release of AgriDatasets.jl, a Julia package providing easy access to open agricultural datasets for data analysis, research, and machine learning. Features Easy…

---

## [Parsequoted=true in JSON.jl](https://discourse.julialang.org/t/parsequoted-true-in-json-jl/139486)

<div class="topic-metadata">

**Author:** [@freeman](https://discourse.julialang.org/u/freeman)\
**Replies:** 4\
**Last updated:** [September 17, 2026, 2:22pm UTC](https://discourse.julialang.org/t/parsequoted-true-in-json-jl/139486 "2026-09-17T14:22:13Z")

</div>

JSON3 had the ability to automatically handle quoted numbers. For example import JSON3 struct MyType x::Float64 end s = "{\\"x\\":\\"4.0\\"}" # note quoted "4.0" JSON3.read(s, MyType; parsequoted=true) # MyType(4.0…

---

## [\[ANN\] DataToolkit.jl — Reproducible, flexible, and convenient data management](https://discourse.julialang.org/t/ann-datatoolkit-jl-reproducible-flexible-and-convenient-data-management/104757)

<div class="topic-metadata">

**Author:** [@tecosaur](https://discourse.julialang.org/u/tecosaur)\
**Replies:** 28\
**Last updated:** [July 21, 2026, 4:46pm UTC](https://discourse.julialang.org/t/ann-datatoolkit-jl-reproducible-flexible-and-convenient-data-management/104757 "2026-07-21T16:46:27Z")

</div>

Reproducible, flexible, and convenient data management DataToolkit.jl is part of a trio of packages that aim to provide an exceptionally convenient and extensible approach to data management. Compared to pipelines (e.…

---

## [\[ANN\] 🚀 Announcing Browzarr.jl](https://discourse.julialang.org/t/ann-announcing-browzarr-jl/137535)

<div class="topic-metadata">

**Author:** [@lazarusA](https://discourse.julialang.org/u/lazarusA)\
**Replies:** 3\
**Last updated:** [June 19, 2026, 4:09pm UTC](https://discourse.julialang.org/t/ann-announcing-browzarr-jl/137535 "2026-06-19T16:09:10Z")

</div>

Hey there, it’s been a while! Today, I want to draw your attention to Browzarr.jl, the Julia bridge for launching Browzarr, a browser-based visualization framework for exploring and analyzing Zarr and NetCDF datasets. T…

---

## [\[ANN\] Colorfy.jl](https://discourse.julialang.org/t/ann-colorfy-jl/137605)

<div class="topic-metadata">

**Author:** [@juliohm](https://discourse.julialang.org/u/juliohm)\
**Replies:** 0\
**Last updated:** [June 13, 2026, 8:08pm UTC](https://discourse.julialang.org/t/ann-colorfy-jl/137605 "2026-06-13T20:08:47Z")

</div>

Colorfy.jl is a tiny utility to convert any vector of Julia objects into Colors.jl colors: julia\> using Colorfy julia\> values = \[:red, :green, :blue\]; julia\> colorfy(values, alpha=\[0.5, 0.6, 0.7\]) 3-element Vector{RGB…

---

## [\[ANN\] DataSplits.jl - data splitting for model selection](https://discourse.julialang.org/t/ann-datasplits-jl-data-splitting-for-model-selection/137274)

<div class="topic-metadata">

**Author:** [@davide.crucitti](https://discourse.julialang.org/u/davide.crucitti)\
**Replies:** 0\
**Last updated:** [May 25, 2026, 10:46am UTC](https://discourse.julialang.org/t/ann-datasplits-jl-data-splitting-for-model-selection/137274 "2026-05-25T10:46:06Z")

</div>

Hi all, I’m pleased to announce DataSplits.jl , a new package for constructing train/test splits and cross-validation folds for model selection. The motivation is simple: when benchmarking models, the split is often as…

---

## [Common data utilities for time series](https://discourse.julialang.org/t/common-data-utilities-for-time-series/137104)

<div class="topic-metadata">

**Author:** [@langestefan](https://discourse.julialang.org/u/langestefan)\
**Replies:** 15\
**Last updated:** [May 23, 2026, 11:03pm UTC](https://discourse.julialang.org/t/common-data-utilities-for-time-series/137104 "2026-05-23T23:03:20Z")

</div>

I frequently find myself having to cleanup and process raw ‘real’ data. I am really not a data person, but I think this is called data plumbing. And to be honest, I don’t have much fun doing it :slight\_smile: Typical op…

---

## [Finding sub-arrays in an array?](https://discourse.julialang.org/t/finding-sub-arrays-in-an-array/136700)

<div class="topic-metadata">

**Author:** [@sophibug](https://discourse.julialang.org/u/sophibug)\
**Replies:** 7\
**Last updated:** [April 14, 2026, 3:50pm UTC](https://discourse.julialang.org/t/finding-sub-arrays-in-an-array/136700 "2026-04-14T15:50:02Z")

</div>

I’m putting this here because this is a chemistry usage but it’s not really a chemistry-specific case. I have an array that has a bunch of states formatted like this: 1.0 1.0 0.0 1.0 0.0 1.0 6380.35 1.0 1.0…

---

## [\[ANN\] GeoIO.jl - Load/save geospatial data in Julia](https://discourse.julialang.org/t/ann-geoio-jl-load-save-geospatial-data-in-julia/106031)

<div class="topic-metadata">

**Author:** [@juliohm](https://discourse.julialang.org/u/juliohm)\
**Replies:** 14\
**Last updated:** [March 13, 2026, 5:11pm UTC](https://discourse.julialang.org/t/ann-geoio-jl-load-save-geospatial-data-in-julia/106031 "2026-03-13T17:11:10Z")

</div>

GeoIO.jl uses various backend packages spread across different Julia organizations to load a universal representation of geospatial data as discussed in the book Geospatial Data Science with Julia. The current list of s…

---

## [\[ANN\] SDMXer and SDMXerWizard: official statistics for Julia with SDMX](https://discourse.julialang.org/t/ann-sdmxer-and-sdmxerwizard-official-statistics-for-julia-with-sdmx/135588)

<div class="topic-metadata">

**Author:** [@gvdr](https://discourse.julialang.org/u/gvdr)\
**Replies:** 1\
**Last updated:** [February 12, 2026, 3:04am UTC](https://discourse.julialang.org/t/ann-sdmxer-and-sdmxerwizard-official-statistics-for-julia-with-sdmx/135588 "2026-02-12T03:04:05Z")

</div>

SDMX is a global data modelling standard, especially for official statistics. It’s been adopted by many National Statistics Offices, and a large number of international organizations. It’s a very rich data+metadata forma…

---

## [Error loading OpenSSL\_jll (“version OPENSSL\_3.3.0 not found”) when precompiling MLDatasets](https://discourse.julialang.org/t/error-loading-openssl-jll-version-openssl-3-3-0-not-found-when-precompiling-mldatasets/128977)

<div class="topic-metadata">

**Author:** [@josemanuel22](https://discourse.julialang.org/u/josemanuel22)\
**Replies:** 8\
**Last updated:** [December 16, 2025, 2:43pm UTC](https://discourse.julialang.org/t/error-loading-openssl-jll-version-openssl-3-3-0-not-found-when-precompiling-mldatasets/128977 "2025-12-16T14:43:10Z")

</div>

Environment Julia version: 1.8 OS: Linux (64-bit) OpenSSL\_jll artifact path: /export/usuarios01/jmfrutos/.julia/artifacts/a696e1e3e6b8d3c2c4b67609357ebc5c35eabde1/lib/libssl.so When I run: using MLDatasets I get th…

---

## [TypeDBClient.jl Revived for TypeDB 3.4.4 – Native FFI, Streaming, & Rollback Safety](https://discourse.julialang.org/t/typedbclient-jl-revived-for-typedb-3-4-4-native-ffi-streaming-rollback-safety/134217)

<div class="topic-metadata">

**Author:** [@iamcomcy](https://discourse.julialang.org/u/iamcomcy)\
**Replies:** 4\
**Last updated:** [December 3, 2025, 6:32pm UTC](https://discourse.julialang.org/t/typedbclient-jl-revived-for-typedb-3-4-4-native-ffi-streaming-rollback-safety/134217 "2025-12-03T18:32:51Z")

</div>

\[ANN\] TypeDBClient.jl – Revived for TypeDB 3.4.4 Community Edition After a long hiatus, I’m excited to announce TypeDBClient.jl – a lightweight, type-safe Julia client for TypeDB (formerly Grakn), the polymorphic graph d…

---

## [Best practices for real-time LabVIEW ↔ Julia data exchange](https://discourse.julialang.org/t/best-practices-for-real-time-labview-julia-data-exchange/132319)

<div class="topic-metadata">

**Author:** [@Frauke](https://discourse.julialang.org/u/Frauke)\
**Replies:** 22\
**Last updated:** [September 16, 2025, 9:18am UTC](https://discourse.julialang.org/t/best-practices-for-real-time-labview-julia-data-exchange/132319 "2025-09-16T09:18:15Z")

</div>

Hi everyone, I am currently working on a project where I want to integrate LabVIEW with Julia. The basic idea is that LabVIEW acquires some signals from hardware, Julia processes the data (e.g., simple computations like…

---

## [How do you like to save your data and how much customizability do you like/need?](https://discourse.julialang.org/t/how-do-you-like-to-save-your-data-and-how-much-customizability-do-you-like-need/129707)

<div class="topic-metadata">

**Author:** [@AwesomeQuest](https://discourse.julialang.org/u/AwesomeQuest)\
**Replies:** 5\
**Last updated:** [June 8, 2025, 2:39pm UTC](https://discourse.julialang.org/t/how-do-you-like-to-save-your-data-and-how-much-customizability-do-you-like-need/129707 "2025-06-08T14:39:01Z")

</div>

I’m making an application that controls a spectrometer (among other things). The program is likely to be saving dozens if not hundreds of spectra, each being about 0.5MB. There’s also some positional metadata that comes…

---

## [How to link a Selector to a column of a DataTable](https://discourse.julialang.org/t/how-to-link-a-selector-to-a-column-of-a-datatable/127723)

<div class="topic-metadata">

**Author:** [@edmund.r](https://discourse.julialang.org/u/edmund.r)\
**Replies:** 4\
**Last updated:** [April 7, 2025, 2:01pm UTC](https://discourse.julialang.org/t/how-to-link-a-selector-to-a-column-of-a-datatable/127723 "2025-04-07T14:01:24Z")

</div>

Hi, I have some JSON of the form j = JSON.parse("""\[{"A":"one", "B":2},{"A":"three","B":4}\]""") I have made a DataTable by dt = DataTable(DataFrame(j)) Next I would like to bind a Selector control to a column. I …

---

## [What is the best way to include sample data in Package for CI and precompilation](https://discourse.julialang.org/t/what-is-the-best-way-to-include-sample-data-in-package-for-ci-and-precompilation/127094)

<div class="topic-metadata">

**Author:** [@lupemba](https://discourse.julialang.org/u/lupemba)\
**Replies:** 2\
**Last updated:** [March 19, 2025, 2:38pm UTC](https://discourse.julialang.org/t/what-is-the-best-way-to-include-sample-data-in-package-for-ci-and-precompilation/127094 "2025-03-19T14:38:46Z")

</div>

I am working on MetopDatasets.jl and I want to includes some sample data for CI tests and precompilation. How can I include sample data in packages and still keep the size of the repository down? I am considering to use…

---

## [Dagger + Dates = snakemake?](https://discourse.julialang.org/t/dagger-dates-snakemake/126111)

<div class="topic-metadata">

**Author:** [@jonathanBieler](https://discourse.julialang.org/u/jonathanBieler)\
**Replies:** 3\
**Last updated:** [February 25, 2025, 9:42am UTC](https://discourse.julialang.org/t/dagger-dates-snakemake/126111 "2025-02-25T09:42:25Z")

</div>

I have a folder data with samples (csv files), I want to compute some statistics for each file and then make a summary. In snakemake you can define rules how to produce the output file from the inputs, and snakemake will…

---

## [Julia cloud app development](https://discourse.julialang.org/t/julia-cloud-app-development/125146)

<div class="topic-metadata">

**Author:** [@monty](https://discourse.julialang.org/u/monty)\
**Replies:** 0\
**Last updated:** [January 23, 2025, 9:05pm UTC](https://discourse.julialang.org/t/julia-cloud-app-development/125146 "2025-01-23T21:05:11Z")

</div>

Our company (EnviTrace; https://envitrace.com ) is aiming to contract work related to the development of AI/ML software and interactive web/mobile applications in Julia. We are looking to contract the work with a US-bas…

---

## [Planing on building an ETL Framework](https://discourse.julialang.org/t/planing-on-building-an-etl-framework/124747)

<div class="topic-metadata">

**Author:** [@th0rben](https://discourse.julialang.org/u/th0rben)\
**Replies:** 2\
**Last updated:** [January 14, 2025, 7:56pm UTC](https://discourse.julialang.org/t/planing-on-building-an-etl-framework/124747 "2025-01-14T19:56:27Z")

</div>

I am planing to build a package for ETL processes as my Bachelor thesis. My plan is to to have the package be a simple way to build data pipelines following ETL. Having a simple way to load the data from different sourc…

---

## [\[ANN\] GeoTIFF.jl](https://discourse.julialang.org/t/ann-geotiff-jl/123679)

<div class="topic-metadata">

**Author:** [@juliohm](https://discourse.julialang.org/u/juliohm)\
**Replies:** 1\
**Last updated:** [December 10, 2024, 11:25pm UTC](https://discourse.julialang.org/t/ann-geotiff-jl/123679 "2024-12-10T23:25:52Z")

</div>

Load and save GeoTIFF files in native Julia with GeoTIFF.jl The package is developed on top of the incredible TiffImages.jl package by @tlnagy Examples of usage in the README:

---

## [Does CSV.read allow another process to keep writing to file?](https://discourse.julialang.org/t/does-csv-read-allow-another-process-to-keep-writing-to-file/122656)

<div class="topic-metadata">

**Author:** [@japhir](https://discourse.julialang.org/u/japhir)\
**Replies:** 6\
**Last updated:** [November 19, 2024, 10:00am UTC](https://discourse.julialang.org/t/does-csv-read-allow-another-process-to-keep-writing-to-file/122656 "2024-11-19T10:00:19Z")

</div>

I’m running a pretty expensive job on a cluster. This generates plaintext output files by appending new lines with data regularly (roughly once every second or so). I’ve written some julia code to perform quick visualiz…

---

## [\[ANN\] JMPReader.jl - Reader for JMP files in Julia](https://discourse.julialang.org/t/ann-jmpreader-jl-reader-for-jmp-files-in-julia/120710)

<div class="topic-metadata">

**Author:** [@jaakkor2](https://discourse.julialang.org/u/jaakkor2)\
**Replies:** 2\
**Last updated:** [October 1, 2024, 1:51pm UTC](https://discourse.julialang.org/t/ann-jmpreader-jl-reader-for-jmp-files-in-julia/120710 "2024-10-01T13:51:15Z")

</div>

Announcing JMPReader.jl, a reader for files saved by JMP, commercial statistical software. Do you have a .jmp file and one or more of the following applies to you? You don’t have a JMP license You’re not running Win…

---

## [\[ANN\] GeoArtifacts.jl - Artifacts for Geospatial Data Science in Julia](https://discourse.julialang.org/t/ann-geoartifacts-jl-artifacts-for-geospatial-data-science-in-julia/114508)

<div class="topic-metadata">

**Author:** [@juliohm](https://discourse.julialang.org/u/juliohm)\
**Replies:** 2\
**Last updated:** [September 26, 2024, 12:36pm UTC](https://discourse.julialang.org/t/ann-geoartifacts-jl-artifacts-for-geospatial-data-science-in-julia/114508 "2024-09-26T12:36:43Z")

</div>

GeoArtifacts.jl The package provides various artifacts (e.g., datasets) for geospatial data science, from various sources (e.g., GADM, INMET, NaturalEarth). The result is always a GeoTable as discussed in the GDSJL book. …

---

## [Current solution for reading Fixed Width files (2024)](https://discourse.julialang.org/t/current-solution-for-reading-fixed-width-files-2024/118635)

<div class="topic-metadata">

**Author:** [@dlakelan](https://discourse.julialang.org/u/dlakelan)\
**Replies:** 3\
**Last updated:** [August 26, 2024, 5:37pm UTC](https://discourse.julialang.org/t/current-solution-for-reading-fixed-width-files-2024/118635 "2024-08-26T17:37:22Z")

</div>

I’ve done the due diligence searching the forum for solutions to read fixed width files, but found mostly things from 2017, 2019, 2020… and referencing packages that don’t seem to exist anymore (FWF.jl). Julia has been m…

---

## [Tips for handling large Datasets with a lot of preprocessing](https://discourse.julialang.org/t/tips-for-handling-large-datasets-with-a-lot-of-preprocessing/117551)

<div class="topic-metadata">

**Author:** [@felix12123](https://discourse.julialang.org/u/felix12123)\
**Replies:** 1\
**Last updated:** [July 27, 2024, 8:24pm UTC](https://discourse.julialang.org/t/tips-for-handling-large-datasets-with-a-lot-of-preprocessing/117551 "2024-07-27T20:24:50Z")

</div>

Hello, i am currently trying to machine learn a local relation between two 2D arrays. Consider the two 2D CircularArrays A and B of the same size. I want to predict the value of B\[x,y\] with the region A\[x-r:x+r, y-r:y+…

---

## [\[Workgroup\] JuliaHealth Meeting – May 30th, 2024](https://discourse.julialang.org/t/workgroup-juliahealth-meeting-may-30th-2024/114805)

<div class="topic-metadata">

**Author:** [@TheCedarPrince](https://discourse.julialang.org/u/TheCedarPrince)\
**Replies:** 2\
**Last updated:** [May 30, 2024, 4:03pm UTC](https://discourse.julialang.org/t/workgroup-juliahealth-meeting-may-30th-2024/114805 "2024-05-30T16:03:13Z")

</div>

Hi everyone! :wave: It is time for another JuliaHealth community call very soon! After having been on hiatus since April, we are back with another monthly call! We have an exciting schedule already lined up for this mon…

---

## [Issues Importing Excel Files with XLSX.jl Package](https://discourse.julialang.org/t/issues-importing-excel-files-with-xlsx-jl-package/114717)

<div class="topic-metadata">

**Author:** [@phil25](https://discourse.julialang.org/u/phil25)\
**Replies:** 2\
**Last updated:** [May 27, 2024, 12:09pm UTC](https://discourse.julialang.org/t/issues-importing-excel-files-with-xlsx-jl-package/114717 "2024-05-27T12:09:29Z")

</div>

Dear all, I’m currently using the XLSX.jl package in Julia to import several Excel files. Unfortunately, I don’t have access to the original sources of these files and have to work with the existing versions. I’ve enco…

---

## [How to import data from MATLAB \`.mat\` files?](https://discourse.julialang.org/t/how-to-import-data-from-matlab-mat-files/114059)

<div class="topic-metadata">

**Author:** [@WuSiren](https://discourse.julialang.org/u/WuSiren)\
**Replies:** 3\
**Last updated:** [May 9, 2024, 3:35pm UTC](https://discourse.julialang.org/t/how-to-import-data-from-matlab-mat-files/114059 "2024-05-09T15:35:10Z")

</div>

Can Julia import data from .mat files directly?

---

## [\[ANN\] Parquet2.jl](https://discourse.julialang.org/t/ann-parquet2-jl/69274)

<div class="topic-metadata">

**Author:** [@ExpandingMan](https://discourse.julialang.org/u/ExpandingMan)\
**Replies:** 20\
**Last updated:** [May 8, 2024, 5:30am UTC](https://discourse.julialang.org/t/ann-parquet2-jl/69274 "2024-05-08T05:30:37Z")

</div>

Parquet2.jl A little something I’ve been working on for the past few weeks. This package is not yet registered because I would like to try to get the community’s help with a bit more testing before registering it. Parq…

---

## [RFC: ClusteringAPI.jl](https://discourse.julialang.org/t/rfc-clusteringapi-jl/112258)

<div class="topic-metadata">

**Author:** [@Datseris](https://discourse.julialang.org/u/Datseris)\
**Replies:** 27\
**Last updated:** [April 18, 2024, 9:11pm UTC](https://discourse.julialang.org/t/rfc-clusteringapi-jl/112258 "2024-04-18T21:11:54Z")

</div>

Hi all, this could go either in statistics, data, or machine learning domains, please share. Alright, so I was trying to test various different clustering algorithms to see which one best clusters my data. In doing so,…

[Next page](https://discourse.julialang.org/tag/data/99.md?match_all_tags=true&page=1&tags%5B%5D=data)