What is the best (recommended) way to store sequence data for recurrence models in Flux when it is aimed to be used in ‘batches’? At the moment I store the X data (features) as onehot hot encoded where the features span the rows (as with images) and the data for each step (time unit) spans the colum…

Since your input data is a list of Vector{String}, there is a pretty straightforward way to do this while still being able to make use of DataLoader. Instead of one-hot encoding everything up front, just pass the arrays of strings to the DataLoader to generate batches and one-hot encode + concatenat…

How to format sequential data to be used in reccurence models when batches are needed?

Specific Domains Machine Learning

mantzaris January 17, 2023, 2:05am 3

It is all in here: JuliaPlottingExploration/Flux03-GeneralConcepts.ipynb at main · mantzaris/JuliaPlottingExploration · GitHub

Topic		Replies	Views
How to do batching in Flux's recurrent sequence model to take advantage of GPU during training? Machine Learning flux	1	836	September 12, 2019
Building simple sequence-to-one RNN with Flux New to Julia flux	8	2117	March 4, 2021
Dimensions of minibatch Machine Learning	3	1083	August 7, 2020
Is it possible to use batching in Flux for sequences of different lengths? Machine Learning	3	1429	February 19, 2020
Simple Flux LSTM for Time Series Machine Learning question , flux , time-series , machine-learning	62	13785	April 11, 2022

How to format sequential data to be used in reccurence models when batches are needed?

Related topics