The CSV package has an option in CSV.File() to skip parsing lines at the end of a file, called “footerskip”. The loadtable function in JuliaDB has a keyword argument to skip rows at the beginning of a file (skiplines_begin) but not the end. Is there some way to parse files this way without modifying them all be removing the last line before calling loadtable on them? I’m interested in loading a group of files into a distributed table at once.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
CSVFiles line by line | 5 | 2715 | December 29, 2018 | |
Parsing strange CSV files | 5 | 618 | March 13, 2020 | |
Reading a file from line x to line y | 28 | 768 | May 22, 2024 | |
Loading a csv-like file with a multi-line header | 11 | 373 | May 20, 2024 | |
Using JuliaDB to read in all the CSVs fails, but not when reading them singly | 2 | 754 | March 18, 2019 |