The CSV package has an option in CSV.File() to skip parsing lines at the end of a file, called “footerskip”. The loadtable function in JuliaDB has a keyword argument to skip rows at the beginning of a file (skiplines_begin) but not the end. Is there some way to parse files this way without modifying them all be removing the last line before calling loadtable on them? I’m interested in loading a group of files into a distributed table at once.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Using JuliaDB to read in all the CSVs fails, but not when reading them singly | 2 | 747 | March 18, 2019 | |
Importing only specific lines from large csv file | 6 | 929 | January 11, 2024 | |
CSVFiles line by line | 5 | 2688 | December 29, 2018 | |
JuliaDB loading data | 15 | 1880 | July 12, 2019 | |
JuliaDB won't open CSV file | 6 | 1923 | April 10, 2019 |