# Reading Data Is Still Too Slow

**URL:** <https://discourse.julialang.org/t/reading-data-is-still-too-slow/17919>\
**Category:** Data\
**Created:** [November 23, 2018, 5:54pm UTC](https://discourse.julialang.org/t/reading-data-is-still-too-slow/17919 "2018-11-23T17:54:56Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![davidanthoff](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/davidanthoff/32/223493_2.png) [@davidanthoff](https://discourse.julialang.org/u/davidanthoff)\
**Post date:** [November 23, 2018, 6:08pm UTC](https://discourse.julialang.org/t/reading-data-is-still-too-slow/17919/2 "2018-11-23T18:08:06Z")

</div>

Could you try [CSVFiles.jl](https://github.com/queryverse/CSVFiles.jl) on your dataset?

```julia
using DataFrames, CSVFiles, FileIO

crsp = load(File(format"CSV", "crspdaily-clean.csv.gz"), nastrings=["NA", "NaN", ""]) |> DataFrame

# or for already uncompressed file
crsp = load("crspdaily-clean.csv", nastrings=["NA", "NaN", ""]) |> DataFrame

```

[This](https://discourse.julialang.org/t/textparse-jl-is-fast-again/16664) indicates that [TextParse.jl](https://github.com/JuliaComputing/TextParse.jl) is often faster (or en par) than [CSV.jl](https://github.com/JuliaData/CSV.jl). [CSVFiles.jl](https://github.com/queryverse/CSVFiles.jl) uses [TextParse.jl](https://github.com/JuliaComputing/TextParse.jl) under the hood. The benchmarks I posted there showed an additional overhead when using [CSVFiles.jl](https://github.com/queryverse/CSVFiles.jl) over pure [TextParse.jl](https://github.com/JuliaComputing/TextParse.jl), but you can get rid of that entirely when using the latest `master` version of [DataFrames.jl](https://github.com/JuliaData/DataFrames.jl).

Having said that, R’s `fread` is a beast and there simply isn’t anything in julia currently that can deliver that level of performance. And I’m only talking about single threaded reads, once `freads` starts to use threads, it simply leaves everything else in the dust…

---

_[View the full topic](https://discourse.julialang.org/t/reading-data-is-still-too-slow/17919)._