# Need example of processing csv file in chunks

**URL:** https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833
**Category:** New to Julia
**Tags:** package, csv
**Created:** [January 4, 2021, 5:10pm UTC](https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833 "2021-01-04T17:10:17Z")
**Posts on this page:** 4
**Page:** 1

<div class="post-metadata">

### Author: ![asyrov](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/asyrov/32/13578_2.png) [@asyrov](https://discourse.julialang.org/u/asyrov)
#### Post date: [January 4, 2021, 5:10pm UTC](https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833/1 "2021-01-04T17:10:17Z")

</div>

I have big 10+GB files which I need to load and process line by line. I’m trying to use CSV package, but appears this package preload entire file.

Can anyone help or point to example of code which works with big files?

---

<div class="post-metadata">

### Author: ![marc](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/marc/32/7668_2.png) [@marc](https://discourse.julialang.org/u/marc)
#### Post date: [January 4, 2021, 5:12pm UTC](https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833/2 "2021-01-04T17:12:14Z")

</div>

This might help:  
[Reading-Chunks](https://csv.juliadata.org/stable/index.html#Reading-Chunks)

---

<div class="post-metadata">

### Author: ![Skoffer](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/skoffer/32/378_2.png) [@Skoffer](https://discourse.julialang.org/u/Skoffer)
#### Post date: [January 4, 2021, 5:29pm UTC](https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833/3 "2021-01-04T17:29:00Z")

</div>

If you want to process data row by row, then maybe Rows can be useful? [Home · CSV.jl](https://csv.juliadata.org/stable/index.html#CSV.Rows)

---

<div class="post-metadata">

### Author: ![mthelm85](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mthelm85/32/224164_2.png) [@mthelm85](https://discourse.julialang.org/u/mthelm85)
#### Post date: [January 4, 2021, 5:38pm UTC](https://discourse.julialang.org/t/need-example-of-processing-csv-file-in-chunks/52833/4 "2021-01-04T17:38:24Z")

</div>

Have a look at [JuliaDB](https://juliadb.juliadata.org/latest/out_of_core/) too.
