# Help with Arrow.jl and size of files

**URL:** https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028
**Category:** Data
**Tags:** question, arrow
**Created:** [October 20, 2022, 6:14pm UTC](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028 "2022-10-20T18:14:23Z")
**Posts on this page:** 4
**Page:** 2

<div class="post-metadata">

### Author: ![austin-putz](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/austin-putz/32/2583_2.png) [@austin-putz](https://discourse.julialang.org/u/austin-putz)
#### Post date: [October 21, 2022, 1:22am UTC](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028/21 "2022-10-21T01:22:57Z")

</div>

Thank you, I’ve always struggled with conversions in Julia. I will use these from now on.

---

<div class="post-metadata">

### Author: ![austin-putz](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/austin-putz/32/2583_2.png) [@austin-putz](https://discourse.julialang.org/u/austin-putz)
#### Post date: [October 21, 2022, 1:23am UTC](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028/22 "2022-10-21T01:23:47Z")

</div>

Thanks for your comments. I’ll probably stick to Arrow then.

---

<div class="post-metadata">

### Author: ![austin-putz](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/austin-putz/32/2583_2.png) [@austin-putz](https://discourse.julialang.org/u/austin-putz)
#### Post date: [October 21, 2022, 1:26am UTC](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028/23 "2022-10-21T01:26:36Z")

</div>

Sorry, forgot to reply, no I didn’t catch that at first, but now I see it, thank you. I’ll try that after Int8 and see if I can get further reduction and what it does to speed on both writing and reading.

---

<div class="post-metadata">

### Author: ![austin-putz](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/austin-putz/32/2583_2.png) [@austin-putz](https://discourse.julialang.org/u/austin-putz)
#### Post date: [October 21, 2022, 2:40am UTC](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028/24 "2022-10-21T02:40:20Z")

</div>

Okay, with conversion to Int8 with your help and with compression using `compress = :lz4` I got it down to 93Mb from the original 3.4Gb. Thanks to everyone for the help! Both with and without compression was much faster than CSV (with spaces). 205 sec vs 37 sec (base Arrow) and 43 sec (with compression).

[Previous page](https://discourse.julialang.org/t/help-with-arrow-jl-and-size-of-files/89028.md?page=1)
