# Cannot load large CSV files with CSV.Read using M1, or M1 Pro?

**URL:** https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498
**Category:** New to Julia
**Tags:** csv
**Created:** [October 27, 2021, 6:36pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498 "2021-10-27T18:36:18Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Mitch](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mitch/32/24224_2.png) [@Mitch](https://discourse.julialang.org/u/Mitch)
#### Post date: [October 27, 2021, 6:36pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/1 "2021-10-27T18:36:18Z")

</div>

Does anyone else have issues loading large CSV files into Julia on the new Apple chips? I have to load smaller files sequentially first, otherwise the loading process never finishes?

---

<div class="post-metadata">

### Author: ![gbaraldi](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/gbaraldi/32/22101_2.png) [@gbaraldi](https://discourse.julialang.org/u/gbaraldi)
#### Post date: [October 27, 2021, 7:06pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/2 "2021-10-27T19:06:18Z")

</div>

I imagine you are using the native build of julia.  
Does it work in rosetta?  
Can you disable threading?  
Also can you share one of those large files so that people can test?  
It might be this [https://github.com/JuliaLang/julia/issues/41820](https://github.com/JuliaLang/julia/issues/41820) .  
Another thing you can do is limit the number of julia threads to just the performance cores, so 4 on the normal m1. Dunno about the others.

---

<div class="post-metadata">

### Author: ![Oscar\_Smith](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/oscar_smith/32/25343_2.png) [@Oscar\_Smith](https://discourse.julialang.org/u/Oscar_Smith)
#### Post date: [October 27, 2021, 7:15pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/3 "2021-10-27T19:15:16Z")

</div>

Are you just running out of ram? If so, you should probably not be reading the whole file at once.

---

<div class="post-metadata">

### Author: ![Mitch](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mitch/32/24224_2.png) [@Mitch](https://discourse.julialang.org/u/Mitch)
#### Post date: [November 2, 2021, 12:47pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/5 "2021-11-02T12:47:41Z")

</div>

![Screen Shot 2021-11-02 at 8.42.21 AM](https://global.discourse-cdn.com/julialang/original/3X/3/2/325c12c43f562d09e5ceae53c1fafc5f3e71aacb.png)

@Oscar_Smith: I don’t think so - I’m uncertain how to test it? It’s only 20,000 rows and my old Mac intel with 8gb of Ram read the file without issues. Either I receive an error like the screenshot above, or I don’t at all.

Thanks for your help - sorry about the late reply.

---

<div class="post-metadata">

### Author: ![Mitch](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mitch/32/24224_2.png) [@Mitch](https://discourse.julialang.org/u/Mitch)
#### Post date: [November 2, 2021, 12:51pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/6 "2021-11-02T12:51:52Z")

</div>

@gbaraldi: I could be wrong, but no. Get info states “Kind: Application (Intel)”.

---

<div class="post-metadata">

### Author: ![gbaraldi](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/gbaraldi/32/22101_2.png) [@gbaraldi](https://discourse.julialang.org/u/gbaraldi)
#### Post date: [November 3, 2021, 7:17pm UTC](https://discourse.julialang.org/t/cannot-load-large-csv-files-with-csv-read-using-m1-or-m1-pro/70498/7 "2021-11-03T19:17:20Z")

</div>

Try adding export `export JULIA_NUM_THREADS=4` to your `.zshrc`. The economy cores don’t play well with julia. I imagine you are on a normal M1 mac.
