Read_parquet() not defined?

[austin-putz]

Hello, I feel kind of silly here. No idea what I did. I couldn’t seem to load a dataset with Arrow from R (feather). So I jumped to Parquet to test. I used the arrow package in R, have a .parquet file on my hard disk and went to read in with Parquet in Julia.

I’m getting an error that ‘read_parquet() not defined’, after loading Parquet, so I went to help and don’t see the function… I used the code directly from their webpage
JuliaIO/Parquet.jl: Julia implementation of Parquet columnar file format reader (github.com)

Anyone have any idea on this one? Feel very lost on why Arrow wasn’t working and why Parquet doesn’t even list a core function. I must have made some mistake.

[mrufsvold]

Can you try Parquet.read_parquet(...)?

The function should be exported but maybe it’s not for some reason?

That’s my best stab without seeing the full stack trace. If you post the full stack trace then it would be easier to get to the bottom of it for you!

[austin-putz]

So sorry, very ignorant here trying to learn Julia still. I mostly use R, but need Julia for JWAS so bare with me. I do not see the function at all. I loaded Parquet, but if you can see my screenshot, no read_parquet() function exists.

Sorry, what is ‘full stack trace’ mean?

[jar1]

Please do

import Pkg
Pkg.status()

and paste the result here, enclosed in triple backticks

```
like this
```

so it’s easy to read.

[austin-putz]

Oh I’m sorry, here you are:

julia> Pkg.status()
Status `~/.julia/environments/v1.10/Project.toml`
  [69666777] Arrow v2.7.1
  [6e4b80f9] BenchmarkTools v1.4.0
  [336ed68f] CSV v0.10.12
  [13f3f980] CairoMakie v0.11.8
  [a93c6f00] DataFrames v1.6.1
  [1313f7d8] DataFramesMeta v0.14.1
  [e9467ef8] GLMakie v0.9.8
  [c9a035f4] JWAS v1.2.1
  [ff71e718] MixedModels v4.22.3
⌅ [626c502c] Parquet v0.4.0
  [46a55296] ParquetFiles v0.2.0
  [b98c9c47] Pipe v1.3.0
  [91a5bcdd] Plots v1.40.1
  [6f49c342] RCall v0.14.1
  [ce6b1742] RDatasets v0.7.7
⌅ [2913bbd2] StatsBase v0.33.21
  [f3b207a7] StatsPlots v0.15.7
  [fd094767] Suppressor v0.2.6
  [337ecbd1] TidierPlots v0.5.4
  [b8865327] UnicodePlots v3.6.3
  [ade2ca70] Dates
  [10745b16] Statistics v1.10.0
Info Packages marked with ⌅ have new versions available but compatibility constraints restrict them from upgrading. To see why use `status --outdated`

So I guess v0.4.0, but not sure why that made read_parquet() disappear… or I’m just going crazy.

[jar1]

That version is from several years ago; I’m guessing read_parquet is newer than that. The current version is 0.8.4. Pkg.update() to update your packages, hopefully there isn’t a conflict that would prevent updating to the newest versions.

[austin-putz]

@jar1 thank you, I have no idea what is going on. Must be another package that is holding it back. I see there is a

status --outdated

I need to run here and remove that package. Sorry about this, I had no idea they would have not had a read_parquet() at any time in development…

[austin-putz]

@jar1 I updated and still cannot find… This is so weird. It’s now to 0.8.4

(@v1.10) pkg> st
Status `~/.julia/environments/v1.10/Project.toml`
  [69666777] Arrow v2.7.1
  [6e4b80f9] BenchmarkTools v1.4.0
  [336ed68f] CSV v0.10.12
  [13f3f980] CairoMakie v0.11.8
  [a93c6f00] DataFrames v1.6.1
  [1313f7d8] DataFramesMeta v0.14.1
  [e9467ef8] GLMakie v0.9.8
  [c9a035f4] JWAS v1.2.1
  [ff71e718] MixedModels v4.22.3
  [626c502c] Parquet v0.8.4
  [b98c9c47] Pipe v1.3.0
  [91a5bcdd] Plots v1.40.1
  [6f49c342] RCall v0.14.1
  [ce6b1742] RDatasets v0.7.7
⌅ [2913bbd2] StatsBase v0.33.21
  [f3b207a7] StatsPlots v0.15.7
  [fd094767] Suppressor v0.2.6
  [337ecbd1] TidierPlots v0.5.4
  [b8865327] UnicodePlots v3.6.3
  [ade2ca70] Dates
  [10745b16] Statistics v1.10.0

But still will not find read_parquet()…See here

any ideas?

[jar1]

If you’ve loaded the old package (i.e. using Parquet) already, you’ll have to restart Julia after installing the new version in order to load the new version.

[austin-putz]

Yup, that was it. Sorry to bother you. Thanks!