Hi all,
I’m trying to use ODBC.jl to query our enterprise’s Snowflake server. Fortunately, it works. Unfortunately, it’s extremely slow. E.g. pulling 1000 rows via ODBC takes 1.5 minutes. Pulling the same 1000 rows in the web app takes about 4 seconds.
ODBC is definitely not my domain of expertise. What can I do to try and troubleshoot this problem? Are there alternative packages I can try using an ODBC connection?
thanks
The TidierDB.jl package has a snowflake backend. I wrote it using http and json3 because I was hitting roadblocks with ODBC.
If you don’t want to use the tidier syntax, you can probably pull what you need from the underlying code to create your own querying functions.
I will point out , I never tested queries on super large tables - just mtcars really so it’s possibly slow/may have some bugs to work out. Happy to work those out if that’s the case
Hope this helps.
Thanks. I saw TidierDB has a Snowflake backend but haven’t given it a try myself yet because I have no idea what our OAuth token is. We use Entra ID, but the Snowflake guide is rather intimidating and probably seems to be out of the lane I should be swimming within our enterprise. Maybe I’ll give it a shot tomorrow if I can’t find a solution with ODBC.
sounds good. i get that. I do remember it took me a little bit of time to figure out how to use the oauth tokens as well and i ended up using this video