# Best practices for local exploratory data analysis

**URL:** <https://discourse.julialang.org/t/best-practices-for-local-exploratory-data-analysis/74520>\
**Category:** Data\
**Created:** [January 13, 2022, 2:45am UTC](https://discourse.julialang.org/t/best-practices-for-local-exploratory-data-analysis/74520 "2022-01-13T02:45:36Z")\
**Posts on this page:** 1\
**Showing post:** 16

<div class="post-metadata">

**Author:** ![aplavin](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/aplavin/32/222056_2.png) [@aplavin](https://discourse.julialang.org/u/aplavin)\
**Post date:** [October 16, 2024, 11:55am UTC](https://discourse.julialang.org/t/best-practices-for-local-exploratory-data-analysis/74520/16 "2024-10-16T11:55:52Z")

</div>

> [@Keith\_Myerscough1](#):
>
> [SQLite.jl](https://juliahub.com/ui/Packages/General/SQLite) would probably do the job, but it’s – quite literally – unjulian to have to write SQL queries and execute them.

SQLCollections.jl ([discourse thread](https://discourse.julialang.org/t/ann-sqlcollections-jl-use-julia-data-manipulation-functions-for-databases/119244/4)) is specifically designed for querying SQL databases with the exact same code one can use for regular Julian collections. Supports a large but fundamentally limited subset of SQL functionality.  
Useful for code consistency in general, and for actually writing functions that can query both kinds of data interchangeably.

It is based on FunSQL.jl as a backend which is a great package! FunSQL gives you access to 100% of SQL but requires using special syntax – different from regular Julian data manipulation. Still more composable than SQL 🙂

For lightweight databases, try SQLite or DuckDB, depending on the workload. The latter is convenient for querying large CSV files without loading into memory, especially so [in synergy with SQLCollections](https://discourse.julialang.org/t/ann-sqlcollections-jl-use-julia-data-manipulation-functions-for-databases/119244/27). Maybe you’ll be fine with simply querying CSV files as they are, without even loading into a database? 😉

---

_[View the full topic](https://discourse.julialang.org/t/best-practices-for-local-exploratory-data-analysis/74520)._