# \[ANN\] A new lightning fast package for data manipulation in pure Julia

**URL:** https://discourse.julialang.org/t/ann-a-new-lightning-fast-package-for-data-manipulation-in-pure-julia/78197
**Category:** Package Announcements
**Tags:** data, dataframes, inmemorydatasets
**Created:** [March 21, 2022, 7:35am UTC](https://discourse.julialang.org/t/ann-a-new-lightning-fast-package-for-data-manipulation-in-pure-julia/78197 "2022-03-21T07:35:42Z")
**Posts on this page:** 1
**Showing post:** 24

<div class="post-metadata">

### Author: ![ericphanson](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/ericphanson/32/215186_2.png) [@ericphanson](https://discourse.julialang.org/u/ericphanson)
#### Post date: [March 22, 2022, 1:06am UTC](https://discourse.julialang.org/t/ann-a-new-lightning-fast-package-for-data-manipulation-in-pure-julia/78197/24 "2022-03-22T01:06:06Z")

</div>

> [@qsong](#):
>
> Currently no need to worry about changing several Base functions when `missing` involved because given the long time of testing (and discussion etc.) `DataFrames.jl` will still be #1 choice for most (potential) users.

The main problem with piracy isn’t really that it is surprising to the immediate users, since they can always read the docs (assuming it is mentioned there); the problem is that it is surprising to users _who don’t know they are using the package_ when it is a dependency of a dependency of a dependency etc. Currently, if any package in a user’s full dependency tree uses InMemoryDatasets, then the behavior of Base functions changes everywhere – and they very well might not know they are depending on InMemoryDatasets! (Consider the user who hasn’t seen this Discourse thread, for example). This could cause all sorts of bugs, since other code (and other packages) will expect those functions to not have been pirated. In other words, it’s non-composable.

> [@davidanthoff](#):
>
> If I had my way, I would actually not allow registration of packages that do things like that in the general registry 🙂

I think this makes sense given the wide-ranging consequences of type piracy, especially if we had a reliable and robust check. File an [issue in RegistryCI](https://github.com/JuliaRegistries/RegistryCI.jl/issues)?

---

_[View the full topic](https://discourse.julialang.org/t/ann-a-new-lightning-fast-package-for-data-manipulation-in-pure-julia/78197)._