# Announcement: DataFrames Future Plans

**URL:** <https://discourse.julialang.org/t/announcement-dataframes-future-plans/266>\
**Category:** Data\
**Tags:** announcement\
**Created:** [November 12, 2016, 1:45pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266 "2016-11-12T13:45:41Z")\
**Posts on this page:** 8\
**Page:** 2

<div class="post-metadata">

**Author:** ![nalimilan](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/nalimilan/32/147_2.png) [@nalimilan](https://discourse.julialang.org/u/nalimilan)\
**Post date:** [February 24, 2017, 2:58pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/21 "2017-02-24T14:58:53Z")

</div>

The DataTables manual is online now.

---

<div class="post-metadata">

**Author:** ![gcalmettes](https://avatars.discourse-cdn.com/v4/letter/g/e9a140/32.png) [@gcalmettes](https://discourse.julialang.org/u/gcalmettes)\
**Post date:** [March 16, 2017, 2:07pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/22 "2017-03-16T14:07:22Z")

</div>

The documentation is now available at [Introduction · DataTables.jl](https://juliadata.github.io/DataTables.jl/stable/)

---

<div class="post-metadata">

**Author:** ![abieler](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/abieler/32/2693_2.png) [@abieler](https://discourse.julialang.org/u/abieler)\
**Post date:** [March 16, 2017, 3:53pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/23 "2017-03-16T15:53:12Z")

</div>

Very nice!

Having played around with DataTables I have a question about modifying columns. Say I want to subtract the mean of every column. I came up with the following rather verbose code:

```julia
function centering!(dt)
  for (name, col) in eachcol(dt)
    x0 = mean(dropnull(col))
    tmp = NullableArray(Float64, length(col))
    for i in eachindex(col)
      tmp.values[i] = col.values[i] - x0
      tmp.isnull[i] = col.isnull[i]
    end
    dt[name] = tmp
  end
end

```

Where I create a new NullableArray, fill it with values and “isnulls” and finally replace the original column in the DataTable with the new one. Is there less verbose way of doing this, maybe with built in methods I overlooked?

Cheers,  
Andre

---

<div class="post-metadata">

**Author:** ![nalimilan](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/nalimilan/32/147_2.png) [@nalimilan](https://discourse.julialang.org/u/nalimilan)\
**Post date:** [March 16, 2017, 4:34pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/24 "2017-03-16T16:34:28Z")

</div>

You should never need to access the `values` field. Something like `map!(x -> x - x0, col)` is enough. On Julia 0.6, `col .- Nullable(x0)` also works, though in the present case it’s not a clear improvement.

You can also use Query.jl which will unwrap (“lift”) nullables automatically.

---

<div class="post-metadata">

**Author:** ![mkborregaard](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mkborregaard/32/556_2.png) [@mkborregaard](https://discourse.julialang.org/u/mkborregaard)\
**Post date:** [March 16, 2017, 4:47pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/25 "2017-03-16T16:47:32Z")

</div>

Nice. Sorry if it’s offtopic to post here, but I was first expecting something like this to be possible using colwise (and I guess this works in 0.6) but why is there no `colwise!` function?

---

<div class="post-metadata">

**Author:** ![nalimilan](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/nalimilan/32/147_2.png) [@nalimilan](https://discourse.julialang.org/u/nalimilan)\
**Post date:** [March 16, 2017, 5:00pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/26 "2017-03-16T17:00:53Z")

</div>

Yes, I guess `colwise!` would be a useful addition. Could you file an issue?

---

<div class="post-metadata">

**Author:** ![mkborregaard](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mkborregaard/32/556_2.png) [@mkborregaard](https://discourse.julialang.org/u/mkborregaard)\
**Post date:** [March 16, 2017, 5:10pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/27 "2017-03-16T17:10:08Z")

</div>

Happy to 🙂

---

<div class="post-metadata">

**Author:** ![nalimilan](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/nalimilan/32/147_2.png) [@nalimilan](https://discourse.julialang.org/u/nalimilan)\
**Post date:** [July 4, 2017, 5:54pm UTC](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266/28 "2017-07-04T17:54:45Z")

</div>

I’ve just posted an update on the DataFrames plans [in a new post](https://discourse.julialang.org/t/announcement-an-update-on-dataframes-future-plans/4646).

[Previous page](https://discourse.julialang.org/t/announcement-dataframes-future-plans/266.md?page=1)
