Dataframe viewer needed


#1

I think a dataframe viewer where I can look at each row and column and if needed can scroll across up and down are needed.

I know atom has a CSV editor plugin. Perhaps can repurpose that. I know it’s a lot of work but it feels so neccesary!


#2

This is not what you are asking for, but may nevertheless be of interest to you


#3

This is a problem that I’ve never seen truly solved. What is really needed is a dataframe API such as DataFrames.jl, IndexedTables.jl, pandas or R dataframes which also has a GUI module preferably also with basic plotting. To my knowledge nothing like this exists even for pandas or R. The closest thing I’ve ever seen is people using the “data viewer” in spyder or pycharm to get a look at pandas dataframe. I also found this python module very useful and it looks like it has matured significantly since I’ve last used it. I wonder how difficult it would be to get it to plug into Julia data?


#4

A fast data viewer would easily put Julia ahead of R in my book. As stated above, python doesn’t have a good standard data viewer. R’s is pretty slow, with either Base R or Rstudio.

Jupyter Lab has a very sleek and responsive table viewer, but as it stands now, the only way to use it is to import a .csv. I submitted a feature request to have a function like R’s View() to use that table viewer for dataframes. So hopefully Jupyter Lab will soon be able to have a robust dataviewer. From the looks of it, it will be faster and more feature complete than R’s.

Stata is the benchmark for this, imo. Their data viewer is ridiculously responsive, but they have had a full time team working on this for years and have clearly figured out how to get as much mileage as possible from Qt.


#5

If Julia will have a data viewer, I hope it works for multiple formats, including JLD, JLD2, hdf5,fst, RData, etc. This feature does not exist in R or Python, but I guess it should be useful.


#6

I think the suggestion would be for a viewer for tabular objects within an open session of Julia, like DataFrames or matrices, rather than for viewing compressed data formats.


#7

A data viewer can be very responsive if it’s just looking at a window (or sub array) of the overall data set. A caching adapter would have to be built around various file formats. Perhaps a random access DataStream would do…?

If there’s a well defined standard I nterface for accessing and scrolling the window, a GUI would just be an addon.


#8

Since you can store anything in those formats, probably going to make the data viewer much more complicated. If you were always looking at things that are essentially AbstractVecOrMat it is a much easier place to start.


#9

@davidanthoff shared https://github.com/JuliaComputing/TableView.jl on slack which looks pretty close to what the OP was interesting in.


#10

Very cool. Hopefully there is a way to use it with a browser normally, as I intensely dislike Jupyter notebooks.


#11

It looks pretty cool! It’s based on WebIO, so I imagine it should work in Juno and/or in an Electron window as well.

EDIT: I’ve just checked: it actually does work in Juno inside the plot pane