With pandas I can read a table into a dataframe, as follows: import pandas as pd dfs = pd.read_html('http://stats.ioinformatics.org/countries/')#returns a list of tables df=dfs[0] df.head()#inspect header I searched for a similar method in DataFrames.jl (more precisely in the forthcomming book, Ju…

My answer was for situations where the remote url returns a delimited file, which is what CSV.File parses. You are looking to extract a table from html, so need a library that parses html rather than delimited files, see: [image] Scraping a html table from a website New to J…

Thank you for the link to Scraping a html table from a url. Unfortunately I have a low level of knowledge and skills in html/CSS. For the moment I will read the tables with pd.read_html(url), save the corresponding dataframe as csv and re-read it in Julia.

Beat me to it… using TableScraper using DataFrames url = "https://stats.ioinformatics.org/countries/" st = scrape_tables(url) df = DataFrame(q=[], Country=String[], Host=String[], G=[], S=[], B=[], Total=[]) for row in first(st).rows push!(df, row) end df.G = pars…

@cormullion Thanks for your nice solution. I adopted it but replaced the last four lines of code by: for name in names(df)[end-3:end] df[!, name]= parse.(Int, df[!, name]) end

Or without for loops: using TableScraper, DataFrames url = "https://stats.ioinformatics.org/countries/" st = scrape_tables(url) df = DataFrame(permutedims(reduce(hcat, first(st).rows)), [:q,:Country,:Host,:G,:S,:B,:Total]) df[!,[:G,:S,:B,:Total]] .= parse.(Int, df[!,[:G,:S,:B,:Total]])

Yes, but the symbols :G, :S, :B, :Total, are repeated three times.

Could be replaced by 4:7, or assigned to a single variable, for instance.

How to read a table from url

General Usage

rafael.guerra November 29, 2022, 6:57pm 4

Check also this post on TableScraper.jl

3 Likes

Topic		Replies	Views
Any equivalent to Pandas read_html() in DataFrames.jl? General Usage dataframes	1	787	February 20, 2021
Scraping a html table from a website New to Julia	2	2477	September 29, 2020
Getting data directly from a website Performance	9	6519	July 9, 2018
Scrap table from NASA GCN circulars website Web Stack question , strings , csv , http	30	1268	August 3, 2023
[ANN] Harbest.jl v0.4 - Simple Web Scraping Package Announcements package , dataframes	0	329	June 27, 2023

How to read a table from url

Related topics