Hi all, I am trying to load multiple csv files from an s3 source but I seem to be hitting a roadblock when trying to use the local method of doing so (glob, csv, dataframes) and trying to incorporate AWSS3: p = S3Path("s3://stuff/", config=global_aws_config()); readdir(p) which produces: 30-ele…

Read multiple csv files from S3

Billpete002 May 30, 2022, 12:24pm 5

Got it after a slight edit from your code:

dftest = CSV.read(AWSS3.read.(readdir(p; join = true)), DataFrame)

as p was already an S3Path. Thanks!!

1 Like

Topic		Replies	Views
Read multiple csv files Performance filesystem	1	1447	July 28, 2020
Retrieve data from Amazon S3? General Usage question , input-output	9	3461	October 17, 2019
Julia is unable to load CSV files from the Kaggle competition Performance question , package , csv	6	2249	August 3, 2018
Problem with file import (dir does not exist) New to Julia	3	1512	March 22, 2017
CSV.read() won't accept just a file name? General Usage	3	3862	February 20, 2019