# AWS S3 and JLD

**URL:** https://discourse.julialang.org/t/aws-s3-and-jld/3915
**Category:** General Usage
**Created:** [May 24, 2017, 7:03pm UTC](https://discourse.julialang.org/t/aws-s3-and-jld/3915 "2017-05-24T19:03:21Z")
**Posts on this page:** 2
**Page:** 1

<div class="post-metadata">

### Author: ![Tomas\_Pevny](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tomas_pevny/32/25466_2.png) [@Tomas\_Pevny](https://discourse.julialang.org/u/Tomas_Pevny)
#### Post date: [May 24, 2017, 7:03pm UTC](https://discourse.julialang.org/t/aws-s3-and-jld/3915/1 "2017-05-24T19:03:21Z")

</div>

Hello All,  
I am working on large machine learning project, where data are stored in S3. My plan is to asynchronously download data to workers that would learn the Neural Network or do other magic on them.

So far, I have encountered two limitations.  
Firstly,

```julia
AWS.S3.get_bkt(env,bucket_name,options=AWS.S3.GetBucketOptions(max_keys=2000))

```

returns at most 1000 elements of the bucket, even though I requested more.

Secondly, when I download the file stored as jld, I cannot parse it. After downloading the file issuing

```julia
r = AWS.S3.get_object(env,bkt,file_name);

```

r.obj is of type `Array{UInt8,1}` but I cannot load it using `load(IOBuffer(r.obj))`.

Has anyone tried to overcome these issues?

Thanks for suggestions.  
Tomas

---

<div class="post-metadata">

### Author: ![kevin.squire](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/kevin.squire/32/62_2.png) [@kevin.squire](https://discourse.julialang.org/u/kevin.squire)
#### Post date: [May 26, 2017, 1:09pm UTC](https://discourse.julialang.org/t/aws-s3-and-jld/3915/2 "2017-05-26T13:09:21Z")

</div>

If you haven’t yet, I suggest opening up an issue in the AWS.jl package repo.