Hello guys! I’m working on an asynchronous implementation of filter, but it never finishes. The code below is for testing a list of 950 proxies to see which ones are still working and if the response time was less than 5 seconds. It works fine for up to 200 proxies, but for the 950 it never runs out. Any hints as to what it could be? Is there any way to optimize this?
const conf = (readtimeout=5, retry=false)
url = "https://api.ipify.org/?format=json"
proxies = CSV.File("proxies.csv") |> Tables.matrix |> vec
function test(proxy)
resp = ""
try
resp = HTTP.get(url, proxy="http://$proxy"; conf...).body |> String |> JSON.Parser.parse |> x -> x["ip"]
catch
end
if resp != ""
println(threadid(), " ok ", proxy)
return true
else
println(threadid(), " fail ", proxy)
return false
end
end
function asyncfilter(f, i)
if length(i) >= 2
head = i[1]
tail = i[2:end]
fun = @async f(head)
recursion = @async asyncfilter(f, tail)
if fetch(@sync fun)
return [head, fetch(@sync recursion)...]
else
return [fetch(@sync recursion)...]
end
else
return i
end
end
result = asyncfilter(test, proxies)
Sukera
August 13, 2022, 4:41am
2
I don’t think that’s how @sync works. It has to enclose the @async calls syntactically to wait on them. fetch also already blocks & waits on the return value of the task, so the @sync is superfluous.
That aside, this will be VERY inefficient, due to creating lots and lots of intermediary arrays and splatting them, as well as creating a copy on slicing and more tasks than necessary due to the recursion - it’s probably better to just asyncmap your test function.
The problem continues in asyncmap.
Sukera
August 16, 2022, 7:02am
4
It’s not really possible to further help debug this without your proxies.csv file - what code exactly are you running with asyncmap? The same test function?
proxies.csv
Column1
116.202.13.106:8080
154.16.63.16:8080
51.250.80.131:80
117.54.114.101:80
71.19.249.118:8001
41.65.236.43:1976
185.51.10.19:80
35.234.248.49:3128
54.36.226.225:2019
200.25.254.193:54240
152.228.163.151:80
133.18.194.45:8080
45.67.201.3:80
43.255.113.232:8082
8.219.97.248:80
80.240.201.62:83
200.105.215.18:33630
41.59.90.92:80
139.99.237.62:80
138.117.85.97:999
45.189.116.21:999
103.159.90.22:83
41.128.148.84:1981
47.89.185.178:8888
130.41.47.235:8080
62.201.214.146:8080
103.41.212.226:44759
103.144.247.53:8888
216.137.184.253:80
104.45.128.122:80
66.196.238.181:3128
45.67.201.4:80
95.59.26.129:80
122.102.118.83:8080
82.210.8.173:80
182.253.141.90:8080
103.159.90.42:83
201.184.72.178:999
195.158.3.198:3128
85.173.165.36:46330
167.114.96.27:9300
190.107.233.230:999
212.83.165.229:2019
193.31.27.123:80
77.70.35.87:37475
134.209.28.98:3128
125.21.3.41:8080
115.96.208.124:8080
79.253.201.252:8080
70.169.70.87:80
130.41.44.100:8080
190.69.153.82:999
66.29.154.103:3128
178.32.101.200:80
187.190.0.240:999
58.27.59.249:80
190.61.41.125:999
2.179.193.146:80
118.36.19.164:8080
94.75.76.10:8080
66.29.154.105:3128
185.61.152.137:8080
181.215.171.210:999
47.74.152.29:8888
102.68.79.51:8080
103.148.178.228:80
201.91.82.155:3128
23.236.109.50:80
69.75.172.54:8080
134.209.29.120:3128
45.189.112.225:999
117.54.114.33:80
181.129.43.3:8080
180.180.123.40:8080
159.203.61.169:8080
3.144.188.184:8080
201.220.102.146:8080
190.107.233.235:999
51.15.242.202:8888
181.78.64.39:999
43.228.125.189:8080
104.192.202.11:8080
218.39.136.163:8000
209.97.150.167:3128
40.122.215.129:80
154.12.243.75:80
197.243.20.186:80
196.1.95.117:80
165.154.227.34:80
46.53.191.12:3128
47.245.33.104:12345
134.209.29.120:8080
181.129.1.228:999
190.94.199.14:999
181.205.20.198:999
45.224.153.60:999
202.154.180.53:46717
181.205.20.195:999
8.242.207.202:8080
79.110.40.129:8080
91.234.127.222:53281
223.113.80.158:9091
62.33.202.44:8080
198.59.191.234:8080
177.141.99.50:8080
154.201.41.60:3128
37.139.26.54:3128
45.66.209.245:8085
172.241.137.55:8118
51.77.141.29:1081
188.133.136.105:1256
197.246.255.203:3030
149.18.31.126:8085
181.129.70.82:44357
212.83.163.176:2019
78.46.107.130:80
172.241.137.99:8118
23.105.86.85:8118
150.136.120.227:3128
20.206.106.192:8123
1.224.3.122:3888
187.188.169.169:8080
190.90.39.77:999
111.95.189.244:5678
185.20.115.118:34493
200.69.77.212:999
188.235.0.207:8282
20.71.241.197:80
222.79.249.182:9091
201.71.2.41:999
36.37.177.186:8080
41.128.148.84:1976
37.35.41.223:8569
178.212.199.95:1099
51.159.197.230:80
43.135.203.23:80
94.28.32.117:8080
117.54.114.97:80
93.86.63.73:8080
154.201.43.23:3128
154.201.39.251:3128
37.35.40.146:8236
41.33.63.182:1981
82.165.65.190:80
130.41.65.206:8080
190.248.153.162:8080
77.37.192.217:8080
181.209.82.154:23500
161.22.35.61:999
23.88.125.28:3128
2.188.164.194:8080
181.78.94.22:999
207.180.224.75:80
24.139.149.74:5678
203.189.89.156:8080
67.202.53.206:3128
140.83.32.175:80
156.200.116.68:1981
103.30.246.41:8888
54.36.226.228:2019
45.65.65.18:4145
47.243.240.77:3128
103.149.162.195:80
95.168.170.84:80
172.241.137.135:8118
45.192.141.128:5165
81.91.144.190:55443
208.109.11.232:8089
50.235.247.114:8085
203.210.84.198:8080
187.102.236.209:999
47.254.90.125:8081
62.193.108.137:1981
105.213.151.253:5678
102.134.127.15:8080
181.78.94.193:999
125.26.165.245:443
45.229.192.61:5678
139.224.134.145:22
190.120.248.89:999
192.186.176.94:8144
83.168.85.9:8090
117.54.114.98:80
103.168.164.26:82
181.129.245.126:999
103.231.78.36:80
83.171.254.60:8085
173.212.213.133:3128
185.190.38.150:8080
93.177.117.141:8085
185.141.63.85:25362
142.252.198.190:3128
212.3.184.102:8080
170.79.12.72:9090
172.241.192.247:8118
96.27.152.115:8080
47.242.48.178:3128
186.159.14.132:5678
213.166.78.38:8085
190.26.201.194:8080
20.110.214.83:80
154.236.168.179:1976
188.136.196.34:8080
38.15.148.35:3128
218.1.142.159:57114
143.244.134.24:80
82.204.150.190:3129
5.58.110.249:8080
129.41.171.244:8000
23.108.43.116:8118
77.233.5.68:55443
37.53.103.6:3128
203.215.166.162:3128
61.7.141.30:8080
38.41.53.145:9090
49.207.36.81:80
5.154.254.218:5229
74.103.66.15:80
109.200.155.195:8080
41.33.219.141:8080
197.156.240.66:5678
213.166.78.154:8085
216.250.156.85:80
200.114.96.18:999
128.199.13.74:80
95.164.233.29:5387
2.59.21.16:7546
120.237.144.77:9091
189.51.4.254:45367
37.35.41.37:8383
104.238.80.180:39605
103.184.180.161:8080
52.168.34.113:80
49.48.120.197:8080
103.92.29.110:8080
172.241.192.192:8118
81.183.253.34:4145
45.79.158.95:7497
187.75.209.247:8080
190.107.233.231:999
45.5.119.178:8080
95.181.149.166:8085
51.75.78.135:3128
82.117.215.98:3629
185.125.253.130:8080
103.135.14.176:8181
125.228.43.81:8080
41.65.236.57:1981
74.82.50.155:3128
37.26.136.224:4153
117.54.106.241:8080
190.187.201.26:8080
103.140.75.11:5678
181.209.106.189:1080
103.71.21.238:83
175.100.64.127:9812
23.108.43.78:8118
172.252.1.125:3128
37.35.40.177:8267
194.35.121.177:6729
221.131.158.246:8888
133.18.227.47:8080
181.205.20.197:999
183.87.160.62:84
51.79.50.22:9300
187.95.27.20:8080
77.50.104.110:3128
103.178.43.2:8181
103.106.219.77:8080
40.69.60.146:80
103.250.148.82:41889
45.175.255.3:999
80.194.38.106:3333
95.161.188.246:61537
164.90.152.213:7497
167.71.230.124:8080
172.252.224.240:3128
12.69.91.227:80
180.178.170.71:8080
177.105.232.114:8080
190.60.104.218:3128
51.77.100.172:8083
104.144.182.185:3128
203.86.16.236:8080
167.172.158.85:81
190.90.242.210:999
193.233.138.121:8085
45.137.63.215:7244
193.41.88.58:53281
1.186.85.2:80
43.255.113.232:80
124.131.219.94:9091
172.241.137.187:8118
23.94.158.191:3128
138.197.148.215:80
142.252.223.49:3128
41.206.56.62:1080
176.108.47.38:3128
109.201.96.222:4145
185.157.241.63:4145
193.56.72.233:8085
119.8.54.56:3128
47.243.249.210:3128
80.211.23.121:80
103.81.114.182:53281
190.107.237.14:999
45.189.253.105:999
185.126.65.70:6855
115.74.246.138:8080
133.18.239.64:8080
46.4.35.210:9099
23.108.42.18:8118
45.236.168.133:999
154.201.40.50:3128
85.133.229.10:1080
59.31.90.206:4145
58.152.94.67:8081
102.66.228.123:5678
24.172.82.94:53281
185.141.63.4:12394
185.94.218.57:43403
34.87.84.105:80
46.105.35.193:8080
190.119.211.42:9812
193.117.138.126:44805
23.81.127.143:8118
20.84.57.125:3128
140.227.127.205:80
27.116.41.156:9898
223.96.90.216:8085
190.107.233.227:999
181.143.59.140:4153
217.57.234.27:80
180.92.212.178:5678
105.213.162.192:5678
45.120.136.104:80
138.201.5.11:1080
8.210.155.195:3128
142.252.26.227:3128
104.144.183.185:3128
117.198.97.220:80
202.29.237.210:3128
185.188.181.85:3128
208.163.39.218:53281
139.255.142.40:1080
190.61.61.70:8080
88.255.101.227:8080
1.179.148.9:55636
151.22.181.215:8080
103.125.162.134:83
41.128.183.12:1976
43.255.113.232:8085
3.226.168.144:80
190.220.1.173:56974
14.161.43.121:8080
200.24.157.114:999
103.96.79.73:8080
41.65.236.44:1981
14.207.16.18:8080
154.201.45.178:3128
187.190.120.15:8080
109.167.134.253:30710
212.129.15.88:8080
186.47.81.50:8888
61.78.63.200:30000
194.44.15.222:8081
23.108.77.246:8118
213.194.113.128:9090
154.201.40.91:3128
94.232.11.178:46449
212.64.72.199:8080
77.220.40.102:1080
177.234.217.92:999
47.242.20.94:3128
177.136.84.134:999
49.231.174.182:80
41.33.63.182:1976
63.151.67.7:8080
37.35.41.221:8567
103.177.224.54:3128
41.59.90.94:80
183.111.25.248:8080
104.37.102.205:8282
212.3.135.57:8080
142.252.223.75:3128
113.160.159.160:19132
47.88.7.13:8080
94.26.108.67:2580
175.101.85.129:8080
80.211.66.104:80
200.106.187.252:999
23.108.43.38:8118
187.37.121.236:4153
205.201.49.132:53281
164.132.170.100:80
133.18.197.218:8080
80.89.198.229:80
103.48.68.35:83
201.222.45.67:999
190.97.225.37:999
186.24.9.114:999
143.244.132.11:80
38.10.252.248:999
212.126.96.154:8080
37.35.40.151:8241
47.92.113.71:80
45.115.211.14:587
181.174.224.35:999
23.105.78.238:8118
103.82.233.2:53281
14.140.131.82:3128
180.183.135.243:8080
27.255.58.74:8080
23.108.64.90:8118
149.18.30.22:8085
88.255.101.229:8080
130.41.55.190:8080
103.10.22.236:8080
88.255.101.230:8080
37.35.41.199:8545
34.75.202.63:80
184.107.73.150:80
190.107.237.20:999
139.9.64.238:443
93.113.233.147:3128
95.0.206.19:8080
193.233.141.179:8085
37.35.40.131:8221
78.37.40.1:4153
203.150.113.239:14153
88.99.162.33:5566
81.161.236.49:8080
83.151.4.172:57812
177.53.221.89:44196
201.150.116.49:999
23.19.7.147:8118
181.129.2.90:8081
67.212.186.99:80
181.204.9.182:9812
37.252.73.192:8080
45.230.169.129:999
175.143.178.15:5678
138.0.91.227:999
201.184.155.20:5678
45.248.41.216:9812
193.151.160.211:8298
187.86.158.117:3128
131.161.237.102:8090
108.177.248.196:8118
45.88.160.93:5529
92.205.21.186:3128
58.82.151.242:8080
93.48.228.247:4153
153.126.179.216:8080
212.112.113.178:3128
146.59.199.12:80
23.108.64.81:8118
217.108.221.11:80
178.212.196.177:9999
161.35.161.38:80
190.107.233.226:999
138.122.147.122:8080
8.214.4.72:33080
51.210.107.99:7497
41.178.6.118:8060
161.22.35.62:999
93.177.117.235:8085
199.168.131.33:8181
200.91.229.204:8080
103.241.182.97:80
82.77.129.205:5678
170.155.2.119:80
77.236.248.237:8080
45.192.140.247:6837
190.107.224.150:3128
200.41.60.33:4153
43.129.95.244:8080
181.205.20.194:999
77.46.138.233:8080
102.68.128.210:8080
108.177.248.133:8118
23.108.15.224:8118
45.5.57.122:8080
175.106.10.227:7878
157.100.12.138:999
104.248.90.212:80
172.241.137.111:8118
209.127.75.140:3128
103.159.47.9:83
111.225.152.235:8089
138.121.161.82:8099
154.201.41.177:3128
212.42.99.22:4145
103.117.192.174:80
222.253.48.253:8080
93.177.229.164:9812
197.255.55.122:41890
1.1.189.58:8080
190.107.233.232:999
67.212.186.101:80
152.89.236.8:80
162.144.236.128:80
154.201.41.40:3128
119.93.129.34:80
2.59.21.59:7589
93.145.17.218:8080
190.104.1.19:999
103.49.202.252:80
162.144.233.16:80
129.150.52.76:80
190.97.233.17:999
14.207.146.65:8080
118.173.242.189:8080
218.238.83.182:80
194.124.38.179:8181
177.93.38.238:8080
201.182.251.154:8080
45.192.141.223:5260
46.14.171.138:8080
78.154.180.52:81
154.201.45.196:3128
31.41.225.205:45067
154.201.45.201:3128
51.79.144.41:17662
176.62.188.10:8123
12.109.102.86:64312
45.192.146.108:6119
47.242.52.247:3128
190.107.233.233:999
12.88.29.66:9080
41.65.246.3:3129
103.35.132.18:82
43.245.93.241:53805
23.108.42.88:8118
78.28.152.111:80
105.212.59.126:5678
45.192.146.26:6037
216.250.156.89:80
95.38.80.36:8050
45.180.10.197:999
140.227.59.167:3180
154.236.184.70:1981
154.201.41.208:3128
183.89.157.219:8080
220.87.222.238:8118
38.65.139.66:999
81.163.57.147:41258
212.95.180.50:53281
134.209.189.42:80
133.18.231.31:8080
178.212.54.137:8080
156.238.9.212:7103
104.211.157.219:80
23.229.21.138:3128
1.214.62.61:8000
154.201.40.248:3128
190.107.237.24:999
175.100.103.170:55443
154.201.43.127:3128
186.251.64.10:8085
193.105.62.11:58973
193.151.161.7:8350
81.252.38.12:8080
201.244.127.210:8080
41.59.90.88:80
45.66.209.79:8085
213.6.199.94:49044
125.99.58.110:3128
154.92.122.25:5095
78.30.230.117:50932
195.178.56.32:8080
41.204.87.90:8080
154.201.42.51:3128
95.217.20.255:51222
154.95.38.130:5788
183.89.68.233:8080
105.112.135.166:8080
45.8.134.120:7136
195.219.98.27:5678
203.189.89.158:8080
168.119.53.93:80
188.133.152.125:8080
23.108.43.158:8118
39.104.68.232:8080
89.208.219.121:8080
5.83.94.8:4153
45.189.113.63:999
201.218.158.79:999
101.109.145.236:8080
88.135.210.179:8080
14.143.172.238:8080
3.212.9.208:80
23.108.15.195:8118
2.56.101.66:8598
181.225.54.3:999
190.107.237.22:999
36.91.166.98:8080
167.172.104.11:40269
88.248.2.160:5678
103.130.70.209:83
103.172.70.27:81
37.35.40.32:8122
154.201.43.49:3128
41.65.236.53:1976
138.68.60.8:8080
143.202.226.205:4145
196.20.12.25:8080
206.62.64.34:8080
139.255.94.122:39635
203.246.112.133:3128
94.23.91.209:80
36.67.27.189:49524
193.106.57.7:33429
95.216.224.238:8118
131.72.69.41:45005
71.94.71.46:3128
77.236.237.241:1256
159.196.222.215:8080
37.35.40.33:8123
172.241.192.87:8118
103.244.108.145:3128
197.210.217.66:60896
45.70.236.123:999
81.91.137.42:8080
194.233.95.214:3128
162.243.174.235:80
190.14.238.197:999
101.255.77.241:8080
80.252.5.34:7001
93.91.112.247:41258
154.201.45.24:3128
181.114.224.38:8080
65.18.114.254:55443
182.52.83.46:8080
212.83.162.168:2019
172.241.192.133:8118
190.109.16.145:999
154.201.45.153:3128
89.161.90.225:5678
5.16.1.17:8080
41.33.99.18:8080
223.25.101.242:53150
183.247.221.119:30001
152.169.106.145:80
190.107.233.229:999
74.114.232.162:8080
183.88.16.226:8080
45.189.254.2:999
37.35.41.8:8354
178.248.44.52:3128
138.99.176.62:999
200.91.223.122:8080
81.30.211.222:3128
102.68.129.54:8080
93.177.117.178:8085
81.174.11.159:61743
191.102.64.147:999
47.243.32.216:8118
190.92.35.102:999
37.35.43.62:8920
195.250.92.58:8080
31.135.91.9:4145
154.201.42.244:3128
37.35.41.124:8470
104.248.203.46:3129
190.120.248.158:999
190.97.225.41:999
130.41.15.76:8080
58.221.193.74:8888
218.1.200.137:57114
68.183.185.62:80
23.108.43.71:8118
45.192.141.221:5258
45.179.200.129:999
154.236.189.23:1981
213.166.77.114:8085
167.99.124.118:80
200.8.185.126:4145
193.151.160.17:8104
38.15.148.55:3128
104.144.161.9:3128
188.239.84.51:53281
43.250.107.91:80
103.172.172.2:8083
193.233.137.197:8085
200.54.25.226:8080
62.253.84.50:3333
102.68.128.218:8080
197.248.184.158:53281
202.91.77.158:83
190.109.6.113:999
45.192.141.108:5145
37.35.43.204:9062
41.193.84.196:3128
172.241.137.118:8118
198.27.74.6:9300
181.118.158.132:999
41.65.227.166:1981
221.6.201.74:9999
103.164.112.124:10001
190.57.245.250:8080
159.65.69.186:9300
69.43.44.106:8080
213.166.78.155:8085
45.184.129.165:8181
154.16.63.16:3128
193.3.40.250:8080
110.78.152.92:4145
201.219.194.118:8080
136.243.124.244:3128
201.217.49.2:80
46.101.126.180:36677
103.168.164.26:83
91.230.199.174:61440
37.35.42.53:8655
185.98.138.177:80
133.18.233.207:8080
5.196.214.181:3128
88.255.102.39:8080
190.107.237.2:999
103.17.201.130:8080
51.195.81.233:8080
38.15.148.91:3128
2.59.21.45:7575
54.176.98.189:3128
110.78.152.78:4145
94.237.27.238:80
166.88.122.167:3128
82.200.80.118:8080
154.95.0.160:6413
212.174.242.114:8080
41.222.62.41:9898
47.243.75.202:58853
157.119.211.133:8080
95.181.149.22:8085
154.201.41.4:3128
45.231.168.93:999
184.191.162.4:3128
68.183.111.90:80
181.198.62.154:999
114.130.78.185:8080
110.74.199.16:63141
37.35.40.17:8107
80.13.0.226:80
119.59.125.191:3128
192.158.15.201:50877
172.241.137.23:8118
201.238.248.134:443
138.197.203.84:7497
105.213.165.97:5678
45.189.255.18:999
190.6.54.5:8080
50.219.7.203:80
192.111.129.145:16894
193.56.64.107:8085
103.155.54.245:83
134.209.241.216:80
122.224.56.198:7302
130.41.41.175:8080
205.207.103.73:8282
97.87.248.14:80
165.16.5.186:9999
103.31.251.97:9191
51.75.206.209:80
111.59.194.52:9091
185.213.174.181:7497
31.145.154.138:9093
8.208.82.80:8081
144.168.146.242:7785
142.252.198.162:3128
109.238.222.5:40387
190.107.237.9:999
116.90.208.151:5678
178.212.48.70:1080
190.119.176.4:999
109.195.23.223:34031
137.74.90.233:8282
124.204.33.162:8000
50.255.17.229:32100
109.92.222.170:53281
78.189.188.121:6563
176.235.131.234:9090
180.180.152.94:4145
195.8.52.243:8080
210.187.176.105:8080
59.15.28.113:3128
196.3.99.162:8080
46.209.196.147:8080
139.59.249.244:7777
213.14.174.70:3128
181.118.158.133:999
91.242.228.107:8085
108.177.248.0:8118
129.205.170.165:51438
176.241.89.244:53583
81.143.236.200:443
47.95.22.177:3128
200.106.216.50:63253
209.127.17.122:3128
46.101.186.238:80
41.65.236.44:1976
45.192.150.153:6336
111.225.152.113:8089
146.56.119.252:80
102.68.128.215:8080
191.97.16.115:999
47.243.40.107:80
183.89.158.254:8080
212.46.230.102:6969
78.186.98.171:1080
176.214.99.101:1256
89.250.152.76:8080
181.78.94.168:999
117.54.114.102:80
219.146.125.162:9091
echoproxy11.ea5gf.es:8100
202.168.69.227:8080
82.114.118.142:1256
31.161.38.233:8090
176.106.122.56:8085
45.170.101.2:999
81.132.20.80:80
46.173.35.229:3629
218.1.142.134:57114
89.208.35.81:3128
91.108.155.196:8080
118.39.57.75:4145
85.195.104.71:80
85.234.126.107:55555
202.131.234.194:8080
185.226.113.180:38030
45.67.213.166:8085
51.143.10.179:80
62.193.68.92:1981
42.2.75.250:8080
189.124.138.137:5678
138.36.180.4:9292
172.241.192.187:8118
101.53.154.137:2008
45.167.39.26:4145
91.106.65.64:9812
176.9.20.195:8080
37.112.210.248:55443
197.246.212.70:3030
206.189.146.13:8080
133.18.203.28:8080
80.48.119.28:8080
167.172.173.210:37823
193.56.64.116:8085
134.122.58.174:80
67.212.186.102:80
45.232.249.62:4145
143.198.242.86:8048
203.150.113.62:8080
104.144.225.196:3128
200.37.199.186:999
200.89.174.158:8080
181.196.253.122:9812
79.122.225.167:8080
103.42.162.50:8080
194.28.56.49:3629
189.196.46.2:999
82.165.105.48:80
202.70.67.93:80
103.68.207.34:83
173.249.39.108:3128
23.105.78.224:8118
5.154.254.229:5240
47.243.91.156:3128
103.250.68.10:8080
190.120.248.157:999
106.244.154.91:8080
193.233.138.128:8085
45.230.169.9:999
54.175.197.235:80
217.180.218.36:8080
117.121.213.94:7497
171.6.132.218:8000
14.177.235.17:8080
162.155.10.150:55443
118.163.13.200:8080
102.68.130.18:6666
74.205.128.200:80
47.57.188.208:80
196.202.215.143:41890
45.192.136.235:5529
62.182.114.164:59623
154.201.40.198:3128
169.57.1.85:8123
111.68.31.155:8080
185.172.129.13:7497
35.88.27.49:80
172.241.192.244:8118
103.232.215.194:80
154.201.45.248:3128
103.105.76.21:5678
102.130.133.102:53281
45.153.22.22:5962
103.112.44.99:5678
201.77.108.130:999
84.53.239.95:4145
202.43.190.11:8118
50.219.7.215:80
125.25.45.11:8080
122.99.125.85:80
54.206.80.159:20000
97.74.92.60:80
103.210.161.198:8998
104.164.183.30:3128
152.69.213.197:8080
45.230.47.17:999
209.127.39.119:3128
177.124.184.52:8080
37.32.40.178:8080
138.68.245.25:7497
188.235.34.146:1080
91.93.118.3:8090
191.101.58.7:999
1.1.220.100:8080
124.122.114.18:8080
159.192.147.186:8080
189.203.234.146:999
162.0.226.218:80
91.241.21.237:9812
129.18.210.126:9812
24.106.221.230:53281
188.43.228.25:8080
45.32.101.24:80
172.252.224.154:3128
47.252.4.64:8888
208.109.191.184:80
154.201.39.71:3128
51.91.62.219:80
80.240.202.218:8080
41.65.174.120:1976
181.209.106.186:1080
151.22.181.214:8080
192.227.182.100:3128
47.242.84.173:3128
37.35.43.191:9049
2.59.21.26:7556
159.203.111.0:7497
103.252.1.137:3128
193.233.230.157:8085
103.117.192.14:80
201.222.45.65:999
37.35.42.181:8783
218.1.200.97:57114
190.107.237.11:999
47.105.80.6:80
what code exactly are you running with asyncmap? The same test function?
yes
result = asyncmap(test, proxies)
jules
August 17, 2022, 7:37am
6
Could be rate limiting on the API?
1 Like
This is not the cause because a 5 second timeout has been set. So if one request fails, it should move on to the next one.
const conf = (readtimeout=5, retry=false)
this problem was a bug in the HTTP.jl package.https://github.com/JuliaWeb/HTTP.jl/issues/909
1 Like