Slow abstractarray.jl, indices: line 64 when starting julia with `--inline=no`

zsoerenm · June 13, 2018, 2:04pm

When I use ProfileView to profile my code it shows that most of the time is consumed in:

abstractarray.jl, indices: line 64

Every arrow is pointing to time consumed in abstractarray.jl, indices: line 64

Unfortunately, it often shows up at the very top of the stack trace after multiple julia calls, which makes it hard to debug.

Is there a way to circumvent this performance bottleneck?

BTW: This is julia 0.6.3

ChrisRackauckas · June 13, 2018, 3:13pm

Without code it’s impossible to know what’s going on. But

github.com

JuliaLang/julia/blob/v0.6.3/base/abstractarray.jl#L64




```jldoctest
julia> A = ones(5,6,7);


julia> indices(A)
(Base.OneTo(5), Base.OneTo(6), Base.OneTo(7))
```
"""
function indices(A)
@_inline_meta
map(OneTo, size(A))
end


# Performance optimization: get rid of a branch on `d` in `indices(A,
# d)` for d=1. 1d arrays are heavily used, and the first dimension
# comes up in other applications.
indices1(A::AbstractArray{<:Any,0}) = OneTo(1)
indices1(A::AbstractArray) = (@_inline_meta; indices(A)[1])
indices1(iter) = OneTo(length(iter))


unsafe_indices(A) = indices(A)

it looks like you’re calling indices a lot, which is causing allocations, which wouldn’t be a good idea.

zsoerenm · June 13, 2018, 5:51pm

The easiest example I could come up with is this:

function norm_matrix(lut::Array{Complex{Float64}, 3})
  powers = sum(abs2.(lut), 1)
  max_gain = maximum(powers)
  lut ./ sqrt(max_gain)
end
using ProfileView
const A = complex.(randn(4,360,90), randn(4,360,90))
norm_matrix(A);
@profile norm_matrix(A);
ProfileView.view()

mbauman · June 13, 2018, 6:34pm

That’s a wonderful example — thank you! I’ll dig into this.

mbauman · June 13, 2018, 6:45pm

Hm, with that example I don’t see indices appear at all in the profile. I did modify it slight to get it to work:

function norm_matrix(lut::Array{Complex{Float64}, 3})
  powers = sum(abs2.(lut), 1)
  max_gain = maximum(powers)
  lut ./ sqrt(max_gain)
end
const A = complex.(randn(4,360,90), randn(4,360,90))
norm_matrix(A);
@profile for _ in 1:10000; norm_matrix(A); end

Perhaps you’re calling a different norm_matrix?

zsoerenm · June 13, 2018, 6:53pm

Sorry, I forgot to mention that this is only visible when starting julia with --inline=no
I started julia with inline=no to see where the actual bottlenecks are, but I guess this makes it even worse?

mbauman · June 13, 2018, 7:09pm

Oooh, yeah, that’s not going to do what you want.

Julia’s performance is heavily dependent upon inlining. Sure, you might get more “accurate” stack traces, but the runtime performance will be so abysmally different that the report will be completely useless for identifying bottlenecks.