If I change a line of my code from cost = typemax(Float64) to cost::Float64 = typemax(Float64) then it becomes type stable (Any goes away). How can it be? The rest of the code is somewhat complicated, and I’m not sure I can reproduce this problem in a simplified setting. It’s in a hot section o…

I’d wager there is at least one other assignment to cost, and that is type unstable. Probably inferred as Union{Float64,...}. The annotation gives the compiler permission to make it concrete. Hard to diagnose without a MWE or the output of @code_warntype.

Is it a global variable? The type assertion tells the compiler that the variable doesn’t change type throughout the evaluation. In general, the compiler can’t assume that about global variables.

@code_warntype hybrid_ransac_fit(proposer, verifier) MethodInstance for VisualGeometryToolkit.hybrid_ransac_fit(::Tuple{SamplePc7{StructArrays.StructVector{NamedTuple{(:first, :second), Tuple{SVector{3, Float64}, SVector{3, Float64}}}, NamedTuple{(:first, :second), Tuple{Vector{SVector{3, Float64}},…

There are no globals as far as I know. They are all defined withing the context of the function.

Quote the code in triple backticks ``` please :slightly_smiling_face:

That Any goes away with a type annotation.

without MWE it’s impossible to help

@code_warntype ransac_fit_fund_mat(pc,1.0) MethodInstance for VisualGeometryToolkit.ransac_fit_fund_mat(::StructArrays.StructVector{NamedTuple{(:first, :second), Tuple{SVector{3, Float64}, SVector{3, Float64}}}, NamedTuple{(:first, :second), Tuple{Vector{SVector{3, Float64}}, Vector{SVector{3, Floa…

of course I would do this, if it were easy to reproduce.

Type stability bug in compiler?

General Usage

ToucheSir January 27, 2023, 4:47pm 10

A MWE means other people have to be able to run the code example showing the issue. See Please read: make it easier to help you if you haven’t already.

Topic		Replies	Views
Ominous type instability Performance bug , code_warntype , type-stability	10	1309	August 20, 2022
Why is this case type-unstable? General Usage	6	856	February 15, 2020
Keyword Arguments and Type Stability Performance function , keyword-arguments	11	986	February 23, 2023
How can I fix the type instability Performance question	3	414	February 5, 2024
Why is this expression type unstable? General Usage question , type-stability , symbolics	1	935	May 9, 2022

Type stability bug in compiler?

Related topics