Yes, if passed a non-observable, @lift falls back to calling map (!!). I was also surprised by this, and made a Makie PR two years ago that was’t accepted.
The @lift macro with the semantics you want is available in MakieExtra.jl:
using MakieExtra
@lift ...