Axis padding

Is there a way to pad an axis in Makie without modifying the data limits? I’m trying to use brackets to highlight a range in a heat map, like in the following little example.

using Makie

function bracket_test()
    fig = Figure()
    ax = Axis(fig[1,1])
    hh = heatmap!(ax, randn(30,17))
    bracket!(ax, [(Point2f(30.5, 1), Point2f(30.5, 6))];text=["Groupd"],style=:square, orientation=:down)
    xlims!(ax, 0.5, 33)
    fig
end

Here I had to artificially increase xlims to avoid the label getting cut off by the bounding box of the axis. The works, but it looks ugly with the extra bit of x-axis sticking out. Is there a way to achieve this without resorting to manipulating data limits? Is there a way to manually add some padding between the data limits and the bounding box of the axis?