Skip empty entries of sparse matrix when plotting a heatmap

I actually ended using a scatter plot, which I found also allows creating a colorbar for the marker colors. That worked fine.