Solving block matrix system with factorized blocks

Is there are package that can construct a block matrix A with pre-factorized blocks, and make use of the factorization to solve Ax=b?
BlockArrays.jl seems able to use \ but not factorized blocks, BlockFactorizations.jl seems able to include factorized blocks, but no solvers or inv is defined.