Use copy to materialize it, just as it says in in the docs.
You really need to post your code here, because I don’t see a reason a priori for a function to not accept Adjoints.
If you use arrays and not matrices (i.e. you don’t care about the algebraic structure, which seems to be your case), you should use permutedims.