For your case, if you use transpose instead of Transpose, it should work. Transpose shouldn’t usually be called directly anyways. It would probably still make sense to have an adjoint for Transpose and Adjoint in Zygote, I will see if I can make a small PR.
FYI, it’s usually a lot easier to help you track down issues, if you provide a standalone minimal working example. See also here.