For now, it merely dispatches the necessary operations to a new experimental library of NVidia (thanks to the NVidia developers involved) cuTENSOR and does not provide a Julia/CUDAnative implementation. The basic functionality of cuTENSOR is wrapped in the custom/experimental branch
ksh/tensor of CuArrays.jl (thanks to @maleadt and @kslimes).
Given the current state, this is a pre-announcement, and CuTensorOperations.jl is not registered yet. It is more likely to become part of TensorOperations.jl in time.
Check out the README for more info, known (current) limitations and installation instructions. Experiment, and report any issues!