Using Julia Autodiff/GPU or tensorflow 2.0

New to Julia
1

Hi all, I am not new to Julia and I love Julia. Currently for my work project, I have a MATLAB framework and I have to decide on the programming language to use next. For a simple task in my project, I was trying tensorflow 2.0, which is much easier to use than tensorflow 1.0 and much easier to scale with GPUs.

My question is: could julia currently provide such things like tensorflow 2.0? is there anyone here who has been in the same situation like mine? I know that ForwardDiff.jl and CuArrays.jl should work, but how easy to use them, compared to tensorflow 2.0. I am just a bit nervous and worried if I use Julia.

My project mostly involves convolution, fast FFT, large matrix, auto diff, optimization (LBFGSB).

Thanks guys and hopefully I can decide to use Julia.

2

those work fine with autodiff. What’s the issue?

3

Thanks. I do not know the exact issues I may come up with. Maybe these questions:

  1. Is using CuArrays with autodiff seamlessly? Like just replace the Float64 variables with CuArray variable?
  2. Does involving some neural network stuff (like Flux.jl) work with CuArrays with no problem?

Thanks. Again, I may be just nervous with Julia in this domain, due to lack of experiences.

4

Well, just replace arrays with CuArrays and run autodiff on it, yup.

Yup, I use CuArrays in neural networks in (stiff) differential equations with my own neural network architectures with implicit solvers daily, and the stuff works dandy. The simpler stuff is quite robust these days.

4 Likes