Activation functions in NeuralPDE

General Usage
, ,
1

Hi everyone,

I am trying to use NeuralPDE to solve ODE systems.
I would like to ask that whether NeuralPDE provide different activation function like Softmax, Tanh or just only Sigmoid?
If yes, how could I find the information of activation functions in NeuralPDE?

Thank you all.

2

You can use any activation function you define in Julia. Just supply it to the Lux or Flux network. See the docs of the ML library for details. Do you have an MWE you’re working on?

3

“You can use any activation function you define in Julia”. It means I need to define the function if I want to use it?, I saw that the NeuralPDE has provide sigmoid, and I would like to explore other activation functions which is provided by NeuralPDE.
“See the docs of the ML library for details”. I have read the tutorial for ODE and just saw the sigmoid function.
" Do you have an MWE you’re working on". Actually I am looking for the activation function, I’ve already defined the ODE system.

4

Here’s the documentation of some Flux ones:

https://fluxml.ai/Flux.jl/stable/models/activation/

But you can also define any function f(x) and place it as the activation function.

1 Like
5

I read the information that the NNODE just supports out-of-place form. Would the NeuralPDE solve the ODE after transform from DAEs by ModelingToolkit?

6

At this time no but it could pretty easily add that feature. I suggest opening an issue.

1 Like