Action Potentials in Neurons

Hello, I'm Ganesh. I'm building git-lrc, an AI code reviewer that runs on every commit. It is free, unlimited, and source-available on Github. Star git-lrc on GitHub to help more developers discover the project. Do give it a try and share your feedback for improving the product.

In the previous article, we discussed what is a neural network and how it works.

Now let's take simple example on how action potentials are defined.

Action Potential

There are many common activation functions used in neural networks.

1. Softplus

This is defined by formula :

2. ReLU

This is defined by formula :

3. Sigmoid

This is defined by formula :

These curved functions are called activation functions.

By these function we can define how to interpret the inputs given to a neuron.

Any feedback or contributors are welcome! It’s online, source-available, and ready for anyone to use.

⭐ Star git-lrc on GitHub