A perceptron is the simplest form of a neural network, consisting of a single neuron with inputs, weights, a bias, and an output.
What is a Neural Network? Deep Learning Foundations Explained
What is a perceptron?
The answer
More FAQs in What is a Neural Network? Deep Learning Foundations Explained
Without activation functions, a neural network is just a giant linear equation, making it incapable of learning complex non-linear patterns.
Rectified Linear Unit (ReLU) is an activation function defined as f(x) = max(0, x). It helps speed up training and prevents vanishing gradients.
Generally, any neural network with two or more hidden layers is considered a deep neural network.
Still have questions?
Browse all our FAQs or reach out to our support team
Want to upskill yourself?
Your learning library
Small steps. Big possibilities.
Find your next course. Build something great.