What is ReLU?
Rectified Linear Unit (ReLU) is an activation function defined as f(x) = max(0, x). It helps speed up training and prevents vanishing gradients.
Explore This Question
Search for additional explanations using these tools:
More FAQs in What is a Neural Network? Deep Learning Foundations Explained
A perceptron is the simplest form of a neural network, consisting of a single neuron with inputs, weights, a bias, and an output.
Without activation functions, a neural network is just a giant linear equation, making it incapable of learning complex non-linear patterns.
Generally, any neural network with two or more hidden layers is considered a deep neural network.
Still have questions?
Browse all our FAQs or reach out to our support team