What is ReLU?
Rectified Linear Unit (ReLU) is an activation function defined as f(x) = max(0, x). It helps speed up training and prevents vanishing gradients.
Verify This Answer
Cross-check this information using these trusted sources:
More FAQs in What is a Neural Network? Deep Learning Foundations Explained
A perceptron is the simplest form of a neural network, consisting of a single neuron with inputs, weights, a bias, and an output.
Without activation functions, a neural network is just a giant linear equation, making it incapable of learning complex non-linear patterns.
Generally, any neural network with two or more hidden layers is considered a deep neural network.
Still have questions?
Browse all our FAQs or reach out to our support team