Personalized AI apps
Build multi-agent systems without code and automate document search, RAG and content generation
Start free trial Question
Rectified Linear Unit - What is the formula for ReLU?
Answer
The notion of Rectified Linear Units, or ReLU for short, is one that has just recently emerged. Maximizing the value of z is a very simple formula. It is not, in fact, linear, despite appearances to the contrary. It improves upon the Sigmoid function in efficiency while maintaining its benefits, such as learning nonlinear functions.
