Checkout
Start free trial
Take Naologic for a spin today, no credit card needed and no obligations.
Start free trial
Question

Learning Rate - Is learning rate 0.1 too high?

Answer

Larger learning rates can reduce the number of training epochs required. Smaller batch sizes are more compatible with smaller learning rates due to the imprecise estimate of the error gradient. A conventional starting point for the learning rate could be 0.1 or 0.01, which might be a suitable initial point for your problem.