Regularization - What is L1 and L2 regularization?

L1 regularization penalizes the absolute total of the weights, whereas L2 regularization penalizes the square sum of the weights. While L2 regularization yields a non-sparse solution, L1 regularization yields a sparse one.