Overfitting - What are symptoms of overfitting?

One telltale sign of overfitting is a low error rate accompanied by a high variance. To avoid this kind of behavior, it is common practice to reserve a subset of the training dataset as a "test set" to ensure that no overfitting has occurred. Overfitting occurs when the error rate on the test data is large compared to the training data, which is low.