Curse Of Dimensionality - What is the curse of dimensionality rule?

When the number of dimensions in a training dataset with a fixed size increases, the feature space gets progressively sparser; this phenomena is also described by the curse of dimensionality. Our first inclination is to believe that in a high-dimensional space, not even the nearest neighbors could provide a reliable estimate due to their great distance.