Feature Scaling is useful for models that use distances like SVM and K-means
When Scaling Is Unnecessary
- Tree-based Algorithms:
- Algorithms like Decision Tree, Random Forests, and Gradient Boosted Trees are invariant to feature scaling because they split data based on thresholds, not distances.
- Example: Splits are determined by feature values, not their magnitude.
- Data with Uniform Scales:
- If all features have the same range or are already normalized (e.g., percentages), scaling may not be required.