1. A junior data scientist is performing EDA on a dataset in Amazon SageMaker Studio. They want to identify features most useful for predicting a binary target variable. They compute the Pearson correlation between each numeric feature and the binary target (0/1), rank features by absolute correlation, and drop features with correlation below 0.1. A senior colleague raises a concern about this approach. Which of the following BEST describes the senior colleague's concern?
- A. Pearson correlation is only valid for measuring linear relationships, so features with strong non-linear relationships to the target would be incorrectly discarded✓ Correct
- B. Pearson correlation cannot be computed between numeric features and a binary target variable in Python
- C. Features with low Pearson correlation to the target are never useful in any machine learning model
- D. The Pearson correlation coefficient ranges from -1 to 1, so a threshold of 0.1 is mathematically invalid
Explanation
The key limitation of Pearson correlation for feature selection is that it only captures linear relationships. A feature could have a strong non-linear, monotonic, or interaction-based relationship with the target while showing near-zero Pearson correlation, meaning it would be incorrectly dropped. Alternatives like Spearman correlation, mutual information, or tree-based feature importance capture non-linear associations. Pearson correlation can technically be computed between a numeric feature and a 0/1 encoded binary target (it becomes a point-biserial correlation), so option B is factually incorrect. Features with low pairwise correlation to the target can still be useful when combined with other features (interaction effects), making option C incorrect. A threshold of 0.1 on a [-1, 1] scale is mathematically valid (it simply means low absolute linear correlation), so option D is incorrect.