Hi there, I saw a lot of posts saying the XGBoost is naturally immune to multi-collinearity features. However, in my experiment of adding duplicated features with different feature names into the feature set, some of the duplicated features are all selected by the algorithm with different Gain weights. This is very confusing to me.
Duplicate features
Did you try re-training the model with the duplicate feature removed?