Hey Guys!
This is my first post in a long time so forgive my noobiness.
I am using xgoost with the following parameters:
params = {‘objective’:‘binary:logistic’, ‘colsample_bytree’: 0.3,‘learning_rate’: 0.1,
‘max_depth’: 5, ‘alpha’: 10, ‘n_estimators’:10}
The task is to classify real from bogus events.
I have a small number of real events as the data is from a telescope that measures spectroscopic information of stars.
I have a large set of bogus events.
My test dataset has 43000 bogus events and 0 real events.
My training data is 206 real events and 164 bogus events.
While using v0.90, I got great results with a warning:
/home/astrolearner/anaconda3/lib/python3.7/site-packages/xgboost/core.py:587: FutureWarning: Series.base is deprecated and will be removed in a future version
if getattr(data, ‘base’, None) is not None and
/home/astrolearner/anaconda3/lib/python3.7/site-packages/xgboost/core.py:588: FutureWarning: Series.base is deprecated and will be removed in a future version
data.base is not None and isinstance(data, np.ndarray) \
xgboost was installed with pip on ubuntu and am using it with python.
I found that the .base class was being depreciated, the issue is closed and fixed.
So I uninstalled v0.90 and got xgboost from git and enabled it in anaconda.
That solved the warning but my classifier became worse with no change to my code.
My test data which was giving me 2254 false positives is now giving me ~23000 FPs.
I have downgraded and I can live with the warning but I want to find out what is happening?
Happy to provide more information on request,