Rewrite the whole xgboost in rust without any c/c++


#1

I want to rewrite the whole xgboost in rust without any single line of c/c++ code. Because my work asks me to do that. I am not familiar with c++ which xgsboost source code uses, and that is the problem for me. Anyone has any advice for me? Any code or paper, except a scalable tree boosting system?


#2

This is the KDD paper written back in 2016 for XGBoost: https://www.kdd.org/kdd2016/papers/files/rfp0697-chenAemb.pdf

I also wrote a master’s thesis on XGBoost, and it contains a pseudocode for the XGBoost training algorithm: https://drive.google.com/file/d/0B0c0MbnP6Nn-eUNRRkVOOGpkbFk/view.

For a runnable example, see https://github.com/eriklindernoren/ML-From-Scratch/blob/master/mlfromscratch/supervised_learning/xgboost.py.


#4

Thx, Philip. It’s really helpful. I’ll check all of them.


#5

You might also have a look at this high performance Python + Numba implementation of XGBoost: