GBDT

Understanding CatBoost Alongside XGBoost and LightGBM

by
Understanding CatBoost Alongside XGBoost and LightGBM

This article provides an overview of the content: 1. Introduction to CatBoost CatBoost is a machine learning library open-sourced by the Russian search giant Yandex in 2017 and is a type of Boosting algorithm. CatBoost, along with XGBoost and LightGBM, is known as one of the three mainstream tools for GBDT, all of which are … Read more

An Explanation and Derivation of the XGBoost Algorithm

by
An Explanation and Derivation of the XGBoost Algorithm

This article is excerpted from “Introduction to Machine Learning Basics (Micro Course Version)” 10.5 XGBoost Algorithm XGBoost is a machine learning algorithm based on the gradient boosting algorithm (GBDT) invented by PhD student Tianqi Chen from the University of Washington in February 2014. This algorithm not only has excellent learning performance but also trains efficiently, … Read more