Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

Author: louwill Although deep learning is currently very popular, Boosting algorithms represented by XGBoost, LightGBM, and CatBoost still have a wide range of applications. Leaving aside the applications of deep learning suitable for unstructured data such as images, text, speech, and video, Boosting algorithms remain the first choice for structured data with fewer training samples. … Read more

Understanding CatBoost Alongside XGBoost and LightGBM

Understanding CatBoost Alongside XGBoost and LightGBM

This article provides an overview of the content: 1. Introduction to CatBoost CatBoost is a machine learning library open-sourced by the Russian search giant Yandex in 2017 and is a type of Boosting algorithm. CatBoost, along with XGBoost and LightGBM, is known as one of the three mainstream tools for GBDT, all of which are … Read more

Understanding Machine Learning Model Explanations with R

Understanding Machine Learning Model Explanations with R

1. Introduction In the field of machine learning, the interpretability of models has always been an important research direction. Today, we would like to introduce a powerful R package — explainer, which provides strong support for understanding complex classification and regression models. This package mainly achieves detailed interpretation of complex models through Shapley analysis, which … Read more