LightGBM

Overview of XGBoost, LightGBM, and CatBoost: Structure and Performance

by
Overview of XGBoost, LightGBM, and CatBoost: Structure and Performance

Selected from Medium Translated by Machine Heart Contributors: Liu Tianci, Huang Xiaotian Despite the resurgence and popularity of neural networks in recent years, boosting algorithms still have indispensable advantages in scenarios with limited training sample sizes, shorter training times, and lack of tuning knowledge. This article compares three representative boosting algorithms: CatBoost, LightGBM, and XGBoost, … Read more

Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

by
Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

Machine Learning Author: louwill Machine Learning Lab Although deep learning is currently very popular, Boosting algorithms represented by XGBoost, LightGBM, and CatBoost still have a wide range of applications. Setting aside deep learning applications suitable for unstructured data such as images, text, speech, and video, Boosting algorithms are still the first choice for structured data … Read more

Understanding XGBoost and LightGBM: Mainstream Ensemble Algorithms

by
Understanding XGBoost and LightGBM: Mainstream Ensemble Algorithms

Click the “Datawhalee” above and select “star” in the official account Get valuable content instantly This is the third article on decision trees, mainly introducing mainstream ensemble algorithms based on the Boosting framework, including XGBoost and LightGBM. Here is the complete mind map: XGBoost XGBoost is a tool for large-scale parallel boosting trees. It is … Read more

Machine Learning Model Iteration Methods (Python)

by
Machine Learning Model Iteration Methods (Python)

Click on 'Xiao Bai Learns Vision' above, select 'Star' or 'Top' 1. Model Iteration Methods In practical applications of machine learning models, the model is usually iterated based on newly added data. Common model iteration methods include the following: 1. Retrain a model using the full dataset by directly merging historical training data with the … Read more

Comparison of Boosting Algorithms: AdaBoost, CatBoost, LightGBM, XGBoost

by

Boosting algorithms are a class of machine learning algorithms that build a strong classifier by iteratively training a series of weak classifiers (usually decision trees). In each round of iteration, the new classifier is designed to correct the errors of the previous classifier, thus gradually improving the overall classification performance. Despite the rise and popularity … Read more

Top 10 Machine Learning Libraries to Bookmark

by
Top 10 Machine Learning Libraries to Bookmark

Source: Machine Learning Algorithms Python is arguably the sharpest weapon for machine learning; conversely, machine learning provides the power to expand influence and recreate brilliance for Python. The two complement each other to such an extent that whenever machine learning is mentioned, people naturally think of Python. Although this perspective may be somewhat narrow, there … Read more

LightGBM: A Gradient Boosting Tree Algorithm for Large-Scale Data

by
LightGBM: A Gradient Boosting Tree Algorithm for Large-Scale Data

1 Algorithm Introduction LightGBM (Light Gradient Boosting Machine, hereinafter referred to as LGBM) is an efficient and scalable machine learning algorithm based on Gradient Boosted Decision Trees (GBDT). As a member of the GBDT framework algorithms and a successor to the XGB algorithm, LGBM effectively integrates a series of advantages from previous GBDT algorithms, including … Read more

Will XGBoost Algorithm Replace Linear Models?

by
Will XGBoost Algorithm Replace Linear Models?

For most data analysts, regression models are undoubtedly one of the fundamental skills. At the beginning of this century, many investment banks used the application of regression models as a standard for evaluating analysts. For over a decade, regression models have maintained a significant presence in all analyses and predictions. However, in recent years, a … Read more

Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

by
Comparison and Tuning of XGBoost, LightGBM, and CatBoost Algorithms

Machine Learning Author: louwill Machine Learning Lab Although deep learning is currently dominant, Boosting algorithms represented by XGBoost, LightGBM, and CatBoost still have a wide range of applications. Excluding the unstructured data applications suitable for deep learning, such as images, text, speech, and video, Boosting algorithms remain the first choice for structured data with fewer … Read more

Comparison of XGBoost and LightGBM for Time Series Prediction

by
Comparison of XGBoost and LightGBM for Time Series Prediction

XGBoost and LightGBM are currently very popular tree-based machine learning models, both demonstrating efficient performance. However, they have different characteristics in certain situations. Simple Comparison of XGBoost and LightGBM Training Speed LightGBM has a significant advantage over XGBoost in terms of training speed. This is because LightGBM uses some efficient algorithms and data structures, such … Read more