In-Depth Analysis of Major Machine Learning Models

In-Depth Analysis of Major Machine Learning Models

Originally from Python Artificial Intelligence Frontier In simple terms, a machine learning model is a type of mathematical function that maps input data to predicted outputs. More specifically, a machine learning model is a mathematical function that adjusts model parameters through learning from training data to minimize the error between predicted outputs and actual labels. … Read more

Summary of Decision Trees, Random Forests, Bagging, Boosting, Adaboost, GBDT, and XGBoost

Summary of Decision Trees, Random Forests, Bagging, Boosting, Adaboost, GBDT, and XGBoost

Official WeChat account of Tsinghua Big Data Software Team Source: Zhihu This article is about 5000 words long, and it is recommended to read for 5 minutes. This article systematically summarizes the related content about decision trees, random forests, etc. 1、Decision Tree A decision tree is a supervised classification model that essentially selects a feature … Read more

XGBoost Split Point Algorithm Explained

XGBoost Split Point Algorithm Explained

Introduction The previous article introduced the algorithm principles of XGBoost and introduced the scoring function (objective function) that measures the quality of tree structures. The best split point is selected based on the scoring function before and after the feature split points, but a detailed introduction to the node splitting algorithm was not provided. This … Read more

Understanding XGBoost and LightGBM: Mainstream Ensemble Algorithms

Understanding XGBoost and LightGBM: Mainstream Ensemble Algorithms

Click on the “MLNLP” above to select the “Star” public account Heavyweight content delivered to you first This article is the third in a series on decision trees, mainly introducing mainstream ensemble algorithms based on the Boosting framework, including XGBoost and LightGBM. Here is the complete mind map: XGBoost XGBoost is a tool for large-scale … Read more

Mathematical Derivation and Pure Python Implementation of Machine Learning Algorithm: XGBoost

Mathematical Derivation and Pure Python Implementation of Machine Learning Algorithm: XGBoost

Click the above “Beginner Learning Vision” to choose to add Star or “Pin” Important content delivered in real-time Since Chen Tianqi proposed XGBoost in 2015, this model has been frequently used as a powerful tool in major data competitions. Its greatest advantages are speed and effectiveness. XGBoost is of the same lineage as GBDT and … Read more

Summary of XGBoost Algorithm Principles

Introduction XGBoost (eXtreme Gradient Boosting) is known as extreme gradient boosting. It is the ace of ensemble learning methods, and most winners in Kaggle data mining competitions have used XGBoost. XGBoost performs exceptionally well in most regression and classification problems. This article provides a detailed introduction to the XGBoost algorithm principles. Table of Contents 1. … Read more

Illustration of Ten Basic Algorithms in Artificial Intelligence

Illustration of Ten Basic Algorithms in Artificial Intelligence

This article provides a general introduction to commonly used algorithms. It does not include code or complex theoretical derivations, but simply illustrates what these algorithms are and how they are applied. Decision Tree Classifies based on certain features by posing a question at each node, dividing the data into two categories, and continuing to ask … Read more

Ultimate Comparison of Machine Learning Algorithms: Tree Models vs Neural Networks

Ultimate Comparison of Machine Learning Algorithms: Tree Models vs Neural Networks

Click the above “Beginner’s Visual Learning” to choose to add Star Mark or “Top” Important content delivered first hand Selected from towardsdatascience Author: Andre Ye Translated by: Machine Heart Editor: Chen Ping The tree model and neural networks are like two sides of a coin. In some cases, the performance of tree models even surpasses … Read more

Reflections on 7 Major Classification Algorithms from an Image Recognition Code

Reflections on 7 Major Classification Algorithms from an Image Recognition Code

Recently, I was preparing some materials on machine vision and implemented a small case while writing code. You can try implementing it yourself. # Import modules import ddddocr # Call the method from the module p=ddddocr.DdddOcr() # Open the image to be recognized with open('picture/img_1.png','rb') as file: # Pass the data stream and store: ddos … Read more

Comprehensive Explanation of XGBoost Algorithm

Comprehensive Explanation of XGBoost Algorithm

This article is a part of Chapter 10 of the book “Introduction to Machine Learning Basics” (by Huang Haiguang). XGBoost Algorithm XGBoost is a machine learning algorithm based on the Gradient Boosting Decision Tree (GBDT) invented in February 2014 by PhD student Chen Tianqi from the University of Washington. This algorithm not only has excellent … Read more