gavin/developer-roadmap
1
0
Fork 0
mirror of https://github.com/kamranahmedse/developer-roadmap.git synced 2026-03-12 17:51:53 +08:00
Code Issues Packages Projects Releases Wiki Activity

chore: sync content to repo

Browse Source
This commit is contained in:
kamranahmedse
2025-11-24 16:40:27 +00:00
committed by github-actions[bot]
parent 674e0e77fb
commit 9eaa1885b3
1 changed files with 4 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
src/data/roadmaps/machine-learning/content/gradient-boosting-machines@JuTTbL_pm1ltGvhUsIzQd.md
View File

@@ -1,9 +1,11 @@
# Gradient Boosting Machines
Gradient Boosting Machines (GBMs) are a type of ensemble learning algorithm that combines the predictions from multiple weaker models, typically decision trees, to create a stronger, more accurate model. The algorithm works iteratively, with each new tree trained to correct the errors made by the previous trees. This correction is achieved by focusing on the instances that were poorly predicted by the existing ensemble, effectively "boosting" the performance on those difficult cases. The final prediction is made by aggregating the predictions of all the trees in the ensemble.
Gradient Boosting Machines are a type of ensemble learning method that combines multiple weak learners, typically decision trees, to create a strong predictive model for classification tasks. The algorithm works iteratively, with each new tree trained to correct the errors made by the previous trees. This is achieved by focusing on the instances that were misclassified in the previous iterations, effectively "boosting" the performance of the model. Popular implementations of gradient boosting include XGBoost, LightGBM, CatBoost, and the original GradientBoostingClassifier, each offering variations in regularization, tree growth strategies, and handling of categorical features.
Visit the following resources to learn more:
- [@article@Gradient Boosting Classifier | scikit-learn](https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.GradientBoostingClassifier.html)
- [@article@A Guide to The Gradient Boosting Algorithm](https://www.datacamp.com/tutorial/guide-to-the-gradient-boosting-algorithm)
- [@video@Gradient Boosting in Scikit-Learn: Hands-On Tutorial](https://www.youtube.com/watch?v=E2mCaIZNE2g)
- [@article@Boosting Algorithms in Machine Learning, Part I: AdaBoost](https://medium.com/data-science/boosting-algorithms-in-machine-learning-part-i-adaboost-b9d86041a521)
- [@article@Boosting Algorithms in Machine Learning, Part II: Gradient Boosting](https://towardsdatascience.com/boosting-algorithms-in-machine-learning-part-ii-gradient-boosting-c155ae505fe9/)
- [@article@Gradient Boosting in Scikit-Learn: Hands-On Tutorial](https://www.youtube.com/watch?v=E2mCaIZNE2g)