Gradient Boosting
Compared to Adaboost
- Gradient Boost also have multiple classifier but this type the depth can be more than 1, in other words they are not Stump, they can be tree (but still limited depth - usually 8-32)
- Gradient Boost also scales the classifier but unlike Adaboost it scales all the tree to same value
There are 2 types of gradient boost depending on the task