What is Pruning?
Pruning
On this page
Pruning
Decision trees are notoriously famous for overfitting. Pruning is a regularization method which penalizes the length of tree, i.e. increases the value of cost function.
Pruning is of two types:
- Post Pruning(Backward Pruning): Full tree is generated and then the non-significant branches are pruned/removed.
- Pre Pruning(Forward Pruning): This approach stops the non-significant branches from generating.