Skip to main content Skip to docs navigation

What is Pruning?

Pruning

On this page

Pruning

Decision trees are notoriously famous for overfitting. Pruning is a regularization method which penalizes the length of tree, i.e. increases the value of cost function.

Pruning is of two types:

  1. Post Pruning(Backward Pruning): Full tree is generated and then the non-significant branches are pruned/removed.
  2. Pre Pruning(Forward Pruning): This approach stops the non-significant branches from generating.