Gradient Clipping

Gradient clipping is used to solve Exploding Gradient issue, where the gradient is clipped to some small values when it crosses a specific threshold value.


References


Related Notes