Gradient Clipping

#deep-learning #interview

Gradient clipping is used to solve Exploding Gradient issue, where the gradient is clipped to some small values when it crosses a specific threshold value.

References

Related Notes

Swallow vs. Deep Learning
Differentiation
Problem Solving Algorithm Selection
Active Learning