Gradient Clipping

#deep-learning #interview

Gradient clipping is used to solve Exploding Gradient issue, where the gradient is clipped to some small values when it crosses a specific threshold value.

References

Related Notes

Autoencoder for Denoising Images
Byte Pair Encoding (BPE)
Contrastive Loss
Logistic Regression vs. Neural Network
GRU