Log-cosh Loss
- Similar to Huber Loss but without the hyperparameter
- It also behaves like squared error for small values and absolute error for larger values.
Log-cosh Loss Formula
Pros:
- Benefits of Huber Loss with twice differentiability
- Fewer computation than Huber Loss
Cons:
- Compared to Huber Loss, more complex Derivative