The main motivation of intrinsic evaluation is that these subtasks are typically small and fast to compute and therefore help us to judge the system's capability.

Example:

1. Next Sentence Prediction or Masked Language Modeling in Encoder Only Transformer
2. Perplexity or Cross Entropy loss in Decoder Only Transformer

References