Intrinsic Evaluation
Intrinsic evaluation is done on small dataset or sometimes without dataset.
The main motivation of intrinsic evaluation is that these subtasks are typically small and fast to compute and therefore help us to judge the system's capability.
Example:
- Next Sentence Prediction or Masked Language Model in BERT
- Perplexity in Autoencoder