Named Entity Recognition (NER)
The key task of NER is to identify and classify entities from a text into pre-defined categories like person names, locations, organizations, dates, quantities and many more.
NER works on 2 stages:
- Identification: first find out the boundary of the current entity (start, end)
- Classification: then classify the current selected boundary into one of the categories
Methods:
- Rule based approaches: using patterns or dictionaries
- Statistical models: Hidden Markov Model, Conditional Random Field
- Neural network based methods: Transformer, RNN, LSTM, BERT
Applications:
- Information extraction
- Customer report generation
- Search engine
- News aggregation