Google

Named Entity Recognition (NER) is a foundational task in Natural Language Processing and a subfield of Information Extraction. It involves a process that automatically detects and classifies key pieces of information, known as named entities, from unstructured text into predefined groups or categories.

Definition of Named Entity Recognition

Named entity tagging is a useful first step in lots of natural language processing
tasks. In sentiment analysis we might want to know a consumer’s sentiment toward a particular entity. Entities are a useful first stage in question answering, or for linking text to information in structured knowledge sources like Wikipedia. And named entity tagging is also central to tasks involving building semantic representations, like extracting events and the relationship between participants.

Application and Advantages

Named entity recognizers are evaluated by recall, precision, and F1 measure.


We can also use the paired bootstrap test to measure if the difference of the F1 score between two systems is significant or not.


Importantly, the unit of response in the NER models should match between training and test conditions. In fact, NER has a segmentation component to separate the unit of response.


Evaluation of NER


The NER task  often applies the rule-base methods in the commercial to be more efficient.
Basically, it uses high-precision rules to tag entities and then applies supervised sequence labeling techniques that use tags from previous stages as additional features.


Rule-based Methods


A crucial step after training a Named Entity Recognition (NER) model is to determine the best possible sequence of labels for a given input. This inference problem is a well-established challenge in NLP. A common and efficient solution involves using dynamic programming algorithms. This method, which is analogous to finding the optimal path through a lattice of potential tags, operates with linear complexity.

Finding the Optimal Label Sequence in NER

Named entities are the specific pieces of key information identified and classified during the Named Entity Recognition (NER) process. They typically consist of proper names that refer to real-world objects and are sorted into distinct, predefined classes. Common categories for these entities include people, locations, organizations, dates, monetary values, and percentages.

Named Entities

Relation extraction is an information extraction task focused on identifying and classifying the semantic relationships between named entities that have already been identified in a text. It serves as a subsequent processing step after Named Entity Recognition (NER), using the extracted entities as a foundation for discovering how they are connected.

Relation Extraction

This diagram illustrates a common architecture for Named Entity Recognition (NER) using BERT, which is a direct application of the sequence labeling approach. An input sequence of tokens ($x_1, x_2, ..., x_m$), prepended with a `[CLS]` token and appended with a `[SEP]` token, is converted into embeddings ($e_i$) and fed into the BERT model. BERT processes the entire sequence and outputs a contextualized hidden state vector ($h_i$) for each token. For the NER task, a separate classification layer is applied to each token's hidden state (e.g., $h_1$ through $h_m$) to predict a corresponding tag from a predefined set, such as {B, I, O} (Begin, Inside, Outside).

Illustration of BERT-based Architecture for Named Entity Recognition

A financial technology company is developing a tool to automatically process business news articles. The goal is to extract specific pieces of information from each article, such as company names, monetary values, and dates, and categorize them accordingly (e.g., 'Apple Inc.' as an ORGANIZATION, '$2.7 billion' as MONEY, 'October 26, 2023' as a DATE). Which of the following processes best describes this core task of identifying and classifying these specific pieces of information?

A marketing team wants to analyze thousands of customer feedback emails to understand which specific products and competitor brands are being mentioned most frequently. They need a system that can automatically find these names in the text and label them as either 'Our Product' or 'Competitor Brand'.

The team is evaluating two automated systems:

*   **System A:** Reads each email and assigns it an overall score from -1 (very negative) to +1 (very positive).
*   **System B:** Reads each email, identifies specific product and brand names, and assigns a category label (e.g., 'Our Product', 'Competitor Brand') to each identified name.

Which system should the marketing team choose to achieve their specific goal? Justify your choice by describing the fundamental task that the correct system performs.

Choosing the Right Text Processing Approach

A basic Named Entity Recognition (NER) task can focus on extracting a single category of entities, such as person names. For example, if a system is instructed to 'Identify all person names' in the text 'For Tom Jenkins, CEO of the European Tourism Organisation, it’s the latter...', it would process the text and produce an output that pairs the identified entity with its classification, such as 'Tom Jenkins - Person Name'. This demonstrates a fundamental NER application focused on a single entity type.

Simple Example of an NER Task: Extracting Person Names

A fundamental task in Named Entity Recognition (NER) is the identification and categorization of multiple entity types within a single text. This process requires a system to locate all named entities and assign them to predefined classes. The final output is typically a structured list where each identified entity is explicitly paired with its assigned category. For example, a system might be given the instruction: 'Identify and classify all named entities in the provided text into categories such as person names, locations, dates, and organizations. List each entity with its type on one line.'

Multi-Category Named Entity Recognition Task

Analyze the sentence below. Identify three distinct pieces of information that are proper names referring to specific things like people, places, or groups. For each piece of information you identify, assign it to a logical category (e.g., Person, Organization, Location, Date) and briefly explain why you chose that category.

Sentence: 'On March 15, 2021, the CEO of InnovateCorp, Dr. Evelyn Reed, announced a new research facility would be built in Geneva.'

Deconstructing Text for Specific Information

A Named Entity Recognition (NER) model generates a probability distribution over the available tag set for each position in an input sequence. For a sequence of length $$m$$, the model outputs distributions $$\mathbf{p}_1, \dots, \mathbf{p}_m$$, where each $$\mathbf{p}_i$$ indicates the likelihoods of various tags for the token at position $$i$$. The model's training and fine-tuning are conducted using these position-wise distributions.

Learn Before

Related