The **slot error rate** (also known as the concept error rate) is an objective metric that can be included in measuring task completion success. It is the percentage of slots filled with correct values per sentence, calculated as:

$$slot error rate = \frac{inserted, deleted, or substituted slots}{total reference slots}$$

Google

Task completion success is a measure of the total correctness of a solution provided by a task-oriented dialogue agent. Often, a user's perception of whether they completed the task is a better predictor of user satisfaction than actual objective task completion success.

Task Completion Success

An on-going but a helpful book resource about NLP
https://web.stanford.edu/~jurafsky/slp3/

Learn Before

Related