Evolution of the Term 'Alignment' in NLP
The term 'alignment' has a history in Natural Language Processing, but its meaning has evolved significantly. Traditionally, it described tasks involving the mapping of corresponding elements between two data sets, such as word-for-word alignment in machine translation. With the rise of Large Language Models, the term has adopted a broader meaning: ensuring that a model's outputs conform to human expectations and intentions.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Evolution of the Term 'Alignment' in NLP
The Problem of LLM Misalignment
AI Chatbot Development Strategy
Evaluating the Sufficiency of Prompting in LLM Adaptation
A development team is building a customer service chatbot for a financial institution using a state-of-the-art, general-purpose language model. Through sophisticated prompting, they have enabled the chatbot to answer general queries. However, it consistently fails to follow the institution's strict, multi-step identity verification protocol and sometimes provides financial advice that contradicts company policy. Based on these issues, what is the most likely reason for the chatbot's shortcomings
Learn After
Consider two distinct natural language processing scenarios. Scenario 1 involves a system that maps words in an English sentence to their corresponding words in a French translation. Scenario 2 involves refining a conversational model to ensure its responses are helpful, truthful, and do not produce harmful content. Which statement best analyzes the application of the term 'alignment' in these two scenarios?
The term 'alignment' has been used in Natural Language Processing for different purposes over time. Match each task description to the era in which that definition of 'alignment' was most prominent.
The Problem of LLM Misalignment
Significance of the Evolving Definition of 'Alignment'