Example of Prompting Failure Due to Lack of Pre-Training Data
An example illustrating the limits of prompting is the task of translating words from Inuktitut to English using a Large Language Model that was not pre-trained on Inuktitut data. In this situation, the model's lack of foundational knowledge of the source language renders it incapable of performing the translation, no matter how well-crafted the prompt is.
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Computing Sciences
Foundations of Large Language Models Course
Related
Example of Prompting Failure Due to Lack of Pre-Training Data
A research team is using a large, general-purpose language model to summarize newly discovered ancient texts written in a rare, previously untranslated dialect. The team has spent weeks crafting highly detailed instructions and providing the model with several hand-translated examples within the input. Despite these efforts, the model consistently produces summaries that are nonsensical or completely unrelated to the text. What is the most likely reason for the model's failure and the most effec
Diagnosing LLM Performance in a Specialized Domain
Evaluating Strategies for a Novel Domain