Evaluating a Data Sourcing Strategy for a Specialized AI
A company is developing a highly specialized AI assistant to provide certified financial advice. They are considering fine-tuning a large language model by sourcing a massive dataset of question-and-answer pairs from public, general-interest financial forums on the internet. Critically evaluate this data sourcing strategy for this specific application. In your evaluation, you must identify and explain one major advantage and two significant potential risks or drawbacks.
0
1
Tags
Ch.4 Alignment - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Sourcing Fine-Tuning Data from Q&A Websites
Evaluating a Data Sourcing Strategy for a Specialized Chatbot
A small startup with limited resources is fine-tuning a large language model to create a general-purpose, open-domain question-answering chatbot. Considering their constraints, which statement best analyzes the primary advantage of sourcing fine-tuning data from naturally occurring question-and-answer pairs on public websites?
Evaluating a Data Sourcing Strategy for a Specialized AI