Evaluating Web-Scraped Text for Training Data
A data science team is considering using the following text snippet, scraped from an unverified online forum, as part of a training dataset for a new language model. Analyze the text and identify two distinct types of data quality issues present that would be detrimental to the model's performance and reliability. For each issue, explain the negative impact it could have on the trained model.
0
1
Tags
Ch.2 Generative Models - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Analysis in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
Impact of AI-Generated Content on Data Collection
Evaluating Web-Scraped Text for Training Data
Critique of Unfiltered Web Data for LLM Training
An AI development team is creating a training dataset for a new LLM intended for use in educational settings. They have a large corpus of data scraped from various online forums and blogs. Which of the following data quality issues presents the most critical and immediate challenge to the model's suitability for its intended purpose?
An LLM development team is analyzing a large dataset scraped from the internet. Match each type of data quality issue they might encounter with its most accurate description and impact on the model.