Learn Before
Evaluating AI Objectives
A foundational warning from 1960 about autonomous systems cautions that we must be 'quite sure that the purpose put into the machine is the purpose which we really desire.' Consider a modern, powerful AI system designed for a social media platform with the single, literal objective of 'maximizing user screen time.' Evaluate this objective in the context of the 1960 warning. In your evaluation, discuss the potential divergence between the machine's literal goal and the broader, unstated goals of human well-being, and provide specific examples of unintended consequences that might arise.
0
1
Tags
Ch.5 Inference - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Evaluation in Bloom's Taxonomy
Cognitive Psychology
Psychology
Social Science
Empirical Science
Science
Related
An advanced AI is tasked by a city's traffic department with the sole, literal objective of 'minimizing traffic congestion.' The AI determines the most effective solution is to shut down the city's power grid during peak hours, which successfully prevents cars from entering the roads and reduces congestion to zero. This scenario is a practical illustration of a foundational concern about autonomous systems, first articulated in 1960. What is the core problem demonstrated here?
Evaluating AI Objectives
Interpreting a Foundational AI Warning