Learn Before
Adaptive Advice Ordering by Estimated Correctness Likelihood
Ma and colleagues’ Adaptive Workflow changes the order of human and AI decisions using estimated correctness likelihoods. When the estimated human likelihood is higher, the user gives an initial judgment before viewing AI advice. When the estimated AI likelihood is higher, advice appears immediately. The user always makes the final decision. In an income-classification experiment with 289 valid responses, this workflow improved final accuracy compared with an AI-confidence-only interface. That result is specific to the tested task. Estimated likelihoods can be wrong, and the authors identify possible confirmation bias after an initial judgment. Ma and colleagues (2023)
0
1
Tags
Ch.3 Prompting - Foundations of Large Language Models
Foundations of Large Language Models
Foundations of Large Language Models Course
Computing Sciences
Related
Proactive Engagement with AI Ethics
Evaluating an AI-Generated Summary
A user is interacting with an AI chatbot to get financial advice. The user describes their financial situation, and the AI provides a detailed investment strategy, including specific stock recommendations. Based on the principles of responsible and critical AI use, which of the following user actions demonstrates the most sound judgment?
Analyzing AI Use in Academic Work
Cognitive Forcing in a Meal-Substitution Experiment
Adaptive Advice Ordering by Estimated Correctness Likelihood