University of Michigan - Ann Arbor

An example demonstrating multimodal understanding and step-by-step reasoning involves presenting GPT-4 with a comic panel and the instruction: "Can you explain why this is funny. Think about it step-by-step." The comic depicts a statistical learning practitioner recommending complex, theoretical interventions for overfitting (such as structural risk minimization and loss function modification), contrasted with a neural network practitioner who simply suggests adding more layers. GPT-4 successfully identifies the humor arising from the contrast between theoretical mathematical complexity and the brute-force simplicity of stacking layers, noting that the caption "But unironically" reinforces the joke because adding layers is often effective in practice.

Example of GPT-4 Step-by-Step Visual Humor Explanation

In GPT-4's step-by-step explanation of the comic panel, why does the caption "But unironically" reinforce the joke?

In the comic panel analyzed by GPT-4, what two complex, theoretical interventions does the statistical learning practitioner recommend to address overfitting?

Learn Before

Related