On what specific format of standardized exam sections were the base pre-trained and post-RLHF GPT-4 models evaluated to compare their benchmark capabilities?
0
1
Tags
Prep Sessions
Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Ch.2 Model Scaling and Capability Evaluation - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Academic and Professional Exam Benchmarks - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Ch.3 Model Alignment and Safety - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Impact of RLHF on Model Capability - Transformer Architecture and Large Language Model Capabilities @ University of Michigan - Ann Arbor
Related
When evaluated on multiple-choice standardized exam sections, what average score is achieved by the base pre-trained GPT-4 model?
Empirical evaluation shows that GPT-4's standardized exam benchmark capabilities originate primarily from post-training alignment rather than pre-training.
Based on empirical evaluations on standardized exam benchmarks, what effect does reinforcement learning from human feedback (RLHF) have on the fundamental capabilities acquired by GPT-4 during pre-training?
In empirical evaluations of GPT-4, which finding provides evidence that standardized exam performance originates primarily in pre-training rather than post-training alignment?
On what specific format of standardized exam sections were the base pre-trained and post-RLHF GPT-4 models evaluated to compare their benchmark capabilities?
Evaluation Asymmetry in Base and RLHF Free-Response Comparison