Learn Before
Activity (Process)

Averaging Probability Distributions in LLM Ensembling

A straightforward method for ensembling in Large Language Models involves calculating the average of the next-token probability distributions from each individual model. The token with the highest resulting averaged probability is then selected for the final output sequence.

0

1

Updated 2026-05-06

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences