Concept

Monte Carlo Sampling for Approximating the Predictive Distribution

In the Bayesian viewpoint of prompt ensembling, directly computing the predictive distribution integral for an output y\mathbf{y} is computationally infeasible due to the potentially infinite space of possible prompts x\mathbf{x}. To address this, methods like Monte Carlo sampling are used to approximate the integral. This involves using a manageable, finite set of sample prompts, weighted by their likelihoods given the problem, defined by the prior distribution of prompts Pr(xp)\Pr(\mathbf{x}|p).

0

1

Updated 2026-04-30

Contributors are:

Who are from:

Tags

Ch.3 Prompting - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences