Multiple Choice

A system is generating a series of stored Key-Value (KV) cache states for the input sequence of tokens [A, B, C, D]. One stored state, cache_BC, corresponds to the prefix [A, B]. Another stored state, cache_BCD, corresponds to the prefix [A, B, C]. What is the relationship between cache_BC and cache_BCD?

0

1

Updated 2025-10-02

Contributors are:

Who are from:

Tags

Ch.5 Inference - Foundations of Large Language Models

Foundations of Large Language Models

Foundations of Large Language Models Course

Computing Sciences

Analysis in Bloom's Taxonomy

Cognitive Psychology

Psychology

Social Science

Empirical Science

Science