Essay

Analyze the role of the pre-discovered candidate list in single-pass LRU victim selection during edge MoE serving. Explain how the miss handler processes runtime cache misses using this list, and explain why the condition qKq \le K is essential to the policy's operational guarantees.

0

1

Updated 2026-09-07

Tags

Prep Sessions

Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

Ch.3 Adaptive Runtime Policies and Device Execution - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

CUDA-Graph-Compatible Device-Side Cache Execution - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor