Essay

Explain the mathematical derivation used to determine the optimal expert cache-fill count qq^* for serving mm missing experts of size SS. Include the expressions for both concurrent branches, how they are equated, and the resulting closed-form policy.

0

1

Updated 2026-09-07

Tags

Prep Sessions

Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

Ch.3 Adaptive Runtime Policies and Device Execution - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

Bandwidth-Adaptive Decode and the q* Execution Policy - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor