Multiple Choice

A system encounters m=12m = 12 missing experts during decode, with PCIe bandwidth BP=32 GB/sB_P = 32\text{ GB/s} and host bandwidth BH=128 GB/sB_H = 128\text{ GB/s}. Based on the optimal execution policy, how many missing experts should be routed to the concurrent PCIe cache-fill branch?

0

1

Updated 2026-09-07

Tags

Prep Sessions

Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

Ch.3 Adaptive Runtime Policies and Device Execution - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor

Bandwidth-Adaptive Decode and the q* Execution Policy - Edge-Native Mixture-of-Experts Serving with FreeToken @ University of Michigan - Ann Arbor