Mixture‑of‑Experts Token Routing
Route tokens
Layer:
0
Play
Active experts:
7
of 385
Active parameters:
3.46B
of 78B
(~4.4% active)