User Tools

Site Tools


concepts:expert_routing

Expert Routing

The mechanism in Mixture-of-Experts architectures that selects which experts process a given input. Typically implemented as a learned gating network producing a sparse distribution over experts. The quality of routing directly affects MoE efficiency and performance.

See also: moe, kimi_linear, attention_residuals

concepts/expert_routing.txt · Last modified: by aethersync

Donate Powered by PHP Valid HTML5 Valid CSS Driven by DokuWiki