Struct MoeRoutingConfig
pub struct MoeRoutingConfig {
pub num_routed_experts: usize,
pub num_experts_per_tok: usize,
pub norm_topk_prob: bool,
pub num_shared_experts: usize,
}Expand description
Configuration for MoE routing.
Fields§
§num_routed_experts: usizeTotal number of routed experts (e.g. 256 for Qwen3.6-35B).
num_experts_per_tok: usizeActive experts routed per token (e.g. 8 for Qwen3.6-35B).
norm_topk_prob: boolWhether to apply softmax normalization across the selected top-k.
Number of shared experts evaluated on all tokens.
Implementations§
§impl MoeRoutingConfig
impl MoeRoutingConfig
pub const fn qwen3_6_35b() -> MoeRoutingConfig
pub const fn qwen3_6_35b() -> MoeRoutingConfig
Canonical Qwen3.6-35B-A3B MoE configuration: 256 routed experts, top-8 selection, softmax-normalized, 1 shared expert.
Trait Implementations§
§impl Clone for MoeRoutingConfig
impl Clone for MoeRoutingConfig
§fn clone(&self) -> MoeRoutingConfig
fn clone(&self) -> MoeRoutingConfig
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for MoeRoutingConfig
§impl Debug for MoeRoutingConfig
impl Debug for MoeRoutingConfig
impl Eq for MoeRoutingConfig
§impl PartialEq for MoeRoutingConfig
impl PartialEq for MoeRoutingConfig
impl StructuralPartialEq for MoeRoutingConfig
Auto Trait Implementations§
impl Freeze for MoeRoutingConfig
impl RefUnwindSafe for MoeRoutingConfig
impl Send for MoeRoutingConfig
impl Sync for MoeRoutingConfig
impl Unpin for MoeRoutingConfig
impl UnsafeUnpin for MoeRoutingConfig
impl UnwindSafe for MoeRoutingConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more