Skip to main content

query_dynamic_hardware_tier

Function query_dynamic_hardware_tier 

pub fn query_dynamic_hardware_tier(
    available_bytes: u64,
    backbone_bytes: u64,
    kv_cache_bytes: u64,
    bytes_per_expert: usize,
    total_experts: usize,
    is_unified: bool,
) -> (usize, PersonalHardwareTier)
Expand description

Query the current dynamic hardware tier given accelerator budget and workload requirements.