Function query_dynamic_hardware_tier
pub fn query_dynamic_hardware_tier(
available_bytes: u64,
backbone_bytes: u64,
kv_cache_bytes: u64,
bytes_per_expert: usize,
total_experts: usize,
is_unified: bool,
) -> (usize, PersonalHardwareTier)Expand description
Query the current dynamic hardware tier given accelerator budget and workload requirements.