Module llm_testing 

LLM Testing Integration for CLI

Simple LLM model testing functionality for the CLI.

Structs

ExploreCandidateResult

One explore-row: layout (+ optional toggle label) → measured decode-proxy tok/s + coherence.

ExploreReport

TestResult

Test result

Functions

benchmark_model

CLI command to benchmark a single model

list_models

CLI command to list available models

parse_explore_layouts 🔒

run_app_profile

Show / set application profile (interactive | live-fast | batch).

run_benchmark_models

CLI command to benchmark models

run_comprehensive_llm_test

Comprehensive LLM capability test (load + inference in one session)

run_convert_gguf_to_p64

Convert a GGUF import file to native .p64 + canonical .q42 model metadata.

run_cuda_tc_microbench

Dense CUDA WMMA microbench (mode-independent; reports whether TC path is live).

run_decode_proxy

Short resident decode for passport child processes. Machine-readable line on stdout.

run_explore_pipeline

Phase-0 explorer: convert missing layouts if source is GGUF, measure decode-proxy, rank, write JSON.

run_generate_report

CLI command to generate test report

run_gpu_capability_campaign

Probe which native GPU tiers this host has, measure the backend × mode decode matrix in child processes, and write machine-gpu-profile.json + apply-machine-gpu.ps1.

run_ground_check

Quant-graph dry-run: ground a prompt+answer pair (forces mode logic via unconditional ground).

run_hardware_passport

Probe / load HardwarePassport and print the ranked circuit matrix.

run_inference_mode

Print or set multi-mode inference approach (portable / cuda / quant-graph).

run_lab

Inference superiority lab instruments.

run_optimize_pipeline

Remarkable one-shot: optional passport + auto-layout convert + activate knobs.

run_path_select

Print (and optionally apply) the device-optimal inference path plan.

run_seed_grounding

Seed quant-graph facts from bundled TSV / QUALIA_GROUNDING_FACTS.

run_test_models

CLI command to run comprehensive LLM model tests

run_validate_models

CLI command to validate models

test_single_model 🔒

Test a single model

validate_model

CLI command to validate model structure