Expand description
GPU-accelerated LoRA delta application via wgpu compute shader.
Computes output += B @ (A @ x) * scaling entirely on the GPU,
avoiding a CPU round-trip for the hidden-state delta.
§Bind-group layout (group 0)
| binding | type | content |
|---|---|---|
| 0 | storage rw | output array |
| 1 | storage r | input array |
| 2 | storage r | lora_a array |
| 3 | storage r | lora_b array |
| 4 | uniform | LoraGpuParams |
Structs§
- LoRA
GpuApplicator - Holds the compiled wgpu pipeline for LoRA delta computation.
- Lora
GpuParams