pub struct LoRAAdapter {
pub context_type: ContextType,
pub meta: LoRAMetadata,
pub lora_a: LoRATensor,
pub lora_b: LoRATensor,
}Expand description
A loaded LoRA adapter ready for CPU or GPU application.
Fields§
§context_type: ContextType§meta: LoRAMetadata§lora_a: LoRATensorDown-projection: [rank × n_in]
lora_b: LoRATensorUp-projection: [n_out × rank]
Implementations§
Source§impl LoRAAdapter
impl LoRAAdapter
Sourcepub fn apply_cpu_buffered(
&self,
input: &[f32],
output: &mut [f32],
rank_scratch: &mut [f32],
) -> Result<(), LoRAError>
pub fn apply_cpu_buffered( &self, input: &[f32], output: &mut [f32], rank_scratch: &mut [f32], ) -> Result<(), LoRAError>
Apply the LoRA delta additively to output.
Implements output += lora_b @ (lora_a @ input) * scaling using caller-provided scratch.
inputmust have lengthmeta.n_inoutputmust have lengthmeta.n_out(values are preserved and incremented)rank_scratchmust have length >=meta.rank
Trait Implementations§
Source§impl Clone for LoRAAdapter
impl Clone for LoRAAdapter
Auto Trait Implementations§
impl Freeze for LoRAAdapter
impl RefUnwindSafe for LoRAAdapter
impl Send for LoRAAdapter
impl Sync for LoRAAdapter
impl Unpin for LoRAAdapter
impl UnsafeUnpin for LoRAAdapter
impl UnwindSafe for LoRAAdapter
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more