Struct AttentionSchedule
pub struct AttentionSchedule {
pub workgroup_size: u32,
pub context_tile: u32,
pub vector_width: u32,
}Expand description
A hardware-safe attention schedule. The generated kernel uses one workgroup per attention head and an online tiled reduction over context.
Fields§
§workgroup_size: u32§context_tile: u32§vector_width: u32Implementations§
§impl AttentionSchedule
impl AttentionSchedule
pub const fn a2000_decode() -> AttentionSchedule
pub const fn a2000_decode() -> AttentionSchedule
Ampere/A2000 schedule for batch-one decode: four warps, one context score per lane, and scalar value accumulation to keep register pressure bounded under the 64-register kill criterion.
pub const fn a2000_prefill() -> AttentionSchedule
pub const fn a2000_prefill() -> AttentionSchedule
Ampere/A2000 prefill schedule: eight warps, with a 256-token score tile.
pub fn validate(self, shape: AttentionShape) -> Result<(), ForgeError>
pub fn validate(self, shape: AttentionShape) -> Result<(), ForgeError>
Validates internal consistency; error on violation.
pub const fn forge_schedule(self) -> Schedule
pub const fn forge_schedule(self) -> Schedule
Compatibility view for generic Forge scheduling/reporting APIs.
Trait Implementations§
§impl Clone for AttentionSchedule
impl Clone for AttentionSchedule
§fn clone(&self) -> AttentionSchedule
fn clone(&self) -> AttentionSchedule
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for AttentionSchedule
§impl Debug for AttentionSchedule
impl Debug for AttentionSchedule
impl Eq for AttentionSchedule
§impl PartialEq for AttentionSchedule
impl PartialEq for AttentionSchedule
impl StructuralPartialEq for AttentionSchedule
Auto Trait Implementations§
impl Freeze for AttentionSchedule
impl RefUnwindSafe for AttentionSchedule
impl Send for AttentionSchedule
impl Sync for AttentionSchedule
impl Unpin for AttentionSchedule
impl UnsafeUnpin for AttentionSchedule
impl UnwindSafe for AttentionSchedule
Blanket Implementations§
§impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
impl<S, A> Aggregate<Result<S, Error>> for Awhere
A: Aggregate<S>,
Aggregate shares in an MPC protocol.
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
impl<ST, DT> CastableFrom<ST, Initialized, Initialized> for DT
impl<ST, DT> CastableFrom<ST, Uninit, Uninit> for DT
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
fn instrument(self, span: Span) -> Instrumented<Self> ⓘ
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
fn into_either(self, into_left: bool) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self> ⓘ
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more