Enum Token 

pub enum Token {
    Var(String),
    Iri(String),
    Prefixed(String, String),
    Str {
        value: String,
        lang: Option<String>,
        datatype: Option<String>,
    },
    Num(String),
    Bool(bool),
    Word(String),
    Punct(char),
    Op(&'static str),
    StarOpen,
    StarClose,
}

A lexical token.

Variants

Var(String)

?x or $x — the leading sigil is kept (the full ?x text) so it matches ctx.register_variable’s convention.

Iri(String)

<http://…> — the inner IRI text (angle brackets stripped).

Prefixed(String, String)

prefix:local — kept split so the parser can expand against the prefix map.

Str

A quoted string literal (quotes stripped, \"/\\ unescaped). An optional @lang or ^^<datatype> is carried alongside.

Fields

value: String

lang: Option<String>

datatype: Option<String>

Num(String)

A numeric literal (integer or decimal/double) — kept as text so the parser can choose the inline tag.

Bool(bool)

true / false.

Word(String)

An unquoted word: a keyword (FILTER, OPTIONAL, …), a function name, or the Turtle a shorthand. Case is preserved; callers upper-case to match.

Punct(char)

( ) { } , ; . [ ]

Op(&'static str)

A multi-char or single-char operator: ||, &&, =, !=, <, <=, >, >=, +, -, *, /, !.

StarOpen

<< — opens an RDF-Star quoted triple.

StarClose

>> — closes an RDF-Star quoted triple.

Trait Implementations

impl Clone for Token

fn clone(&self) -> Token

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for Token

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl PartialEq for Token

fn eq(&self, other: &Token) -> bool

Tests for self and other values to be equal, and is used by ==.

fn ne(&self, other: &Rhs) -> bool

Tests for !=. The default implementation is almost always sufficient, and should not be overridden without very good reason.

impl StructuralPartialEq for Token