Module xxcalc::tokenizer [] [src]

Tokenizer is a StringProcessor, it takes string expression and converts it into Tokens for further processing.

Structs

Tokenizer

Tokenizer performs the very first step of parsing mathematical expression into Tokens. These tokens can be then processed by TokensProcessor.