Tokenizing

RWUTokenizer finds delimiters in source strings, and provides sequential access to the tokens between those delimiters.

In this section: