SourcePro Core
:
Internationalization Module User’s Guide
:
Boundary Analysis and Tokenizing
: Tokenizing
Tokenizing
RWUTokenizer
finds delimiters in source strings, and provides sequential access to the tokens between those delimiters.
This site works best with JavaScript enabled