finesse.script.highlighter.KatScriptPygmentsLexer.get_tokens_unprocessed

KatScriptPygmentsLexer.get_tokens_unprocessed(text)

Return an iterable of (index, tokentype, value) pairs where “index” is the starting position of the token within the input text.

In subclasses, implement this method as a generator to maximize effectiveness.