class documentation
class ITokenizer(Protocol[
Known subclasses: pydoctor.epydoc.markup._types.NodeTokenizer, pydoctor.napoleon.docstring.Tokenizer
Constructor: ITokenizer(annotation, warns_on_unknown_tokens)
A tokenizer for annotations.
Tokens and warnings should be set during the initialization phase, then retreivable with the coresponding method. Instance of this clas should be considered frozen.
| Method | __init__ |
Undocumented |
| Class Variable | tokens |
The tokens. |
| Class Variable | warnings |
The warnings trigered during the tokenization. |