2.0.1

add initial support for escape-characters

2.0

PHP 8.1 cleanup

1.2.4

adds setable start-lineno

1.2.3: BREAKING: tokenizer-config is now an array: Tokenizer(,,array $config)

- setting config of the tokenizer is now done as an array, supporting the following attributes:
  -  maxDepth (int)
  - disableAutoTrim (bool)

1.2.2

fixes TokenStream Typehints in docblocks

1.2.1

adds BaseToken::content(): string to fetch general token content as s…

1.2.0: introduces optional affix-separation

- input-blocks can now be configured through the new bool $splitAffixIntoSymbols
  paramter to generate prepended and appended Tokens instead of prefix/suffix
  attributes, allowing easier parsing of naturla-language like syntaxes

1.1.5

adds stream reseting to custom offsets

1.1.4

• adds source line-number to result tokens

1.1.3

introduces BlockToken::content() for simple block-content access