diff options
| author | Miikka Salminen <miikka.salminen@gmail.com> | 2016-02-06 22:01:49 +0200 |
|---|---|---|
| committer | Miikka Salminen <miikka.salminen@gmail.com> | 2016-02-06 22:01:49 +0200 |
| commit | 995aa30dfb51621a017833258654d35ec3fc2c30 (patch) | |
| tree | 478df67e08fb01720e3426f7006c0ab2f322a35e /doc | |
| parent | 0c812483363f57bc812f979d70d6b6773da6135f (diff) | |
| download | pygments-995aa30dfb51621a017833258654d35ec3fc2c30.tar.gz | |
Add tokens for string affixes and heredoc delimiters. Add lexing for them in C/C++, Perl, PHP, Python and Ruby. Update my old style Lovelace accordingly.
Diffstat (limited to 'doc')
| -rw-r--r-- | doc/docs/tokens.rst | 8 |
1 files changed, 8 insertions, 0 deletions
diff --git a/doc/docs/tokens.rst b/doc/docs/tokens.rst index 96a6d003..801fc638 100644 --- a/doc/docs/tokens.rst +++ b/doc/docs/tokens.rst @@ -223,12 +223,20 @@ Literals `String` For any string literal. +`String.Affix` + Token type for affixes that further specify the type of the string they're + attached to (e.g. the prefixes ``r`` and ``u8`` in ``r"foo"`` and ``u8"foo"``). + `String.Backtick` Token type for strings enclosed in backticks. `String.Char` Token type for single characters (e.g. Java, C). +`String.Delimiter` + Token type for delimiting identifiers in "heredoc", raw and other similar + strings (e.g. the word ``END`` in Perl code ``print <<'END';``). + `String.Doc` Token type for documentation strings (for example Python). |