diff options
| author | gbrandl <devnull@localhost> | 2007-05-03 18:23:03 +0200 |
|---|---|---|
| committer | gbrandl <devnull@localhost> | 2007-05-03 18:23:03 +0200 |
| commit | e130dbff2eb591c7cdca4a0bef90b63502cd3d4e (patch) | |
| tree | fcb7f3140464f1be96ff5a119c154b3ace677df4 /docs/src | |
| parent | 2af8e713b4d89c8961c419db4818f11d43030643 (diff) | |
| download | pygments-e130dbff2eb591c7cdca4a0bef90b63502cd3d4e.tar.gz | |
[svn] Add whitespace filter. Add a few more filter unit tests.
Diffstat (limited to 'docs/src')
| -rw-r--r-- | docs/src/tokens.txt | 8 |
1 files changed, 6 insertions, 2 deletions
diff --git a/docs/src/tokens.txt b/docs/src/tokens.txt index f98b4d6e..3a1cd4af 100644 --- a/docs/src/tokens.txt +++ b/docs/src/tokens.txt @@ -57,8 +57,9 @@ For some tokens aliases are already defined: Inside the `pygments.token` module the following aliases are defined: -============= ============================ ================================== +============= ============================ ==================================== `Text` `Token.Text` for any type of text data +`Whitespace` `Token.Text.Whitespace` for specially highlighted whitespace `Error` `Token.Error` represents lexer errors `Other` `Token.Other` special token for data not matched by a parser (e.g. HTML @@ -73,7 +74,10 @@ Inside the `pygments.token` module the following aliases are defined: `Comment` `Token.Comment` any kind of comments `Generic` `Token.Generic` generic tokens (have a look at the explanation below) -============= ============================ ================================== +============= ============================ ==================================== + +The `Whitespace` token type is new in Pygments 0.8. It is used only by the +`VisibleWhitespaceFilter` currently. Normally you just create token types using the already defined aliases. For each of those token aliases, a number of subtypes exists (excluding the special tokens |