diff options
| author | Adrian Thurston <thurston@complang.org> | 2012-05-22 20:33:51 -0400 |
|---|---|---|
| committer | Adrian Thurston <thurston@complang.org> | 2012-05-22 20:33:51 -0400 |
| commit | 35f086e516696d13b13d129062ae45d186e3523e (patch) | |
| tree | f3360707423e65dbad73c203ce27deccd65d070e /colm/bytecode.h | |
| parent | aa01add5ba8ea59850b4db058f6a0e53ab9c41fe (diff) | |
| download | colm-35f086e516696d13b13d129062ae45d186e3523e.tar.gz | |
improvements to ignore handling in the parser
Every region now also has a duplicate scanning region that is only for tokens.
The duplicate ignores and tokens generate the original tokens through a
TokenDef ignore mechanism.
Can turn off post ignore parsing and pre-igore parsing on a token-by-token
basis. Probably want to move it into the productions and specify it there.
Currently don't have a specification mechanism.
If an ignore is a post-token ignore it is not right-attached.
Diffstat (limited to 'colm/bytecode.h')
| -rw-r--r-- | colm/bytecode.h | 12 |
1 files changed, 7 insertions, 5 deletions
diff --git a/colm/bytecode.h b/colm/bytecode.h index bb639e94..2151544d 100644 --- a/colm/bytecode.h +++ b/colm/bytecode.h @@ -340,20 +340,22 @@ typedef unsigned char uchar; */ /* A tree that has been generated by a termDup. */ -#define PF_TERM_DUP 0x0001 +#define PF_TERM_DUP 0x0001 /* Has been processed by the commit function. All children have also been * processed. */ -#define PF_COMMITTED 0x0002 +#define PF_COMMITTED 0x0002 /* Created by a token generation action, not made from the input. */ -#define PF_ARTIFICIAL 0x0004 +#define PF_ARTIFICIAL 0x0004 /* Named node from a pattern or constructor. */ -#define PF_NAMED 0x0008 +#define PF_NAMED 0x0008 /* There is reverse code associated with this tree node. */ -#define PF_HAS_RCODE 0x0010 +#define PF_HAS_RCODE 0x0010 + +#define PF_RIGHT_IGNORE 0x0020 #define PF_LEFT_IL_ATTACHED 0x0400 #define PF_RIGHT_IL_ATTACHED 0x0800 |