summaryrefslogtreecommitdiff
path: root/Lib/tokenize.py
Commit message (Expand)AuthorAgeFilesLines
* Issue #26331: Implement the parsing part of PEP 515.Brett Cannon2016-09-091-8/+9
* Issue #26581: Use the first coding cookie on a line, not the last one.Serhiy Storchaka2016-03-201-1/+1
|\
| * Issue #26581: Use the first coding cookie on a line, not the last one.Serhiy Storchaka2016-03-201-1/+1
* | Issue #25977: Fix typos in Lib/tokenize.pyBerker Peksag2015-12-301-51/+67
|\ \ | |/ |/|
| * Issue 25311: Add support for f-strings to tokenize.py. Also added some commen...Eric V. Smith2015-10-261-51/+67
* | Issue #25977: Fix typos in Lib/tokenize.pyBerker Peksag2015-12-301-4/+4
|/
* Issue #24619: Simplify async/await tokenization.Yury Selivanov2015-07-231-16/+23
* Issue #24619: New approach for tokenizing async/await.Yury Selivanov2015-07-221-1/+6
* Issue #20387: Merge test and patch from 3.4.4Jason R. Coombs2015-06-281-5/+57
|\
| * (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary fileVictor Stinner2015-05-261-5/+57
| |\
| | * PEP 0492 -- Coroutines with async and await syntax. Issue #24017.Yury Selivanov2015-05-111-2/+54
| | * Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded withSerhiy Storchaka2015-03-111-2/+1
| | |\
| | * | Removed duplicated dict entries.Serhiy Storchaka2015-01-111-1/+0
| | * | (Merge 3.4) Issue #22599: Enhance tokenize.open() to be able to call it duringVictor Stinner2014-12-051-2/+3
| | |\ \
| | | * | PEP 465: a dedicated infix operator for matrix multiplication (closes #21176)Benjamin Peterson2014-04-091-2/+3
* | | | | Issue #20387: Restore retention of indentation during untokenize.Dingyuan Wang2015-06-221-0/+17
|/ / / /
* | | | Issue #23840: tokenize.open() now closes the temporary binary file on error toVictor Stinner2015-05-261-5/+9
| |_|/ |/| |
* | | Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded withSerhiy Storchaka2015-03-111-2/+1
|/ /
* | Issue #22599: Enhance tokenize.open() to be able to call it during PythonVictor Stinner2014-12-051-3/+4
|/
* Merge with 3.3Terry Jan Reedy2014-02-231-1/+1
|\
| * Merge with 3.3Terry Jan Reedy2014-02-231-0/+6
| |\
| * \ Merge with 3.3Terry Jan Reedy2014-02-171-1/+1
| |\ \
| | * \ Untokenize, bad assert: Merge with 3.3Terry Jan Reedy2014-02-171-1/+3
| | |\ \
| | * \ \ Issue #18960: Fix bugs with Python source code encoding in the second line.Serhiy Storchaka2014-01-091-0/+3
| | |\ \ \
| | * \ \ \ #19620: merge with 3.3.Ezio Melotti2013-11-251-1/+1
| | |\ \ \ \
| | * \ \ \ \ Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py scriptSerhiy Storchaka2013-09-161-4/+4
| | |\ \ \ \ \
| | * | | | | | Replace IOError with OSError (#16715)Andrew Svetlov2012-12-251-1/+1
* | | | | | | | whitespaceTerry Jan Reedy2014-02-231-1/+1
| |_|_|_|_|_|/ |/| | | | | |
* | | | | | | Issue #9974: When untokenizing, use row info to insert backslash+newline.Terry Jan Reedy2014-02-231-0/+6
|/ / / / / /
* | | | | | Issue #8478: Untokenizer.compat now processes first token from iterator input.Terry Jan Reedy2014-02-171-13/+11
| |_|_|_|/ |/| | | |
* | | | | Untokenize: An logically incorrect assert tested user input validity.Terry Jan Reedy2014-02-171-1/+3
| |_|_|/ |/| | |
* | | | Issue #18960: Fix bugs with Python source code encoding in the second line.Serhiy Storchaka2014-01-091-0/+3
| |_|/ |/| |
* | | #19620: Fix typo in docstring (noticed by Christopher Welborn).Ezio Melotti2013-11-251-1/+1
| |/ |/|
* | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py scriptSerhiy Storchaka2013-09-161-4/+4
|/
* #16152: merge with 3.2.Ezio Melotti2012-11-031-1/+3
|\
| * #16152: fix tokenize to ignore whitespace at the end of the code when no newl...Ezio Melotti2012-11-031-1/+3
* | Merge branchFlorent Xicluna2012-07-071-52/+173
|\ \ | |/ |/|
| * Issue #15096: Drop support for the ur string prefixChristian Heimes2012-06-201-9/+3
| * Issue #15054: Fix incorrect tokenization of 'b' string literals.Meador Inge2012-06-161-1/+1
| * Issue #14629: Mention the filename in SyntaxError exceptions fromBrett Cannon2012-04-201-3/+19
| * merge 3.2: issue 14629Martin v. L?wis2012-04-201-49/+160
| |\
| | * Updated tokenize to support the inverse byte literals new in 3.3Armin Ronacher2012-03-041-6/+16
| | * Basic support for PEP 414 without docs or tests.Armin Ronacher2012-03-041-8/+22
| | * Issue #2134: Add support for tokenize.TokenInfo.exact_type.Meador Inge2012-01-191-1/+58
| | * Issue #13150: The tokenize module doesn't compile large regular expressions a...Antoine Pitrou2011-10-111-19/+16
| | * Issue #12943: python -m tokenize support has been added to tokenize.Meador Inge2011-10-071-23/+56
* | | Issue #14990: tokenize: correctly fail with SyntaxError on invalid encoding d...Florent Xicluna2012-07-071-1/+1
|/ /
* | Issue #14629: Raise SyntaxError in tokenizer.detect_encodingMartin v. L?wis2012-04-201-2/+5
|/
* Merged revisions 88498 via svnmerge fromBrett Cannon2011-02-221-3/+2
* Issue #10386: Added __all__ to token module; this simplifies importingAlexander Belopolsky2010-11-111-3/+2