summaryrefslogtreecommitdiff
path: root/toke.c
Commit message (Collapse)AuthorAgeFilesLines
* [ID 20001113.003] utf8_to_uv on malformed utf returns wrong valuesYitzchak Scott-Thoennes2000-11-141-1/+1
| | | | | Message-Id: <200011132249.eADMnek09679@garcia.efn.org> p4raw-id: //depot/perl@7677
* Overrideable keys, each, pop, push, shift, splice, unshift.Casey R. Tweten2000-11-081-7/+7
| | | | | | Subject: [PATCH] prototyped functions that should be overrideable Message-ID: <Pine.OSF.4.21.0011031100470.17471-100000@home.kiski.net> p4raw-id: //depot/perl@7600
* glibc5 detection by __GNU_LIBRARY__.Jarkko Hietaniemi2000-11-061-2/+8
| | | p4raw-id: //depot/perl@7582
* Fix forDavid Dyck2000-11-061-2/+20
| | | | | | | | | | Subject: [ID 20000728.005] perl -P broken Message-Id: <200007290019.RAA08484@dd.tc.fluke.com> (hopefully). The fix is also not complete, it seems to break BOM swallowing for libc5 systems, but until someone figures out a way to do this without ftell(), this will do. p4raw-id: //depot/perl@7570
* A fix of sorts for 20000329.026, a better error messageJarkko Hietaniemi2000-11-051-4/+13
| | | | | for a missing "use charnames" when using the \N{...}. p4raw-id: //depot/perl@7557
* Make \x{...} consistently produce UTF-8.Simon Cozens2000-10-291-19/+20
| | | | | | Subject: Re: \x{...} is confused Message-ID: <20001029193648.A6287@pembro4.pmb.ox.ac.uk> p4raw-id: //depot/perl@7485
* The reëntrant version shouldn't be needed unless USE_PURE_BISON.Jarkko Hietaniemi2000-10-281-17/+19
| | | p4raw-id: //depot/perl@7465
* Continue the internal UTF-8 API tweaking.Jarkko Hietaniemi2000-10-251-2/+2
| | | | | | | | Rename utf8_to_uv_chk() back to utf8_to_uv() because it's used much more than the simpler API, now called utf8_to_uv_simple(). Still not quite happy with API, too much partial duplication of functionality. p4raw-id: //depot/perl@7439
* Allow poking holes at the UTF-8 decoding strictness.Jarkko Hietaniemi2000-10-251-2/+2
| | | p4raw-id: //depot/perl@7438
* Make the UTF-8 decoding stricter and more verbose whenJarkko Hietaniemi2000-10-241-28/+38
| | | | | | | | | | | | malformation happens. This involved adding an argument to utf8_to_uv_chk(), which involved changing its prototype, and prefer STRLEN over I32 for the UTF-8 length, which as a domino effect necessitated changing the prototypes of scan_bin(), scan_oct(), scan_hex(), and reg_uni(). The stricter UTF-8 decoding checking uses Markus Kuhn's UTF-8 Decode Stress Tester from http://www.cl.cam.ac.uk/~mgk25/ucs/examples/UTF-8-test.txt p4raw-id: //depot/perl@7416
* Make scan_num() reëntrant, as suggested inRoca, Ignasi2000-10-201-16/+11
| | | | | | Subject: [PATCH perl@7229] Rentrant parser and yylex() Message-ID: <5930DC161690D211966700902715754702DA09CD@madt009a.siemens.es> p4raw-id: //depot/perl@7382
* Reëntrancy fix.Roca, Ignasi2000-10-201-12/+39
| | | | | | Subject: [PATCH perl@7229] Rentrant parser and yylex() Message-ID: <5930DC161690D211966700902715754702DA09CD@madt009a.siemens.es> p4raw-id: //depot/perl@7381
* Allow @+ and @- to be doublequoted, from Simon Cozens.Jarkko Hietaniemi2000-10-131-2/+4
| | | p4raw-id: //depot/perl@7224
* Re: Trapping by opmask sets strange parser state [PATCH]Gisle Aas2000-09-301-1/+1
| | | | | Message-Id: <m3aed9ybrm.fsf@eik.g.aas.no> p4raw-id: //depot/perl@7098
* Re-instate Perl_utf8_to_uv without checking parameter - added in change 7075.Nick Ing-Simmons2000-09-301-2/+2
| | | | | | | i.e. rename Simon's function to Perl_utf8_to_uv_chk, change all calls to it to use new name and add Perl_utf8_to_uv() as a wrapper which calls it passing 0 to checking to get the warning. p4raw-id: //depot/perl@7096
* Fix for the charnames.t failures from Spider Boardman.Jarkko Hietaniemi2000-09-151-0/+1
| | | p4raw-id: //depot/perl@7093
* Re: perl@7078 Spider Boardman2000-09-141-0/+2
| | | | | Message-Id: <200009142306.TAA20082@leggy.zk3.dec.com> p4raw-id: //depot/perl@7090
* continued -Wformat supportRobin Barker2000-09-141-2/+2
| | | | | Message-Id: <200009141707.SAA13276@tempest.npl.co.uk> p4raw-id: //depot/perl@7081
* Batch of UTF-8 patches from Simon Cozens.Jarkko Hietaniemi2000-09-141-2/+2
| | | p4raw-id: //depot/perl@7075
* Allow chop() and chomp() to be overridden.Casey R. Tweten2000-09-141-2/+2
| | | | | | Subject: [PATCH] Re: [ID 20000911.006] I can override glob but not chop? Message-ID: <Pine.OSF.4.21.0009131154120.6661-100000@home.kiski.net> p4raw-id: //depot/perl@7071
* Re: [ID 20000905.001] Assertion failed: file "toke.c", line 202 Hugo van der Sanden2000-09-071-4/+4
| | | | | Message-Id: <200009051313.OAA24507@crypt.compulink.co.uk> p4raw-id: //depot/perl@7028
* Drop unused argument.Spider Boardman2000-09-011-2/+1
| | | | | | Subject: Re: [ID 20000831.034] overload::constant and number of arguments. Message-Id: <200008312010.QAA20392@leggy.zk3.dec.com> p4raw-id: //depot/perl@6972
* Have symbols for the IoTYPEs.Jarkko Hietaniemi2000-08-061-4/+4
| | | p4raw-id: //depot/perl@6532
* BOM patching from Simon Cozens.Jarkko Hietaniemi2000-08-011-2/+10
| | | p4raw-id: //depot/perl@6478
* The swallow_bom() saga continues. The #23 of require.tJarkko Hietaniemi2000-07-311-30/+43
| | | | | | | | (UTF16-LE) still fails (silently, no output) but the #22 (UTF16-BE) seems to be working now. The root of the failure may be in sv_gets(): is it UTF-16LE-aware, especially when it comes to line endings? p4raw-id: //depot/perl@6469
* A new version of the "remove UPPERACSE string comparison"Jarkko Hietaniemi2000-07-301-16/+0
| | | | | | | | operators. The problem with the previous one (change #6454) was that it was for Perl 5.6.0. From Paul Marquess. p4raw-link: @6454 on //depot/perl: d164fe835174420df93c1795763a090dc6471f0a p4raw-id: //depot/perl@6466
* Tune the comments and hopefully stop a memory leak.Jarkko Hietaniemi2000-07-291-1/+6
| | | p4raw-id: //depot/perl@6463
* Back out #6454, doesn't seem to work.Jarkko Hietaniemi2000-07-281-0/+16
| | | | | | (Reason: that patch was for perl 5.6.0, not perl-current) (A version of the patch for perl-current came in later as #6466) p4raw-id: //depot/perl@6458
* Remove EQ, NE, GT, LT, GE, LE (they have been deprecatedJarkko Hietaniemi2000-07-271-16/+0
| | | | | | | | | | | | | | | | | | | | | | | | | | for a long time). Reported in Subject: [ID 20000717.004] Unexpected complaint of NE deprecation From: Ryan Herbert <rherbert@sycamorehq.com> Date: Mon, 17 Jul 2000 11:40:42 -0400 Message-Id: <200007171540.LAA20480@beorn.hq.sai> Patched in Subject: RE: [ID 20000717.004] Unexpected complaint of NE deprecation From: "Paul Marquess" <Paul.Marquess@btinternet.com> Date: Wed, 26 Jul 2000 23:40:18 +0100 Message-ID: <000001bff752$79511880$0a17073e@tiny> based on an earlier patch from Stephen P. Potter. (Removed later by change #6458 because this patch was for perl 5.6.0, not perl-current) p4raw-link: @6458 (not found) p4raw-id: //depot/perl@6454
* Get UTF16 BOMs working. Patch fromM. J. T. Guy2000-07-251-0/+6
| | | | | | | | | | | | | | Subject: Re: [ID 20000719.001] Problem with bleadperl of 7/18/00 Date: Tue, 25 Jul 2000 12:52:45 +0100 Message-Id: <E13H3GP-0004MR-00@libra.cus.cam.ac.uk> and notes from Subject: Re: [ID 20000719.001] Problem with bleadperl of 7/18/00 From: "M.J.T. Guy" <mjtg@cus.cam.ac.uk> Date: Tue, 25 Jul 2000 11:43:25 +0100 Message-Id: <E13H2BJ-0002nG-00@libra.cus.cam.ac.uk> p4raw-id: //depot/perl@6435
* PERL_OBJECT build tweaksGurusamy Sarathy2000-07-141-32/+36
| | | p4raw-id: //depot/perl@6404
* inconsistent types needs castsGurusamy Sarathy2000-07-141-4/+6
| | | p4raw-id: //depot/perl@6403
* typecasts needed for change#6394Gurusamy Sarathy2000-07-141-4/+4
| | | | | p4raw-link: @6394 on //depot/cfgperl: 78ae23f54fc4e301b66d2a32897cb42fa2633fe7 p4raw-id: //depot/perl@6401
* integrate cfgperl contents into mainlineGurusamy Sarathy2000-07-141-12/+10
|\ | | | | p4raw-id: //depot/perl@6400
| * Fix the BOM bug: not a byteorder bug, a signedness bug.Jarkko Hietaniemi2000-07-141-10/+10
| | | | | | p4raw-id: //depot/cfgperl@6394
| * Integrate with Sarathy.Jarkko Hietaniemi2000-07-131-1/+1
| |\ | | | | | | p4raw-id: //depot/cfgperl@6390
| * | Re: format bug report [Patch]H.Merijn Brand2000-07-111-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Date: Wed, 05 Jul 2000 13:12:52 +0200 Message-Id: <20000705130745.67BF.H.M.BRAND@hccnet.nl> Subject: Re: format bug report [Patch] From: "H.Merijn Brand" <h.m.brand@hccnet.nl> Date: Wed, 05 Jul 2000 14:10:01 +0200 Message-Id: <20000705140837.73C2.H.M.BRAND@hccnet.nl> p4raw-id: //depot/cfgperl@6340
| * | Be less forgiving about ambiguous and illegal tr ranges.Mark-Jason Dominus2000-07-111-2/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Subject: Re: [ID 20000703.001] tr/// operator understands multiple hyphens in a bizarre way Date: Tue, 04 Jul 2000 10:00:12 -0400 Message-ID: <20000704140012.17772.qmail@plover.com> Subject: Re: [ID 20000703.001] tr/// operator understands multiple hyphens in a bizarre way From: Mark-Jason Dominus <mjd@plover.com> Date: Wed, 05 Jul 2000 09:37:36 -0400 Message-ID: <20000705133736.27293.qmail@plover.com> p4raw-id: //depot/cfgperl@6339
| * | Fix the alignment problem in Crays ([ID 20000612.002]).Jarkko Hietaniemi2000-07-071-5/+5
| | | | | | | | | p4raw-id: //depot/cfgperl@6324
| * | Win32 patches for cfgperl from Sarathy.Jarkko Hietaniemi2000-07-041-21/+21
| | | | | | | | | p4raw-id: //depot/cfgperl@6307
| * | Re: [PATCH cfgperl] BOMs away!Simon Cozens2000-06-281-2/+58
| | | | | | | | | | | | | | | Message-ID: <slrn8kmpf5.8pl.simon@justanother.perlhacker.org> p4raw-id: //depot/cfgperl@6261
| * | Re: [PATCH] support 'my __PACKAGE__ $obj = ...'Doug MacEachern2000-06-281-1/+24
| | | | | | | | | | | | | | | Message-ID: <Pine.LNX.4.10.10006271412340.7587-100000@mojo.covalent.net> p4raw-id: //depot/cfgperl@6250
| * | Do no -warn on \_, only on \alpha.David Dyck2000-06-271-1/+1
| | | | | | | | | | | | | | | | | | Subject: New Unrecognized escape warning for /\_/ from activestate perl-current5.6.0 Message-ID: <Pine.LNX.4.05.10006260830280.3054-100000@dd.tc.fluke.com> p4raw-id: //depot/cfgperl@6241
| * | Remove tr///CU (the feature is to be obsoleted by better interfaces).Simon Cozens2000-06-231-27/+2
| | | | | | | | | | | | | | | | | | Subject: [PATCH] Eliminate tr///[CU][CU] Message-ID: <slrn8l6h44.h5k.simon@justanother.perlhacker.org> p4raw-id: //depot/cfgperl@6221
* | | enable UTF-16 filter by default if relevant BOM is seen; variousGurusamy Sarathy2000-07-141-62/+66
| |/ |/| | | | | | | cleanups (typos, misformatted code, and small bugs) p4raw-id: //depot/perl@6399
* | tweak for build failure under multiplicityGurusamy Sarathy2000-07-111-1/+1
| | | | | | p4raw-id: //depot/perl@6374
* | integrate cfgperl changes#6325..6373 into mainlineGurusamy Sarathy2000-07-111-4/+18
| | | | | | | | | | | | | | | | (NOTE: today's batch of integrations still untested) p4raw-link: @6373 (not found) p4raw-link: @6325 on //depot/cfgperl: d6ac44cc5a00fa38a56717785146bc16b716472c p4raw-id: //depot/perl@6373
* | integrate cfgperl changes#6293..6324 into mainlineGurusamy Sarathy2000-07-111-26/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | p4raw-link: @6324 on //depot/cfgperl: 81bf48a6dbba4b295dfa172a17ca70b654dbf225 p4raw-link: @6293 on //depot/cfgperl: 6e37ea6052902cde1aeb08a2129ffc7c8ea53736 p4raw-id: //depot/perl@6369 p4raw-branched: from //depot/cfgperl@6368 'branch in' lib/Win32.pod lib/lib_pm.PL p4raw-deleted: from //depot/cfgperl@6368 'delete in' pod/Win32.pod (@5937..) pod/buildtoc (@6091..) lib/lib.pm.PL (@6227..) pod/Makefile (@6232..) p4raw-integrated: from //depot/cfgperl@6368 'copy in' thread.h (@5656..) lib/warnings/register.pm (@5704..) ext/B/B/Stash.pm (@5972..) lib/CGI/Util.pm (@6034..) util.c (@6217..) gv.c (@6244..) pp.c (@6260..) doop.c (@6269..) pod/perlfunc.pod (@6277..) pp_ctl.c (@6293..) makedef.pl (@6301..) embed.h global.sym objXSUB.h perlapi.c proto.h (@6305..) win32/Makefile (@6307..) Makefile.SH (@6309..) t/op/method.t (@6312..) sv.h (@6315..) 'ignore' op.c (@6273..) 'merge in' embed.pl win32/win32.c (@6305..) p4raw-integrated: from //depot/cfgperl@6324 'merge in' toke.c (@6307..) p4raw-branched: from //depot/cfgperl@6323 'branch in' pod/buildtoc.PL (@6319..) p4raw-integrated: from //depot/cfgperl@6323 'copy in' pod/perl.pod (@6319..) pod/perltoc.pod (@6322..) 'merge in' MANIFEST (@6319..) p4raw-branched: from //depot/cfgperl@6319 'branch in' pod/Makefile.SH p4raw-integrated: from //depot/cfgperl@6315 'ignore' pp_hot.c (@6313..) p4raw-integrated: from //depot/cfgperl@6311 'copy in' ext/POSIX/POSIX.pod (@6296..) p4raw-integrated: from //depot/cfgperl@6307 'merge in' doio.c (@6223..)
* | integrate cfgperl changes#6261..6266 into mainlineGurusamy Sarathy2000-07-111-2/+58
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | p4raw-link: @6266 on //depot/cfgperl: a009ce76c9b4ddbde44a58eab3fe27d331cf27fe p4raw-link: @6261 on //depot/cfgperl: 27d76ecff97d0a9449f569d789504cc8b69a6d01 p4raw-id: //depot/perl@6363 p4raw-integrated: from //depot/cfgperl@6362 'copy in' README.epoc epoc/createpkg.pl epoc/epocish.c (@5586..) epoc/epocish.h t/comp/require.t (@5639..) cygwin/Makefile.SHs (@6096..) ext/POSIX/POSIX.pm (@6140..) hints/bsdos.sh (@6156..) epoc/config.sh (@6168..) ext/POSIX/POSIX.xs (@6198..) p4raw-integrated: from //depot/cfgperl@6265 'copy in' ext/POSIX/POSIX.pod (@5586..) p4raw-integrated: from //depot/cfgperl@6263 'copy in' doop.c (@6256..) p4raw-integrated: from //depot/cfgperl@6261 'merge in' pod/perldiag.pod (@6206..) toke.c (@6250..)
* | integrate cfgperl change#6250 into mainlineGurusamy Sarathy2000-07-111-1/+24
| | | | | | | | | | | | | | | | | | p4raw-link: @6250 on //depot/cfgperl: ec6a9911b75518dd4c77eb4985d8bee0371df340 p4raw-id: //depot/perl@6360 p4raw-branched: from //depot/cfgperl@6250 'branch in' t/op/my_stash.t p4raw-integrated: from //depot/cfgperl@6250 'copy in' MANIFEST (@6232..) 'merge in' toke.c (@6241..) embed.pl proto.h (@6243..)