diff options
author | Jarkko Hietaniemi <jhi@iki.fi> | 2001-08-12 14:16:44 +0000 |
---|---|---|
committer | Jarkko Hietaniemi <jhi@iki.fi> | 2001-08-12 14:16:44 +0000 |
commit | ad0029c435199eaf70c06265f639c1af50f36906 (patch) | |
tree | 1c5cb5b923db2505a17d89f8374aad419d5bcb1d /lib/utf8.pm | |
parent | 9e1b5a4e54e5c46a7023c503b5749aa9998420a2 (diff) | |
download | perl-ad0029c435199eaf70c06265f639c1af50f36906.tar.gz |
Dispell the "use utf8" superstition.
p4raw-id: //depot/perl@11643
Diffstat (limited to 'lib/utf8.pm')
-rw-r--r-- | lib/utf8.pm | 40 |
1 files changed, 13 insertions, 27 deletions
diff --git a/lib/utf8.pm b/lib/utf8.pm index 0885e6740a..cb1968636f 100644 --- a/lib/utf8.pm +++ b/lib/utf8.pm @@ -1,6 +1,5 @@ package utf8; - $utf8::hint_bits = 0x00800000; our $VERSION = '1.00'; @@ -34,9 +33,6 @@ utf8 - Perl pragma to enable/disable UTF-8 (or UTF-EBCDIC) in source code =head1 DESCRIPTION -WARNING: The implementation of Unicode support in Perl is incomplete. -See L<perlunicode> for the exact details. - The C<use utf8> pragma tells the Perl parser to allow UTF-8 in the program text in the current lexical scope (allow UTF-EBCDIC on EBCDIC based platforms). The C<no utf8> pragma tells Perl to switch back to treating @@ -49,33 +45,21 @@ source text. Until UTF-8 becomes the default format for source text, this pragma should be used to recognize UTF-8 in the source. When UTF-8 becomes the standard source format, this pragma will effectively become a no-op. For convenience in what follows the -term UTF-X is used to refer to UTF-8 on ASCII and ISO Latin based +term I<UTF-X> is used to refer to UTF-8 on ASCII and ISO Latin based platforms and UTF-EBCDIC on EBCDIC based platforms. -Enabling the C<utf8> pragma has the following effects: +Enabling the C<utf8> pragma has the following effect: =over 4 =item * Bytes in the source text that have their high-bit set will be treated -as being part of a literal UTF-8 character. This includes most literals -such as identifiers, string constants, constant regular expression patterns -and package names. On EBCDIC platforms characters in the Latin 1 -character set are treated as being part of a literal UTF-EBCDIC character. - -=item * - -In the absence of inputs marked as UTF-X, regular expressions within the -scope of this pragma will default to using character semantics instead -of byte semantics. - - @bytes_or_chars = split //, $data; # may split to bytes if data - # $data isn't UTF-X - { - use utf8; # force char semantics - @chars = split //, $data; # splits characters - } +as being part of a literal UTF-8 character. This includes most +literals such as identifiers, string constants, constant regular +expression patterns and package names. On EBCDIC platforms characters +in the Latin 1 character set are treated as being part of a literal +UTF-EBCDIC character. =back @@ -87,8 +71,9 @@ The following functions are defined in the C<utf8::> package by the perl core. =item * $num_octets = utf8::upgrade($string); -Converts internal representation of string to the perls internal UTF-X form. -Returns the number of octets necessary to represent the string as UTF-X. +Converts internal representation of string to the Perl's internal +I<UTF-X> form. Returns the number of octets necessary to represent +the string as I<UTF-X>. =item * utf8::downgrade($string[, CHECK]) @@ -97,11 +82,12 @@ Converts internal representation of string to be un-encoded bytes. =item * utf8::encode($string) Converts (in-place) I<$string> from logical characters to octet sequence -representing it in perl's UTF-X encoding. +representing it in Perl's I<UTF-X> encoding. =item * $flag = utf8::decode($string) -Attempts to convert I<$string> in-place from perl's UTF-X encoding into logical characters. +Attempts to convert I<$string> in-place from Perl's I<UTF-X> encoding +into logical characters. =back |