diff options
| author | Jarkko Hietaniemi <jhi@iki.fi> | 2001-11-19 14:24:33 +0000 |
|---|---|---|
| committer | Jarkko Hietaniemi <jhi@iki.fi> | 2001-11-19 14:24:33 +0000 |
| commit | 05632f9aff3e990388b86286c6c58111a26f1522 (patch) | |
| tree | 305231d57ee6544b27ce9f37129bde81e0131cd6 /pod/perlunicode.pod | |
| parent | a801c63c4c283fdf8af1d9fbd7d3d89096ee73f6 (diff) | |
| download | perl-05632f9aff3e990388b86286c6c58111a26f1522.tar.gz | |
Figures 1 and 2 for UTF-8.
p4raw-id: //depot/perl@13095
Diffstat (limited to 'pod/perlunicode.pod')
| -rw-r--r-- | pod/perlunicode.pod | 25 |
1 files changed, 25 insertions, 0 deletions
diff --git a/pod/perlunicode.pod b/pod/perlunicode.pod index 64116bcae1..6606ecdc86 100644 --- a/pod/perlunicode.pod +++ b/pod/perlunicode.pod @@ -694,6 +694,31 @@ length (1 to 6 bytes, current character allocations require 4 bytes), byteorder independent encoding. For ASCII, UTF-8 is transparent (and we really do mean 7-bit ASCII, not any 8-bit encoding). +The following table is from Unicode 3.1. + + Code Points 1st Byte 2nd Byte 3rd Byte 4th Byte + + U+0000..U+007F 00..7F + U+0080..U+07FF C2..DF 80..BF + U+0800..U+0FFF E0 A0..BF 80..BF + U+1000..U+FFFF E1..EF 80..BF 80..BF + U+10000..U+3FFFF F0 90..BF 80..BF 80..BF + U+40000..U+FFFFF F1..F3 80..BF 80..BF 80..BF + U+100000..U+10FFFF F4 80..8F 80..BF 80..BF + +Or, another way to look at it, as bits: + + Code Points 1st Byte 2nd Byte 3rd Byte 4th Byte + + 0aaaaaaa 0aaaaaaa + 00000bbbbbaaaaaa 110bbbbb 10aaaaaa + ccccbbbbbbaaaaaa 1110cccc 10bbbbbb 10aaaaaa + 00000dddccccccbbbbbbaaaaaa 11110ddd 10cccccc 10bbbbbb 10aaaaaa + +As you can see, the continuation bytes all begin with C<10>, and the +leading bits of the start byte tells how many bytes the are in the +encoded character. + =item UTF-16, UTF-16BE, UTF16-LE, Surrogates, and BOMs (Byte Order Marks) UTF-16 is a 2 or 4 byte encoding. The Unicode code points |