blob: 31bbd052c51c44e7281b6417e518e7897936cf31 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
|
# Generating GHC’s Unicode modules
`GHC.Unicode.Internal.*` modules are generated with the internal tool `ucd2haskell`.
```bash
cd ucd2haskell
./ucd.sh download && ./ucd.sh generate
```
# Updating Unicode modules
1. Update the Unicode version in `unicode_version`.
2. _Comment_ the line in `ucd.sh` with `VERIFY_CHECKSUM=y`.
3. Run `./ucd.sh download`.
4. Update the checksums in `ucd.sh` and _uncomment_ `VERIFY_CHECKSUM=y`.
5. Run `./ucd.sh generate`. This will generate the `GHC.Unicode.Internal.*`
modules.
6. Check and update the output of the tests `base/tests/unicodeXXX.hs`.
7. Compare with Python (see hereinafter) and fix any error.
__Note:__ you need a Python version with the same Unicode version.
8. Mention the update in `base` changelog and in the User’s Guide.
# Comparing with Python
In order to check Unicode implementation in GHC, we compare the results obtained
with Python.
__Warning:__ A Python version with the _exact same Unicode version_ is required.
# GHC
Check the properties of all the characters.
```bash
ghc -O2 tests/export_all_chars.hs
./tests/export_all_chars > tests/all_chars.csv
python3 tests/check_all_chars.py tests/all_chars.csv
```
# GHC tests data
Check the Unicode test data (`unicodeNNN.stdout`).
```bash
python3 tests/check_test_data.py
```
|
