summaryrefslogtreecommitdiff
path: root/src/storage
Commit message (Collapse)AuthorAgeFilesLines
* Fix code stylePeng Wu2023-01-142-3/+3
|
* Fix libpinyin crash on ARMv7Matias Larsson2022-11-295-20/+27
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Fix the alignment trap in get_unigram_frequency(). Fix also other places where this same trap could happen (depending on compiler and surrounding code). The trap happened when the ARM GCC generated a SIMD instruction (specifically VLDR) to load 32 bits in a single instruction, and when the memory address was not aligned to 32 bits. VLDR traps if the address is not aligned. GCC generated the instruction because of the cast to uint32 from the address. The fix is to allocate a uint32 variable in stack and use memcpy to copy the data to that variable. This way we ensure that appropriate instructions are generated. **Links** About the issue with GCC: https://trust-in-soft.com/blog/2020/04/06/gcc-always-assumes-aligned-pointer-accesses/ How Linux does it: https://elixir.bootlin.com/linux/v5.10.155/source/include/linux/unaligned/memmove.h#L13 ARM documentation: https://documentation-service.arm.com/static/5f8dc043f86e16515cdbbc92?token= See 'A3.2.1 Unaligned data access'
* Support longer candidatePeng Wu2022-09-211-1/+1
|
* Write search_suggestion_with_matrix functionPeng Wu2022-09-142-0/+99
|
* Write FacadeChewingTable2::search_suggestion methodPeng Wu2022-09-091-0/+26
|
* Write ChewingLargeTable2::search_suggesion method for Kyoto CabinetPeng Wu2022-09-083-1/+167
|
* Write ChewingLargeTable2::search_suggesion method for Berkeley DBPeng Wu2022-09-072-0/+164
|
* Write ChewingTableEntry::search_suggestion methodPeng Wu2022-09-022-4/+82
|
* Fix Kyoto Cabinet usagePeng Wu2022-08-302-3/+8
|
* Fix pinyin.cppPeng Wu2022-08-291-1/+1
|
* Write FacadePhraseTable3::search_suggestion methodPeng Wu2022-08-251-0/+25
|
* Fix a typoPeng Wu2022-08-251-1/+1
|
* Write search_suggestion methodPeng Wu2022-07-265-5/+119
|
* Write compare_phrase functionPeng Wu2022-07-192-0/+76
|
* Use abort function instead of assert macroPeng Wu2022-06-0612-40/+40
|
* Use check_result macro in src directoryPeng Wu2022-06-0110-37/+41
|
* Switch from GrassDB to ProtoTreeDBPeng Wu2022-03-302-4/+4
|
* Update special_table.h2.6.1Peng Wu2021-09-151-0/+1
|
* Update full pinyin parser codePeng Wu2021-03-251-1/+1
|
* update special_table.hZhangyuan Nie2021-03-251-0/+1
|
* Fix delimiter for reading table files on macOSWeixuan XIAO2020-11-265-0/+25
| | | | | | | | | | | On macOS under llvm/clang++, the default delimiter for format string is weird: it cannot read full CJK characters from the table files. This patch adds macOS-specified code to make "\t" and " " the implicit delimiter. Ref: https://stackoverflow.com/questions/12885628/changing-the-scanf-delimiter
* update special_table.hPeng Wu2020-11-101-0/+1
|
* Fixes Berkeley DB cursor usagePeng Wu2020-10-144-0/+15
|
* Fixes copy_bdb functionPeng Wu2020-10-101-0/+4
|
* support database format in table.confPeng Wu2020-09-272-1/+48
|
* Use Kyoto Cabinet snapshot featurePeng Wu2020-09-234-0/+32
|
* improve Kyoto Cabinet usagePeng Wu2020-08-213-9/+9
|
* fixes merge_single_gram functionPeng Wu2020-08-211-0/+2
|
* Copy the data when merge into single ngram.Weng Xuetian2020-08-181-4/+4
| | | | system and user single ngram might be invalidated later.
* improve full pinyin parserPeng Wu2020-08-171-13/+16
|
* improve full pinyin parser auto correctionPeng Wu2020-07-241-9/+22
|
* refactor parse_one_key methodPeng Wu2020-07-243-15/+23
|
* update pinyin_parser_table.hPeng Wu2020-07-241-660/+660
|
* Fixes typoPeng Wu2020-07-201-1/+1
|
* update pinyin_custom2.h for C language compatibilityPeng Wu2020-02-271-19/+16
|
* remove pinyin_custom3.hPeng Wu2020-02-271-142/+0
|
* improve autoconf for libpinyin.la and libzhuyin.laPeng Wu2019-11-281-2/+0
|
* improve autoconf for libpinyin_internal.aPeng Wu2019-11-281-9/+7
|
* Revert "not use in-memory DBM in src/storage"Peng Wu2019-01-1714-81/+6
| | | | This reverts commit 5607752c2b989849923676f4a925e5315a3303d4.
* fixes fscanf usagePeng Wu2018-01-256-7/+7
|
* write is_valid_zhuyin methodPeng Wu2017-12-283-0/+29
|
* update zhuyin_table.hPeng Wu2017-12-281-0/+12102
|
* update special_table.hPeng Wu2017-12-281-20/+20
|
* not use in-memory DBM in src/storagePeng Wu2017-06-1914-6/+81
|
* Fix a typo: omited -> omittedFelix Yan2017-06-121-1/+1
|
* handle zhuyin table file in src/storagePeng Wu2017-05-257-18/+63
|
* import libzhuyin.pc.inPeng Wu2017-05-161-1/+4
|
* import gen_zhuyin_table.cpp and test_zhuyin.cppPeng Wu2017-05-151-1/+1
|
* support zhuyin table in table_info.cppPeng Wu2017-05-111-2/+7
|
* write zhuyin_custom2.hPeng Wu2017-04-241-0/+45
|