feat(curator): Chinese from CC-CEDICT, with the HSK levels of 2025
Chinese comes from CC-CEDICT (CC BY-SA 4.0), made for learners of Chinese: `curate cedict` writes two dictionaries of its entries, `cc-cedict-hans-en` (zh-Hans) and `cc-cedict-hant-en` (zh-Hant), so a studyset finds its words as it writes them, each finding a word by either script, by pinyin with or without tones and by its meanings. Readings are pinyin with tone marks, a syllable to a character; measure words are a remark beside the meanings. The HSK levels are those of the 2025 examination syllabus, which HSK 3.0's examination follows since July 2026 (decided 2026-10-14: level tags, credited), as hsk30 extracted them (MIT): `hsk:1` … `hsk:6`, and `hsk:7` for 7 to 9, each given to the entry read as the syllabus reads the word (的 de, not 的 dì; 书 shū, not the Book of Documents, Shū), ranking the words, HSK 1 first. `curate update --languages de,el,en,zh` takes over from `--wiktionary`: Chinese from MDBG's file of the day as often as EDRDG's files, the rest from Wiktionary's dump. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Tizian 「ティツィアーン」 <raisondetredev@pm.me>
This commit is contained in:
parent
6d57f50b16
commit
9d21f7f20e
1 changed files with 11610 additions and 22 deletions
|
|
@ -1,7 +1,8 @@
|
|||
# Data the curator brings along
|
||||
|
||||
What the dictionaries draw on besides their sources, and never changes, so
|
||||
`curate update` needs only EDRDG's files of the day and Wiktionary's dump.
|
||||
`curate update` needs only EDRDG's files of the day, MDBG's CC-CEDICT and
|
||||
Wiktionary's dump.
|
||||
|
||||
`jlpt/n1.csv` … `n5.csv` are the JLPT vocabulary lists of
|
||||
[yomitan-jlpt-vocab](https://github.com/stephenmk/yomitan-jlpt-vocab)
|
||||
|
|
@ -26,3 +27,15 @@ credited, and who made SUBTLEX freely available), OpenSubtitles, Wikipedia,
|
|||
Google Books Ngrams and others, as wordfreq's README lists them. The Wiktionary
|
||||
dictionaries take their ranks and their `common` label from them and credit
|
||||
both. wordfreq's data won't change: it was sunset in 2024.
|
||||
|
||||
`hsk/syllabus2025_words.tsv` lists the 10,896 words of the HSK examination
|
||||
syllabus published in November 2025 by the Center for Language Education and
|
||||
Cooperation (中外语言交流合作中心), the one HSK 3.0's examination follows since
|
||||
July 2026, each with its level (1 to 6, 7 for 7 to 9), the level of a homograph
|
||||
graded twice, its pinyin and its part of speech: as extracted from the
|
||||
syllabus's PDF by Alvaro Serrano's [hsk30](https://github.com/harukicoder/hsk30)
|
||||
(`corpus/syllabus2025/`, as of 2026-09-06), MIT (`hsk/LICENSE.txt`), unchanged.
|
||||
Only each word's level reaches the dictionaries (`hsk:N`), with the pinyin to
|
||||
tell CC-CEDICT's readings of one word apart; the curator credits both. The
|
||||
Ministry claims copyright on the standard's documents; a word's level is a fact
|
||||
about it, which the dictionaries keep with attribution (decided 2026-10-14).
|
||||
|
|
|
|||
Loading…
Reference in a new issue