feat(curator): Chinese from CC-CEDICT, with the HSK levels of 2025

Chinese comes from CC-CEDICT (CC BY-SA 4.0), made for learners of
Chinese: `curate cedict` writes two dictionaries of its entries,
`cc-cedict-hans-en` (zh-Hans) and `cc-cedict-hant-en` (zh-Hant), so a
studyset finds its words as it writes them, each finding a word by
either script, by pinyin with or without tones and by its meanings.
Readings are pinyin with tone marks, a syllable to a character; measure
words are a remark beside the meanings.

The HSK levels are those of the 2025 examination syllabus, which HSK
3.0's examination follows since July 2026 (decided 2026-10-14: level
tags, credited), as hsk30 extracted them (MIT): `hsk:1` … `hsk:6`, and
`hsk:7` for 7 to 9, each given to the entry read as the syllabus reads
the word (的 de, not 的 dì; 书 shū, not the Book of Documents, Shū),
ranking the words, HSK 1 first.

`curate update --languages de,el,en,zh` takes over from `--wiktionary`:
Chinese from MDBG's file of the day as often as EDRDG's files, the rest
from Wiktionary's dump.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Tizian 「ティツィアーン」 <raisondetredev@pm.me>
This commit is contained in:
Tizian 「ティツィアーン」 2026-10-14 07:27:02 +02:00
commit 9d21f7f20e
Signed by: raisondetredev
GPG key ID: 07F6FCF405488B64

View file

@ -1,7 +1,8 @@
# Data the curator brings along
What the dictionaries draw on besides their sources, and never changes, so
`curate update` needs only EDRDG's files of the day and Wiktionary's dump.
`curate update` needs only EDRDG's files of the day, MDBG's CC-CEDICT and
Wiktionary's dump.
`jlpt/n1.csv` … `n5.csv` are the JLPT vocabulary lists of
[yomitan-jlpt-vocab](https://github.com/stephenmk/yomitan-jlpt-vocab)
@ -26,3 +27,15 @@ credited, and who made SUBTLEX freely available), OpenSubtitles, Wikipedia,
Google Books Ngrams and others, as wordfreq's README lists them. The Wiktionary
dictionaries take their ranks and their `common` label from them and credit
both. wordfreq's data won't change: it was sunset in 2024.
`hsk/syllabus2025_words.tsv` lists the 10,896 words of the HSK examination
syllabus published in November 2025 by the Center for Language Education and
Cooperation (中外语言交流合作中心), the one HSK 3.0's examination follows since
July 2026, each with its level (1 to 6, 7 for 7 to 9), the level of a homograph
graded twice, its pinyin and its part of speech: as extracted from the
syllabus's PDF by Alvaro Serrano's [hsk30](https://github.com/harukicoder/hsk30)
(`corpus/syllabus2025/`, as of 2026-09-06), MIT (`hsk/LICENSE.txt`), unchanged.
Only each word's level reaches the dictionaries (`hsk:N`), with the pinyin to
tell CC-CEDICT's readings of one word apart; the curator credits both. The
Ministry claims copyright on the standard's documents; a word's level is a fact
about it, which the dictionaries keep with attribution (decided 2026-10-14).