Tizian 「ティツィアーン」
8820cefde3
For parity with Japanese's KANJIDIC2 and kana: - Unihan (Unicode License v3) makes characters' dictionaries: the 8,105 standard simplified characters (unihan-hans) and the traditional ones in use (unihan-hant), told apart and ranked by CC-CEDICT's words (Unihan calls 这 its own traditional variant; 後 ranks as the 后 of 以后), with pinyin, meanings, strokes, Kangxi radical, HSK 2025 character levels, the 3,500 common ones and Hong Kong's grades; and Korean Hanja (unihan-ko) with their sounds, the 1,800 of education, and their native readings from Wiktionary (물 수), with the 40 Hangul letters as kana are. - The Greek alphabet, the curator's own (CC0): letters with names, transliteration and sound. - KRDict, the Basic Korean Dictionary for learners (CC BY-SA 2.0 KR, downloaded without an account), replaces Wiktionary for Korean's words: learners' levels, pronunciation where it differs from the spelling (같이 [가치]), Hanja, English senses; Wiktionary's update keeps the words' forms (가다's 99) and the Hanja's readings beside it for both. - The update converts KRDict when its page offers another export and the characters weekly, and removes the files of languages no longer kept or of sources replaced. Measured on the real data: Unihan 3 s; KRDict 54,870 entries in 24 s and under 600 MB. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Tizian 「ティツィアーン」 <raisondetredev@pm.me>
72 lines
4.3 KiB
Markdown
72 lines
4.3 KiB
Markdown
# Test data
|
|
|
|
`jmdict-eng-sample.json` holds six entries of JMdict 3.6.2 (2026-10-05) as
|
|
jmdict-simplified writes it (<https://github.com/scriptin/jmdict-simplified>):
|
|
JMdict is © the Electronic Dictionary Research and Development Group, used under
|
|
its licence, CC BY-SA 4.0 (<https://www.edrdg.org/edrdg/licence.html>).
|
|
|
|
`jlpt/` holds a few rows of the JLPT lists of yomitan-jlpt-vocab
|
|
(<https://github.com/stephenmk/yomitan-jlpt-vocab>), CC BY-SA 4.0, from Jonathan
|
|
Waller's lists (<http://www.tanos.co.uk/jlpt/>), CC BY; one row without an id is
|
|
made up.
|
|
|
|
`kanjidic2-sample.xml` holds five characters of KANJIDIC2 (database version
|
|
2026-282) with its header and a shortened DTD: KANJIDIC2 is © the Electronic
|
|
Dictionary Research and Development Group, used under its licence, CC BY-SA 4.0
|
|
(<https://www.edrdg.org/edrdg/licence.html>).
|
|
|
|
`kanji-data-sample.json` holds four entries of kanji-data's `kanji.json`
|
|
(<https://github.com/davidluzgouveia/kanji-data>), cut to their numbers, from
|
|
KANJIDIC2 and from Jonathan Waller's JLPT levels (<http://www.tanos.co.uk/jlpt/>),
|
|
CC BY.
|
|
|
|
`kanjivg-sample.xml` holds four characters of KanjiVG (the release of
|
|
2026-07-14) with its notice, among them 橅, whose entry names itself 機:
|
|
KanjiVG is © Ulrich Apel, CC BY-SA 3.0 (<https://kanjivg.tagaini.net>).
|
|
|
|
`jmdict-e-examp-sample.xml` holds five entries of EDRDG's `JMdict_e_examp.gz`
|
|
of 2026-10-09 (JMdict with Tatoeba's sentences, CC BY 2.0 FR) and the
|
|
declarations of the entities they use: JMdict is © the Electronic Dictionary
|
|
Research and Development Group, used under its licence, CC BY-SA 4.0
|
|
(<https://www.edrdg.org/edrdg/licence.html>).
|
|
|
|
`wiktionary-sample.jsonl` holds 31 lines of kaikki.org's Wiktextract data of the
|
|
English Wiktionary (the dump of 2026-10-03, read per word from kaikki.org): the
|
|
German Haus, Häuser, Häusern, essen, aß, gegessen, Straße and im, the Greek σπίτι,
|
|
σπιτιού and γράφω, the English house, houses, go and went, the French maison,
|
|
the Korean 먹다, 집 and 학생, and the Korean entry of the Han character 水 (its readings,
|
|
물 수), each shortened to the fields the curator reads (no categories,
|
|
etymologies or related words; at most six senses, two examples, 40 forms, two
|
|
sounds, and 14 translations, those into German and Greek). Wiktionary's text is
|
|
by its contributors, CC BY-SA 4.0 (<https://en.wiktionary.org/wiki/Wiktionary:Copyrights>);
|
|
the extraction is Tatu Ylonen's Wiktextract (<https://kaikki.org>).
|
|
|
|
`cedict-sample.txt` holds CC-CEDICT's header and 23 of its lines (MDBG's file of
|
|
2026-10-13): 中国, 了, 女儿, 学习, 书, 熊猫, 略, 的, 说, 银行, 和 and 咊, an old
|
|
variant of 和, with their readings. CC-CEDICT is by MDBG and its contributors, CC BY-SA 4.0
|
|
(<https://www.mdbg.net/chinese/dictionary?page=cc-cedict>).
|
|
|
|
`tatoeba-*.tsv` hold a few lines of Tatoeba's exports of 2026-10-10
|
|
(<https://downloads.tatoeba.org/exports/per_language/>): German, Chinese and
|
|
Korean sentences using Haus, aß, Straße, 学习, 집에서 and 학생이 (and one of each
|
|
without an English translation), the links to their English translations, and
|
|
those translations. The sentences are by Tatoeba's contributors, CC BY 2.0 FR
|
|
(<https://tatoeba.org/en/terms_of_use>).
|
|
|
|
`unihan-sample.txt` holds the lines of Unihan 18.0.0 (2026-07-31,
|
|
<https://www.unicode.org/Public/UCD/latest/ucd/Unihan.zip>) the curator reads for
|
|
水, 说, 說, 説, 這, 这, 了, 瞭, 后, 後, 行, 们, 們, 学 and 學, with a header like its
|
|
files'. The Unihan Database is © Unicode, Inc., under the Unicode License v3
|
|
(<https://www.unicode.org/license.txt>).
|
|
|
|
`cedict-characters-sample.txt` holds 17 lines of CC-CEDICT (MDBG's file of
|
|
2026-10-14) for the words those characters write (這, 了, 瞭, 瞭解, 為了, 後, 后,
|
|
以後, 皇后, 們, 我們, 說, 水, 行, 銀行, 學 and 學習), CC BY-SA 4.0 as above.
|
|
|
|
`krdict-sample.json` holds six entries of KRDict's JSON export of 2026-09-19
|
|
(<https://krdict.korean.go.kr/download/downloadPopup>): 같이 (the adverb and the
|
|
particle), 가다 with its proverb 가는 날이 장날, 읽다 and 학교, each cut to its first
|
|
three senses, their English and Japanese equivalents and two examples, without
|
|
sound files or related words. 한국어기초사전 is by the National Institute of
|
|
Korean Language (국립국어원), CC BY-SA 2.0 KR
|
|
(<https://krdict.korean.go.kr/kboardPolicy/copyRightTermsInfo>).
|