feat(curator): Tatoeba's sentences as examples in every new language
JMdict brings Tatoeba's sentences for Japanese; the other languages' dictionaries had none (CC-CEDICT) or Wiktionary's own, often quotations. Each file now takes Tatoeba's sentences of the week (its per-language exports, CC BY 2.0 FR) as its entries' first examples, which become a card's hints: each sentence with a translation into the dictionary's meaning language goes to the entries its words find, cut as the app cuts a line of subtitles (at spaces, Korean's particles off, Chinese by its longest words), up to three for each, those using the word as its headword writes it first (Haus rather than zu Hause; 学习 rather than 學習 in the simplified dictionary), then those nearest seven words long. German's common words nearly all get some (8,849 of 9,292), in ten seconds and under 300 MB; a dictionary whose sentences can't be had keeps its words. `curate tatoeba` does the same for a file made by hand. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Signed-off-by: Tizian 「ティツィアーン」 <raisondetredev@pm.me>
This commit is contained in:
parent
a2441ecdf2
commit
222175584b
1 changed files with 811 additions and 35 deletions
5
halkyon_learn_curator/test/fixtures/tatoeba-kor_sentences.tsv
vendored
Normal file
5
halkyon_learn_curator/test/fixtures/tatoeba-kor_sentences.tsv
vendored
Normal file
|
|
@ -0,0 +1,5 @@
|
|||
13191814 kor 집에서 할게.
|
||||
8533585 kor 메리는 꽃집에서 일해.
|
||||
13172354 kor 학생이야?
|
||||
13172353 kor 학생이에요?
|
||||
507619 kor 그는 이모의 집에서 머물렀다.
|
||||
|
Loading…
Reference in a new issue