halkyon/tool
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Tizian 「ティツィアーン」 a875a91f40
feat(curator): turn JMdict and the JLPT lists into dictionary files
A package of its own in the workspace, without Serverpod (AGPL, like the
tooling): an adapter per source writes one format for all, documented in
its README, which the server will load. The format is JSON Lines: a
header (source, version, languages, licence, credits), then entries with
a headword and reading, labels (`common`, `jlpt:n5`), a rank, the keys a
search matches, and the entry as cards take it. Everything specific to a
language happens in its adapter (Japanese: forms, readings in kana and
Hepburn romaji, long vowels typed once, meanings without "to" and
articles), so the server's search knows no language.

JMdict comes as jmdict-simplified's JSON, read one entry at a time: all
218,863 entries in some 20 seconds and 300 MB, 16.8 MB gzipped. The JLPT
lists (yomitan-jlpt-vocab, CC BY-SA 4.0, from Waller's CC BY lists) add
levels by JMdict entry, the easiest when a word is on several, and give
the headword its common spelling. Words rank N5 to N1, then the other
common words, then the rest.

The server's image leaves the package out, as it does the client's.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MMm7usAo6q9ZZRoPkWjoxi
Signed-off-by: Tizian 「ティツィアーン」 <raisondetredev@pm.me>
2026-10-09 18:09:25 +02:00
..
anki Fix what the first Android run found 2026-10-02 19:52:39 +02:00
maps feat(app): map questions on Japan's prefectures 2026-10-01 21:10:07 +02:00
release feat: the F-Droid repository moves to halkyon.app 2026-10-05 20:41:54 +02:00
app_icons.py fix(app): the app has its own icon instead of Flutter's 2026-10-06 22:49:25 +02:00
check.sh feat(curator): turn JMdict and the JLPT lists into dictionary files 2026-10-09 18:09:25 +02:00
fdroid_repo.sh build: the F-Droid repository shows the app's icon 2026-10-06 14:22:24 +02:00
release.sh fix: the release script checks its token on the repository 2026-10-05 21:47:03 +02:00