mirror of
https://github.com/anomalyco/hex.git
synced 2026-11-21 17:56:51 +08:00
* iOS: emoji index built from Unicode's emoji list and CLDR
What changed
- scripts/build-emoji-data.py builds HEXShared/FullKeyboard/Emoji/emoji-index-<lang>.txt
for the four keyboard layouts (en, nb, es, de) from Unicode emoji-test.txt 18.0
(pinned by SHA-256) and CLDR 49 annotations and annotationsDerived (release-49 tag),
plus Hex's own chat words in scripts/emoji-aliases-en.txt ("congrats", "bday",
"lol", "new year"; 336 words, written for Hex).
- Each file holds the catalog in panel order (8 categories, 1,923 emoji, 332 with five
uniform skin tones), each emoji's English name, its folded search words, and the
word and phrase postings already weighted (one-word name 1.0, name word 0.75,
keyword 0.6, keyword-phrase word 0.3, chat word 1.2 down to 0.9, an IDF factor for
words many emoji share), sorted by key so the keyboard can binary-search the file
in place. Non-English layouts carry English's words at 0.85.
- LICENSE-Unicode.txt (Unicode License v3) ships beside the data, as the licence
asks: both emoji-test.txt and CLDR's data are under it, which allows commercial
use with the notice.
Why
- The emoji panel (next commits) suggests emoji for what you type and searches them
on the iPhone. Precomputing the index keeps the keyboard extension's heap small:
the first version built Swift dictionaries at runtime and held 5.7 MB, which
malloc kept after release; the mapped file plus offsets measures 0.7 MB.
Verified
- The generator runs from a sources folder or downloads the pinned files; output is
deterministic. Files: en 351 KB, nb 560 KB, es 549 KB, de 610 KB.
* iOS: rank emoji for the text before the cursor, on device
What changed
- EmojiLibrary maps an emoji-index file (Data .alwaysMapped) and keeps only the emoji,
their skin tones and byte offsets: word and phrase lookups binary-search the file's
sorted keys and parse postings in place; search scans each emoji's folded name and
keyword words for prefixes (name words first, a short name the query fills before a
long one it touches, then your use and everyday emoji). Emoji newer than 15.1 are
listed only if the emoji font itself draws them as one glyph.
- EmojiSuggester reads the last eight content words (the newest counts 1, then 0.85
each word back), their forms (plurals, -ing, -ed, held-down letters: "lmaooo"),
two- to four-word phrases ("new year", "good luck") and the word still being typed;
an emoji several words point at gains a third of the rest. One emoji per family
("man running", "woman running"); your use breaks ties and fills the row, then
everyday defaults. forFinishedWord gives the strip at most three strong matches for
the word just finished ("pizza " -> 🍕).
- EmojiUsageStore keeps, in the App Group, a use count per emoji that halves every 10
days (frequency and recency in one score, at most 120 emoji) and the skin tone last
picked for each; no words. clear() empties both.
- EmojiRoutedTarget lets the keys type into the emoji search's query instead of the
field while you search.
- EmojiSemanticIndex (app target only, for the comparison test): Apple's on-device
NLEmbedding word vectors over the index's 3,257 words, standing in for a context word
with no emoji of its own. Not used by the keyboard (see Measured).
- EmojiSuggesterTests: index, folding, context, families, endings, other layouts,
strip, search, history decay and tones, the search's routing, and quality on 60
hand-written sentences (Fixtures/emoji-context-sentences.json, 30 to tune, 30 held
out) with and without the embedding.
Measured (sensible emoji in the top 5, context only; top-1 in brackets)
- Simulator, iPhone 17, iOS 27.2: keywords dev 30/30 (27), held-out 30/30 (27), 0.04 ms
a sentence; with the embedding the same counts at 0.14 ms, its index built in 120 ms.
- Mac harness, same code: CLDR keywords alone dev 26/30 (13), held-out 22/30 (14);
with Hex's chat words 30/30 (27) and 30/30 (27). A blind set of 40 messages and
sensible emoji written by a separate agent that saw no code or word lists: CLDR
alone 30/40 (13), with chat words 37/40 (28), adding the embedding 37/40 (28); 38/40
after the held-down-letter rule, which those failures suggested. Apple's sentence
embedding scored 18/40 (7) and took 7.5 s to embed the 1,923 descriptions.
- Memory on the Mac: the mapped index adds 0.72 MB; the embedding adds 5.3 MB (1 MB
NLEmbedding, 3.9 MB vectors) and none of it came back after release. No measurable
gain for that, so the keyboard uses keywords and your history only.
Verified: xcodebuild test on an iPhone 17 simulator (iOS 27.2): 245 tests, 1 skipped,
0 failures.
* iOS: emoji panel for the full keyboard (Experiments › Emoji)
What changed
- Experiments › Full keyboard › Emoji (experiments.emoji, off by default; shown with the
full keyboard): an emoji key (face.smiling) right of 123, after the globe, in plain
text fields (not URL, email or ASCII-only ones). The bottom row takes the compact
sizes it uses beside the globe. "Clear emoji history" empties EmojiUsageStore.
- EmojiPanelView replaces the strip and the keys: a row of up to ten suggestions for
the text before the cursor and your history (one emoji per family, your skin tone),
a search button; a grid that scrolls sideways through Frequently used (your history,
then everyday emoji, 16 at least) and the eight categories in four rows of 42 pt
(three of 38 in landscape), each section's name kept at the left edge while it
scrolls; a bar with ABC, the categories and a repeating delete, drawn like the
letter keys' 123 and delete. Holding an emoji with skin tones opens the accent
picker with its five tones; the pick is typed and remembered for that emoji. Key
pop-ups and haptics follow their switches.
- Search: the letter keys type into a search field in the strip (EmojiRoutedTarget),
results above it in a row the keyboard grows 44 pt for, your suggestions while it's
empty; return, the field's close button or the emoji key go back to the panel.
Typing logs and Learn how I type see the emoji typed into the field, never the query.
- The strip, when it would be empty after a space, offers the finished word's strong
emoji ("pizza " -> 🍕, "birthday " -> 🎂 🎉 🥳), a lone one in the centre slot; never
over word suggestions, Undo dictation, a status or the clipboard chips.
- Grid cells drop their text (and bitmap) when they scroll off and prefetching is off:
scrolling every section had kept 353 cell bitmaps, 35 MB.
- FullKeyboardView+Emoji.swift holds the wiring; the engine's target is now the routed
target, which forwards everything to the field unless a search is open.
- Scenes: full-keyboard-emoji, -emoji-search (--emoji-query), -emoji-tones,
-emoji-food, -emoji-strip (each -dark and -dark-field), and -emoji-probe, which prints
the panel's footprint and open latency.
Measured in the keyboard extension (Release, iPhone 17 simulator, iOS 27.2, a field
focused with the real HEXKeyboard.appex and a temporary, uncommitted probe; the
simulator counts no GPU memory and reports no headroom), footprint:
keyboard with the emoji key, nothing loaded 19.0 MB
after "pizza " (the strip loads the index) 19.0 MB
panel open 28.7 MB
picked three suggestions, closed 22.7 MB
every section scrolled 41.6 MB (peak 48.4; 71.1 before the cell fix)
closed after that 36.5 MB
The 17.5 MB left after browsing everything is about 351 emoji glyph images the system's
text rendering caches process-wide (18.7 MB in the heap, 351 CGImages); drawing with a
font instance the panel owns or at 21 pt left it the same, and no public API frees it.
Whether iOS purges it under memory pressure is unverified on an iPhone.
Opening: 22-26 ms from the emoji key to the panel laid out the first time, 12-14 ms
after (median of 10), about 21 ms until committed.
Verified: xcodebuild test (245 tests, 1 skipped, 0 failures); every scene above in
light, dark and dark field looked at on the simulator.
* iOS: document the emoji experiment and keep its blind sentences as a check
What changed
- README: the emoji experiment under Capabilities (what the panel, search, skin tones
and strip do, what the history keeps, where the index comes from and its licence),
how to rebuild the index, and its proof limits with the quality, memory and latency
measurements and what is unverified on an iPhone (whether iOS purges the cached
emoji glyph images that browsing every section leaves, about 18 MB).
- emoji-context-sentences.json gains the 40-message blind set a separate agent wrote
without seeing code or word lists; EmojiSuggesterTests scores it beside the other
60 and fails below 35/40.
Why: the blind set is the least biased quality number; keeping it catches a ranking
change that helps the hand-written sentences at its expense.
Verified: xcodebuild test on an iPhone 17 simulator (iOS 27.2): 245 tests, 1 skipped,
0 failures; EMOJI_QUALITY: dev 30/30 (top-1 27), held-out 30/30 (27), blind 38/40 (29),
the same with the embedding, which built in 101 ms.