25 Commits
Author SHA1 Message Date
Luke Parker b02e240f71 perf: listening bench waits for the listener before measuring rest (#1615)
A new build's first launch compiles the GPU driver's shaders while the model loads. On a busy machine that ran past the fixed 10 s setup into the measured runs, so listening-at-rest read 1-2.5 s of cpu.work instead of about 10 ms. Setup now waits for session_started in the copy's event log, then 2 s, and at least 10 s. The listening profiles also move the copy's shortcuts to F19 and F18, as the dictation profiles do.
2026-11-09 16:19:11 -06:00
Luke Parker 98e4c37fac perf: switch-panes waits for the window to go idle between pane clicks, untimed (#1447)
* perf: switch-panes waits for the window to go idle between pane clicks, so each click can be an interaction sample

* perf: switch-panes idle waits through ctx.untimed (strobe 0.14), without gpu.process.3d
2026-11-06 06:34:03 -06:00
Luke Parker 5b548e5f0b perf: idle window-open waits for General's switches before its runs (#1438)
strobe 0.9+ refuses a block whose runs start from different states (ResetIncomplete). On macOS run 1 started before General had its Launch at login and microphone switches (login item still Checking, the tree not yet complete), so window-open failed every block. The window target's setup now waits until the switches hold still.
2026-11-05 18:56:37 -06:00
Luke Parker 0cee3b6be3 perf: history-search reset selects all with Command on macOS (#1395) 2026-11-05 10:31:23 -06:00
Luke Parker d2be1ef32e perf: fix the model-picker case and the macOS tray launch the benches use (#1389)
The model-picker case clicked Back while the picker panel still sprang to
the full list's height, so the click missed and the case timed out on
macOS. It now waits for the window to rest between views.

macOS `hex app` had no `--hidden` flag, so the benches' tray targets
(`hex app --hidden`) exited with a usage error at once and measured
nothing. `hex app --hidden` now starts in the menu bar without the window,
as on Linux and Windows, and skips the GPU prewarm.
2026-11-05 09:19:48 -06:00
Luke Parker c14ab98a71 perf: interaction.bench.ts clicks and scrolls on macOS too (#1354)
strobe's Quartz clicks switch Hex's panes and its scroll moves History on
macOS now, so the bench drives macOS as it does Windows and Linux: pane
switches are clicks (interaction.* instead of PatternInput) and History
scrolls with page.scroll instead of 200 px wheel ticks.
2026-11-04 22:50:08 -06:00
Luke Parker 3a5958b90f macOS: the window and HUD draw with Rune's Metal backend, not wgpu (#1347)
Rune 90355ba: the native Metal backend offers IMMEDIATES, which the
window's and HUD's compositors ask for (their Painter), so they no
longer fall back to wgpu, and the window keeps the prewarmed device.
process.log names the backend each window and HUD device draws with
(rune::describe_gpu). launch.bench.ts gains first-frame;
interaction.bench.ts measures gpu.process.3d and drives macOS through
accessibility and the wheel.
2026-11-04 19:52:55 -06:00
Luke Parker a193abe459 perf: strobe 0.7 PR workflow in the docs, and screen checks on window and site cases (#1346)
docs/perf.md and site/README.md: authors write their own text; strobe report experiment <exp> --format pr --update-pr <n> places strobe's generated block. Window cases expect the Hex title and their pane's heading, the site bench its page title and address, so a block on another screen is refused WrongScreen.
2026-11-04 19:40:02 -06:00
Luke Parker f7749f7ad4 Benches on macOS: the hex profiles record the identity migration (no first-run tour over the window); the start case runs on Windows and Linux (#1324) 2026-11-04 14:34:13 -06:00
Luke Parker ed74458a37 Windows and Linux read the browser's page only when processing uses it (#1266)
* Windows and Linux read the browser's page only when processing uses it

macOS asks a browser for its page only while a website mode, an OpenCode
rewrite, or a script transformation is set up. Windows walked the focused
browser's UI Automation tree on every browser dictation, and the paste
waited up to 300 ms for it; Linux asked AT-SPI for every dictation, before
the paste, for up to 400 ms.

ModeRuntime now keeps the same rule (`reads_page`, from the predicate macOS
uses). Windows starts no UIA walk without it, and Linux asks AT-SPI only for
the page or for the process of a window the display server names no other
way. A dictation without processing never reads the page.

perf/dictation.bench.ts gains a Windows `browser` case: Edge in front on a
long local page, then the dictation case's stop.

* dictation bench: the browser case runs on Linux too (Chromium on X11, espeak-ng speech)
2026-11-04 13:15:47 -06:00
Luke Parker 7a1d4c3872 perf: say that strobe keeps GPU shader caches warm, so cold-launch is a returning user's launch (#1281)
strobe 0.6.0 keeps each variant's compiled shaders across its launches by default (gpuCache warm). docs/perf.md says what that means for the cases and when a target would need gpuCache cold.
2026-11-04 09:16:30 -06:00
Luke Parker e89deec505 macOS: Metal's residency heartbeat sleeps once its keep-alive runs out (transcribe.cpp 2778ae4) (#1258) 2026-11-04 06:04:56 -06:00
Luke Parker 1a7b6cfd7f Accessibility: name Hex's panes and controls; interaction benches through UI Automation (#1220)
* Accessibility: name Hex's panes and controls for screen readers and strobe

* Rune c35fe19; pane_header beside title_bar; rows report selected only when selected

* Drop the unused title_bar import

* Tests: microphone row at the tall size; say what the tree held when a key is missing

* Tests: read the microphone field with its menu closed

* Rune f6799d3
2026-11-04 05:30:06 -06:00
Luke Parker 574e0b899f macOS: hex dictation and paste-last skip the main thread's pump (#1241) 2026-11-04 02:24:20 -06:00
Luke Parker 3f8aa05af1 perf(windows): tray Hex makes no GPU device at rest; the HUD still shows fast (Rune c448a35a) (#1229)
* perf(windows): tray Hex makes no GPU device until something shows

Rune 4c039671. The capture capsule, picker, and ink keep their windows from
launch but make their GPU surfaces only to show (release_gpu_when_hidden).
gpu-draw.pending is written when Rune starts the launch's first GPU device
(rune::on_gpu) and cleared by its first frame, so a tray launch that never
draws leaves no marker.

* perf(windows): the first HUD after rest shows without waiting for the GPU

Rune c448a35a. A first surface on a new device now takes about 210 ms to its
first present instead of 630 to 850 ms (precompiled DX12 uber shader, one
adapter enumeration). The HUD keeps its window from launch, keeps its GPU
surface for 5 minutes after its last hide (release_gpu_after), then gives the
device back. When the dictation shortcut's modifiers go down, Rune makes the
device and the HUD's pipeline on a thread (warm_gpu_with), so the HUD that
follows shows in about 15 ms.

* docs(capture): the picker is prewarmed again; it holds no GPU surface while hidden
2026-11-04 01:49:43 -06:00
Luke Parker a7cd40e3b6 Windows listener: take tray and hex commands at once while idle (#1237)
* Windows listener: take tray and hex commands at once while idle

With the microphone released the idle listener waited up to 50 ms on shortcut events only, so a hex dictation start or a tray command waited out that timeout before the microphone began to open. The loop now parks; the keyboard hook and every command sender unpark it.

* bench: dictation start with the microphone released (phase.start)
2026-11-04 00:28:58 -06:00
Luke Parker 3b66d3bdc0 Windows listener: stop polling every 5 ms while it records (#1232)
* Windows listener: stop polling every 5 ms while it records

With the microphone streaming, its chunks (about every 10 ms) wake the loop while it records too, as they already did while idle: shortcut events and commands are taken at the next chunk, and a release's tail ends on one. A shortcut's audio boundaries come from its event's own time, so nothing about the clip changes. Only an opening or recovering microphone is still polled. Adds perf/dictation.bench.ts (recording) on HEX_AUDIO_FIXTURE.

* bench: name the fixture PR
2026-11-03 23:42:35 -06:00
Luke Parker aba7efbbf3 Windows: make the capture picker at its first open (#1226)
On Windows a prewarmed overlay keeps no pixels while hidden, only its
surface. The picker's surface covers the whole primary display, so a tray
Hex held it in GPU memory from launch. The picker is now made the first
time it opens. It shows only before the capture it starts, so that
capture still knows its window. The idle memory case also reports
gpu.vram.
2026-11-03 21:30:04 -06:00
Luke Parker 1982f5313f perf(windows): draw on the GPU that drives a display; tray Hex holds 360 MB less (#1223)
* perf(windows): draw on the GPU that drives a display (Rune pin)

* nix: Rune ae0c9499 output hash
2026-11-03 19:16:07 -06:00
Kit Langton fb1e06bc54 perf(annotate): show destinations while routing finishes (#1204)
* perf(annotate): show routes before remote preparation finishes

* test(annotate): refresh countdown snapshots and check remote identity
2026-11-03 13:56:25 -08:00
Luke Parker 9f52e8dafd perf: run tray, hidden-launch, and listening benches on a locked session (#1205)
Tray targets use strobe's windowless native target; a hidden launch ends on the local API's start line; listening cases with released and open microphone profiles.
2026-11-03 15:21:32 -06:00
Kit Langton 9af39c0add Speed up Annotate routing lookups and remote checks (#1199) 2026-11-03 12:31:51 -08:00
Luke Parker e5ccf0c3ea Let strobe launch an isolated Hex (#1180)
* Let strobe launch an isolated Hex

Scope the Windows instance event to a custom data root, read ~/.config/hex from USERPROFILE on Windows, add HEX_DISABLE_UPDATES, name the UI and remaining long-lived threads, and add the strobe profile and feature, strobe.json, perf benches, and docs/perf.md.

* strobe.json: keep the copy out of the Hugging Face cache

* strobe.json: keep seeded history

* Windows instance event: keep the default event for the default root

Naming the default data root in HEX_APPLICATION_SUPPORT_DIR must not let two apps share it.
2026-11-04 06:05:58 +10:00
Kit Langton 3e166524bc feat: expand dictation tooling and TypeScript SDK 2026-07-22 20:58:27 -04:00
Kit Langton b167167242 feat: ship HEX 2.0.9 2026-07-17 19:48:51 -04:00