83 Commits
Author SHA1 Message Date
Dax 9a79a25475 make the labs card copy plain (#1929)
* make the labs card copy plain

Rewrite the Labs card titles and lines in words a regular user understands:
YOLO mode says the message sends itself, Live text and Failure notices name
the small recording indicator, Vocabulary help says which speech models it
affects, and the key-side cards name Option, Command, Shift, and Control.
Audit every other card, updating the CLI descriptions, all nine translated
languages, the website lab catalog, the feature docs, and the render goldens.

* fix labs copy review findings

Restore the ISO qualifier on the section-key card, spell out that
double-tap and hold-through shortcuts contain no letter or number key,
cover all Global mode stages in the API text card, and name the print
command in the print-start copy. Restore the developer API card titles,
fix the Annotate capture wording, and retranslate the affected strings.
Remove every replaced translation key and stale lab-name reference.

* fix second labs copy review

Update the live typing test and YOLO goldens. Add a Windows variant of the
hold-through-keys copy naming Ctrl, Alt, Shift, and the Windows key. Remove
the last unused rewrite-by-voice translation key, keep Annotate untranslated
in the replay title, and clean the remaining old lab-name comments.

* use the Polish Annotate pane name in its replay title

Polish calls the Annotate pane Adnotacje, so the Annotate last 15 seconds
title says Ostatnie 15 sekund w Adnotacjach again. Other languages keep
Annotate because their pane name is Annotate.
2026-11-16 22:32:02 -05:00
Dax 8cffd94db7 annotate: count words from transcript text when the model has no word timings (#1918)
* annotate: count words from transcript text when the model has no word timings

A model that requests no timestamps (GigaAM v3) returns its text with an
empty word list, so `transcript.words.len()` read 0: lists and JSON said
"0 words" and the capsule called it "no speech". `transcribe::word_count`
counts the model's own word times, or the words in the text when it has
none, and every capture count goes through it (finished captures, the
iPhone and screen paths, replay, and `hex capture list|show`).

* annotate: spread untimed words over the clip for the editor

A model that gives no word times (GigaAM v3) left a capture's words empty,
so a recording or annotation opened from the Captures pane read "Nothing
was said" and its Send used the placeholder text. The words path now
spreads the text over the clip with estimated times, as `hex` does out of
process, and the pane spreads a bundle already on disk the same way.
`word_count` still counts those bundles when they are listed.

* annotate: spread each untimed piece over its own audio

A model with no word times (GigaAM v3) had a multi-minute capture's whole
text spread over the entire clip, so words landed minutes away from where
they were said. Each `audio.wav` piece now spreads its own untimed text
over its own 30 s, on the same offset base as measured words, and the
estimate reaches `transcript()` so it never spreads the text again; a clip
held in memory still spreads over the whole of it.

Also fix the Captures pane's wording: an annotation's times stay on the
capture's clock, not the movie's.
2026-11-16 16:15:24 -05:00
Dax cdb96f585e capture: keep all audio in long captures (#1795) (#1894)
* capture: stream audio to disk so long captures keep all of it

A capture's timeline now writes 16 kHz mono PCM16 to its bundle's
audio.wav as it records, with the leading offset and gaps as silence, so
memory stays flat and the 20-minute drop is gone. An 8-hour guard bounds
disk use only; past it the rest is one recorded gap.

A finished capture is transcribed from the WAV in 30 s pieces, the
reader hex transcribe already used (lifted to transcription/pieces.rs),
and each piece's words move onto the capture clock. The Parakeet, Apple
(path-based), and GGUF paths keep every word without holding the
session. The pipeline never rewrites a streamed audio.wav from empty
samples, an iPhone narration is read back where it must be re-based,
and a cancelled capture closes and removes its file.

* capture: say where a capture's audio stopped

A streamed capture keeps all of its audio, but the 8-hour disk guard (or
a failed audio write) still stops it early, and only the process log
said so. The timeline now carries the stop point onto RecordedAudio,
the bundle stores it as audioStoppedAtMs (serde default, so old bundles
load unchanged), and three places say it plainly: summary.md, `hex
capture show`, and `hex capture status`.

The guard records its point at a 1 s test limit, and the summary line is
tested at 12:34 and 8:00:00 so both clock shapes are covered.

* capture: fill the replay's stop point from its bundle

The 15 s replay builds Written too, on macOS only, so the new field
broke the macOS clippy job while Linux never compiled that function.

* capture: keep a recording out of recovery until it stops

Review fixes for the streamed timeline.

A capture now streams to `audio.wav.partial` and renames it to `audio.wav`
in `Timeline::finish`, so a bundle with a movie and an in-progress audio
file is never mistaken for a capture whose build never ran (recover's
orphan rule, Scrawl.app's `scrawl recover`) and retention cleans a crashed
one like any other bundle. Cancel and discard remove the partial; a failed
publish reads it back into memory rather than pointing at a missing file.

Also: a write failure's stop point is the last sample that reached the
file, not the end of the failed chunk; a trim failure counts every written
sample; the capture's words keep one running frame total instead of
adding truncated per-piece millis; an iPhone narration's `since` drains the
decoded samples instead of copying them and treats a missing file as no
audio; the phone and replay paths carry the audio stop point into their
bundles; and empty audio answers `source: "none"`, as `transcribe_with`
does.

Tests: a movie plus partial audio is never owed, retention trashes a
crashed bundle's media, a write failure records its stop point, a missing
streamed file shifts to no samples, and the replay shift moves the stop
point with the clock.

* capture: publish audio.wav only once its build journals the capture

Follow-ups from review.

A capture now streams to audio.wav.partial and keeps that name after it
stops: the partial is renamed to audio.wav right after the build writes
unfinished.json, so audio.wav never exists without a journal, and a
stopped capture waiting in the finish queue no longer looks like an
orphan to Scrawl.app's recover. A partial that cannot take the name is
read back and written by the build, and its partial name removed; the
replay removes the unshifted partial once the narration is read for
shifting.

Also: a periodic header flush error is now a write failure (the rest of
the capture is a gap) rather than a log line; the midpoint of a failed
write records where the file stopped; and the words test cuts pieces at
odd sample counts and computes offsets from the running frame total, so
per-piece millisecond drift would fail it.

Tests: a streamed audio takes its final name only when the build settles
it (and falls back when it cannot), a capture that has not been
journaled is never owed a rebuild, a mid-capture write failure stops
where the file stopped, and the word offsets are exact at odd piece
lengths.

* capture: consume a streamed recording's partial when it is read

Follow-ups from review.

`RecordedAudio::since` and `into_memory` now remove the partial once its
samples are read: an iPhone narration (capture.rs's `host_narration`
path) used to leave the whole streamed file in the finished bundle. The
replay relies on the same path instead of removing it by hand, and the
light zip leaves `audio.wav.partial` out defensively. A read that fails
is an error to `into_memory` (so a build keeps the only copy) while
`since` still treats a missing file as no audio for an iPhone.

A failed publish now reads the audio back only when it produced the
samples the recording had; a failed read keeps the partial and removes
any half-copied `audio.wav`. `publish_audio` takes `&mut self` and points
the recording at the published file.

A journaled bundle whose `audio.wav` is missing adopts `audio.wav.partial`
before rebuilding. Docs say the guarantee is a streamed capture's, and
that a crash while recording or queued is retention's job, not
recovery's.

Tests: reading a streamed recording consumes the partial; a finished
iPhone bundle keeps none; a streamed audio is published only when its
build settles it, including the read-back and unreadable-partial cases; a
journaled capture adopts its partial.

* capture: keep a failed audio publish recoverable

Follow-ups from review.

The publish fallback read the partial with `into_memory`, which deletes
it, and then ignored whether its own write landed: a failed write left
the audio nowhere. It now reads through `read_streamed` (no deletion),
writes `audio.wav` and checks the result, and removes the partial only
once that write succeeded. A failed read or write removes any half
`audio.wav` and fails the build, which is the pipeline's existing failed
path: `recover::finished` runs only for an `Ok` build, so `unfinished.json`
stays and the next launch's recovery adopts the partial instead of the
capture quietly finishing without its audio.

`publish_audio` also treats a landed copy as success even when deleting
the partial fails, logging it rather than reporting failure and letting
the fallback overwrite a good `audio.wav`.

Tests: a blocked target keeps the partial and fails the build; a
fallback write that lands consumes the partial and writes `audio.wav`;
an unreadable partial is kept.
2026-11-16 10:28:54 -05:00
Kit Langton 804c2af789 feat(capture): Annotate suggests the OpenCode session open in a Ghostty pane, and never guesses between two (#1514)
* Annotate: route Ghostty captures by the terminal's OpenCode session and folder

* fix(capture): build the argv parser only where it's used (t1451)

* fix(capture): a TUI that moved off its command line's session names none (t1509)
2026-11-12 16:47:14 -08:00
Dax 33cb10c244 fix: find scrawl-helper from test binaries under cargo 1.100's build-dir layout (#1745) 2026-11-12 15:14:58 -05:00
Dax db338045f3 fix: find build output under cargo 1.100's new build-dir layout (#1734) 2026-11-12 14:37:40 -05:00
Dax d3721f8391 fix: windows clippy needless_bool in opencode executable check (#1731) 2026-11-12 13:45:15 -05:00
Dax ec7b6b283d labs: copy captures as a zip (#1721)
* labs: copy captures as a zip

A finished Annotate capture can go on the clipboard as one light zip
file (Labs > Copy captures as a zip, off by default): the bundle's
manifest, summary, contact sheet, and keyframes, with summary.md's
bundle path written as ".", and without its video, audio, full-size
frames, delivery markers, or an earlier copy.

crates/capture/src/slim_zip.rs writes it with STORED local headers, a
central directory, and an end-of-central-directory record (CRC-32,
UTF-8 flag, DOS timestamp; no dependency). It lands inside the bundle
beside the other files, renamed into place, so retention removes it
with the bundle.

The clipboard holds only the file: a macOS file URL, Windows CF_HDROP,
or Linux text/uri-list (X11 target or wl-copy). A failed zip build or
clipboard write logs and falls back to the normal copy.

Checks: slim_zip unit tests (CRC-32 vector, central-directory read-back,
excludes, summary rewrite, a second copy), linux/paste file_uri, the
labs switch test, and the regenerated Labs goldens. Not verified: a
real paste of the zip into a chat or agent app on any OS.

* labs: leave the light zip out of the agent host copy

The SSH light-files tar copies a bundle wholesale to the agent host, so
a capture's <stem>.scrawl.slim.zip would travel with it. Share the name
pattern as scrawl-router's SLIM_ZIP_SUFFIX/SLIM_ZIP_TEMP_SUFFIX, use it
from slim_zip, and exclude both from light_files_tar. The existing tar
test now puts the zip and its temp file in the fixture and checks they
stay out.

No other path copies a bundle wholesale: phone ingest builds a new
bundle from the movie and timeline, retention shrinks or trashes named
media, and zoom/export write their own files.

* labs: tidy the capture zip copy

Generate the zipped summary with the bundle folder as ".", so only its
header names the copy's location and transcript text is never touched.

Use strict limits before ZIP64 (0xFFFF files, 0xFFFFFFFF bytes), a
Windows path from encode_wide rather than lossy text, and the current
time for an entry whose summary.md is missing. DOS times stay UTC: the
crate has no local-time facility without a new dependency.

Show the lab row only where Annotate itself is available, under the same
Annotate policy lock, with a folder icon and a shorter description that
fits its card. Docs note the terminal paste gets no text and that the
manifest and summary still name media the zip leaves out.

* labs: match the capture zip description

Use the same shortened sentence in the Labs description the card shows.
2026-11-12 09:14:48 -05:00
Dax 9ca6bf8d77 capture: name why a capture has no screen on linux (#1709)
* capture: name why a capture has no screen on linux

A Linux capture with no screen frames was saved with the generic "the
screen recorded no frames" even when the screen source had failed, so the
summary blamed an empty screen instead of naming the real reason.

The failure is now kept when the person stops the capture rather than
dropped, so it survives into the stop. A PipeWire stream that sends no
frames fails with that reason (or says the stream sent no frames), an X11
sampler that grabs nothing fails instead of returning quietly, and the
summary's no-screen reason comes from the reason recorded for the capture.

The PipeWire buffers param also asks for at least two buffers, four
preferred, since `newest_locked` holds the last one until the next frame
arrives and a single buffer would stall.

* capture: keep the generic reason for an early x11 stop, document early stream failure

An X11 sampler only grabs nothing when the person stopped before its first grab, so it returns quietly again and the generic no-frames reason stands. The test now checks the source's failure is kept and, on Linux, that no failure falls back to the platform's literal reason.
2026-11-11 20:56:55 -05:00
Kit Langton 4ac1a79dbf fix(capture): a page that names its session beats a site rule for its host (#1627) 2026-11-09 19:37:11 -08:00
Kit Langton 582d87c8aa feat(screenshots): record the screen at full resolution in sharp HEVC (#1609)
* capture: record lab movies as full-quality HEVC

* capture: live HEVC check and microphone refusal test; docs
2026-11-09 11:58:24 -08:00
Kit Langton a65a5e375f feat(screenshots): record the screen, and keep captures until you close them (#1371)
* Talk over a screenshot: dictation words go with the shot

* Regenerate the screenshot editor goldens with the words row

* Cover the card held while someone talks over it

* Add the listening card's goldens

* Record the screen from Screenshots, ending in the corner card and a trim editor

* Move the capture timeline out, add the recording goldens and feature map

* Keep the replay's start on Windows quiet

* Keep the timeline move's imports and the replay start quiet off macOS

* Clear the record shortcut without returning its change

* Fix the macOS lints the recording left

* screenshots: only the open editor takes a dictation

A dictation taken while only the corner card showed used to talk over the
shot: the card held, showed "Listening…", and the words opened the shot in
the editor. That took the shortcut's normal paste away from everyone who
never asked for it.

Now only an open editor takes the words. While the card shows, a dictation
pastes as it did before the Lab, the card keeps its few seconds, and its
listening pill, hold and the narration path that opened the shot are gone.
The card's own card/listen/heard API goes with it, so nothing else can reach
the shot but the editor.

The i18n Screenshots rows move to i18n/labs.rs, where the Labs rows live,
so the main table stays under the source cap after dev's merge.

* screenshots: the editor's pieces come from the kit, and a shot grows in from where it was taken

The editor's toolbar was hand-made: five canvas-drawn tool glyphs in bespoke
hover chips, a bare ✕, a bare microphone, and action buttons stretched past
the kit's own height. The card's ✕ was a filled button beside them. They now
come from the rest of Hex: the tools are line icons beside the theme's own,
drawn by rune-kit icon buttons that fill while a tool is picked, ✕ and the
microphone and clear-words are the kit's ghost icon buttons like a capsule's,
and Copy, Save and Send to… are the kit's buttons at their own size. The
trim handles take the kit's corner.

A shot now grows in from the rectangle it was taken from. The card's overlay
is the whole display, so it can start anywhere on it: an area or window shot
starts at exactly the rectangle captured, at that size and place, and springs
into its corner slot on one spring that never overshoots its size, leaving
the same way. A whole-display shot keeps the slide in from the edge, and
Reduce Motion still only fades.

* screenshots: regenerate the editor and card goldens for the look pass

* docs: the card grows in from the shot's rectangle, and the editor is the kit's

* screenshots: a recording saves itself to the screenshots folder, as a shot does

* screenshots: cards stay until closed, stack in the corner, and take CleanShot's keys

* screenshots: Restore Last Capture in the menu bar brings back the card closed last

* screenshots: a Captures pane lists the last 30 days of shots and recordings

* screenshots: goldens for the card stack and the Captures pane, and its playground paths

* screenshots: the card's Return and the editor's file are macOS-only

* screenshots: pin that cards of any shape share the corner's right edge

* screenshots: keep macos_rune.rs and app_settings.rs under the file cap
2026-11-09 08:18:56 -08:00
Dax ceb07a1a5c annotate: use OpenCode in WSL when the lab is on (#1586)
* annotate: send through OpenCode in WSL when the lab is on

* annotate: address review

* annotate: dropped wsl replies read as no answer
2026-11-09 08:08:57 -05:00
Dax 1099e264ca fix: stop re-reading screen recording every 2s while idle (#1592) 2026-11-09 07:53:27 -05:00
Dax bc996e85a8 linux: open the annotate pen on the recorded output (#1515)
* linux: open the annotate pen on the output the screencast portal records

* linux: leave the pen's display alone when the named output isn't found
2026-11-07 23:14:58 -05:00
Dax b0ecc0a809 Keep capture media safe when Linux retention can't trash it (#1516)
* Keep capture media safe when Linux retention can't trash it

* docs(capture): describe staged media recovery
2026-11-07 23:05:30 -05:00
Dax 6958927696 Windows: hex.com console entry point beside the GUI hex.exe (#1374)
* Windows: ship hex.com, a console entry point beside the GUI hex.exe, on PATH

* lock, fmt, legacy adoption

* clippy

* build hex-console in its own cargo run: -p hex is ambiguous with the hex crate

* hex.com returns once the app starts; Ctrl+C only; install script and Setup replace a running hex.com; hex-console checks in Compile

* fmt

* installer test: exit 0 once every check passed
2026-11-05 06:52:51 -05:00
Kit Langton b729aab22e feat(screenshots): a click on the card opens a floating editor with pen, arrow, box, text, crop, Copy, Save and Send to… (t1344) 2026-11-04 23:29:34 -08:00
Dax afb11de5e3 dev green: split capture_host routing session naming, regenerate labs link goldens (#1339)
* split session naming out of capture_host/routing.rs

* regenerate the mac-labs-link goldens for the live auto-scroll lab (#1334)

* capture: Linux frames are pixels too in the capture size test

* fmt
2026-11-04 18:39:40 -05:00
Kit LangtonandKit Langton 3a1de64a8f Capture capsule: name the session, never its ses id (#1327)
A saved rule to a session ID is answered before the session server
answers, so the router had only the id: the pill read
"Sent to ses_e853… · too late" and the bundle's summary did too, while
the routing record had the title.

Every destination now carries a title: the name the router read, else
the capture's own session list, else OpenCode's title for that session,
else "session". The bundle, the delivery and the capsule all read it,
and the capsule's short() refuses a raw ses id from any host.

Co-authored-by: Kit Langton <kit@kitlangton.com>
2026-11-04 12:57:23 -08:00
Kit Langton 5c98c48253 Labs: ⌘⇧4 screenshots on macOS (t1300) (#1296)
* Labs: ⌘⇧4 screenshots on macOS (t1300)

* Fix the thumbnail golden's render (t1300)

* Round the thumbnail's size; list its scene in the playground (t1300)

* Keep rune_ui.rs under the size limit (t1300)

* Thumbnail goldens (t1300)

* Allow macOS-only re-exports elsewhere (t1300)
2026-11-04 11:56:24 -08:00
Ryan Vogel 5d8ff5bb6d feat(capture): record Linux screen captures at 60 fps (#1212)
Raise Linux Annotate screen recording from 30 fps to 60 fps across the
PipeWire/VA-API, PipeWire/x264, and X11/x264 paths (step L1):

- Raise `linux::media::FPS` from 30 to 60 and propagate it to both
  sampler loops, `ffmpeg` mux/encode args, and VA-API H.264 sequence
  and VUI timing (`time_scale = 2 * FPS = 120`), replacing the 30 fps
  cap (`time_scale = 60`).
- Offer `SPA_FORMAT_VIDEO_maxFramerate` 60/1 (range 1/1..60/1) and a
  60/1 default on `SPA_FORMAT_VIDEO_framerate` in PipeWire `enum_format`,
  keeping linear modifier negotiation unchanged for now.
- Compute VA-API H.264 `level_idc` from macroblocks and frame rate per
  Table A-1 (e.g. 4.2 at 1080p60, 5.1 at 1440p60, 5.2 at 4K60, replacing
  hardcoded level 5.1), allocate coded surfaces padded to 16 px
  macroblocks while setting SPS `frame_cropping_flag` and crop offsets
  (replacing `fit(..., 16)` truncation that squashed 1920x1080 to
  1920x1072 and float-truncating 3840x2160 to 2560x1438), and scale the
  `small` candidate surface on demand in `small_rgba` at
  `FRAME_SAMPLE_INTERVAL` instead of on every frame in `load`.
- Switch CPU `Writer::x264` from fixed `veryfast` to `superfast` up to
  1440p and `ultrafast` above, raise the pipe buffer to 1 MiB, and
  timestamp piped frames on the wall clock into `fps=60` inside `ffmpeg`
  instead of duplicating multi-MB raw frames across `pipe:0` when a
  screen is still or a 4K software frame runs past 16.7 ms.
- Borrow the X11 MIT-SHM segment directly into `Writer` instead of
  copying each frame into a `Vec<u8>`, and cache the XFixes cursor image
  across frames using `XFixesSelectCursorInput` (`XFixesCursorNotify`),
  pipelining `QueryPointer` with `shm_get_image` instead of fetching the
  cursor bitmap every frame.
- Update `docs/features/capture.md` (`capture.linux`) with the new
  behaviour, checks, and T4 verification limits.

Verified:
- `cargo clippy --locked -p scrawl-capture --target x86_64-unknown-linux-gnu -- -D warnings`
  and `python3 scripts/code-shape.py --check`.
- FFmpeg `trace_headers` bit-level parse of generated VA-API SPS/PPS/IDR
  headers at 1920x1080@60 (level 42, crop_bottom 4), 2560x1440@60
  (level 51), and 3840x2160@60 (level 52), all `time_scale = 120`.
- On `hex-linux-nvidia` (`g4dn.2xlarge`, Tesla T4, Ubuntu 24.04):
  273/275 `scrawl-capture` unit tests pass (the other 2 fail identically
  on clean `dev`); native Xorg 1080p60 recorded 598 frames in 9.97 s at
  60/1 (`1920x1080`, 597 grabs, 16.5% capture CPU); Xorg 1280x720 Area
  recorded 298 frames in 4.97 s at 60/1 (297 grabs); rootful Xwayland 4K
  recorded `2560x1440` at 60/1 (598 frames in 9.97 s from 282 raw 4K
  grabs); PipeWire 1080p60 SHM -> x264 recorded 598 frames in 9.97 s at
  60/1 (594 delivered). VA-API hardware encoding was not exercised live
  because Tesla T4 has no VA-API encoder.
2026-11-03 18:04:52 -05:00
Luke Parker 3a7a712315 Keep a benchmarked Hex's Annotate folders in its own home on Windows; build strobe.json on any commit (#1214) 2026-11-03 16:58:59 -06:00
DaxandHex issue pipeline 9ee2214a9c Fix #1210: Annotate capture routing to OpenCode (#1211)
Automated fix from the Hex issue pipeline (run 1210-2026-11-03t21-59-52-374z).

Fixes #1210

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-03 17:15:57 -05:00
Kit Langton fb1e06bc54 perf(annotate): show destinations while routing finishes (#1204)
* perf(annotate): show routes before remote preparation finishes

* test(annotate): refresh countdown snapshots and check remote identity
2026-11-03 13:56:25 -08:00
Kit Langton 9af39c0add Speed up Annotate routing lookups and remote checks (#1199) 2026-11-03 12:31:51 -08:00
DaxandHex issue pipeline c99d6b9f1d Fix #1179: annotate screen capture (VA-API DMA-BUF import) (#1182)
Automated fix from the Hex issue pipeline (run 1179-2026-11-03t19-19-51-347z).

Fixes #1179

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-03 14:38:52 -05:00
DaxandHex issue pipeline a77a191a61 Fix #1127: Annotate transcription speech detection (#1129)
Automated fix from the Hex issue pipeline (run 1127-2026-11-03t13-25-52-405z).

Fixes #1127

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-03 08:29:32 -05:00
DaxandHex issue pipeline f60705106e Fix #1079: Annotate capture bundle recovery (#1081)
Automated fix from the Hex issue pipeline (run 1079-2026-11-03t03-23-25-028z).

Fixes #1079

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-02 22:25:21 -05:00
Dax 7c0b507133 Keep autocrop from panicking on any frame or keyframe size (#945) (#1073)
* Keep autocrop from panicking on any frame or keyframe size (#945)

* Test only well-formed keyframes end to end; format
2026-11-02 18:20:48 -05:00
DaxandHex issue pipeline 00ab1af8e5 Fix #1042: annotate tool voice trigger words / language support (#1044)
Automated fix from the Hex issue pipeline (run 1042-2026-11-02t16-42-11-215z).

Fixes #1042

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-02 11:46:28 -05:00
DaxandHex issue pipeline 687fbb36ba Fix #999: annotate pen overlay on fractional scaling (#1001)
Automated fix from the Hex issue pipeline (run 999-2026-11-02t13-09-43-508z).

Fixes #999

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-02 08:15:33 -05:00
DaxandHex issue pipeline 6c56a40430 Fix #960: Annotate screen recording (VA-API hardware encoding on Intel+NVIDIA) (#962)
Automated fix from the Hex issue pipeline (run 960-2026-11-02t06-35-37-858z).

Fixes #960

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-02 01:40:49 -05:00
DaxandHex issue pipeline 4d09d01e14 Fix #945: Annotate capture finishing (autocrop, capsule and video) (#947)
Automated fix from the Hex issue pipeline (run 945-2026-11-02t02-47-51-230z).

Fixes #945

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-01 21:49:52 -05:00
DaxandHex issue pipeline 859137b681 Fix #853: Annotate screen capture (video encoding) (#854)
Automated fix from the Hex issue pipeline (run 853-2026-11-01t16-47-52-189z).

Fixes #853

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-11-01 11:53:38 -05:00
Kit Langton 008fec4531 Scrawl sends one contact sheet, not the keyframes (#754) 2026-10-31 21:58:10 -07:00
Kit Langton 53eb9bd080 fix(ci): remove duplicate failure field in ScreenCaptureSession test literal 2026-10-31 15:44:36 -07:00
Dax 4661987182 Annotate on X11: record the screen and areas without a ScreenCast portal (#690) (#694)
On an X11 session (DISPLAY set, WAYLAND_DISPLAY empty; never XWayland) Screen and Area are read from the X server: MIT-SHM GetImage each frame (plain GetImage without it), the pointer blended in from XFixes, 30 fps to x264 through ffmpeg. The screen is the RandR monitor under the pointer; `hex annotate start --area X,Y,W,H` records an area. i3 and other desktops without a ScreenCast backend now get video. A Window still needs the portal's picker and fails saying to record the screen or an area, never widening to the screen. When X11 capture can't start (no display, unusual depth, no ffmpeg/x264) the capture fails at once with why in the capsule instead of writing one with no picture.

Checked in a headless Xvnc + i3 session on apollo with no ScreenCast portal: an 800x500 area recorded 154 frames over 5.1 s, the 1920x1080 screen 153, each with a keyframe and the cursor. Also fixes scrawl-capture's own tests, which no longer compiled (ScreenCaptureSession.failure).

Reported and diagnosed by @nefthy.
2026-10-31 18:19:36 -04:00
DaxandHex issue pipeline 4763501a1d fix(ci): add the missing failure field to a crate test's ScreenCaptureSession literal (#692)
Check macOS failed on dev since eef51da7. Automated CI fix from the Hex pipeline (run ci-41245758514-2026-10-31t22-01-54-308z).

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-10-31 18:05:27 -04:00
DaxandHex issue pipeline ca43a4fec9 fix(ci): ignore the new Sampler failure field in the macOS run_sampler (#688)
Check macOS failed on dev since eef51da7. Automated CI fix from the Hex pipeline (run ci-41244714553-2026-10-31t21-52-01-196z).

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-10-31 17:54:34 -04:00
DaxandHex issue pipeline eef51da7e0 Fix #681: Annotate screen capture and dictation hotkey on GNOME Wayland (#683)
Automated fix from the Hex issue pipeline (run 681-2026-10-31t21-36-18-652z).

Fixes #681

Co-authored-by: Hex issue pipeline <noreply@anoma.ly>
2026-10-31 17:40:50 -04:00
Dax 154b4d402e Talk only to a running OpenCode service; quiet mic meter (#598)
* Talk only to a running OpenCode service; never spawn or probe a CLI

* wip

* wip

* Golden for OpenCode not running

* clippy

* fmt

* General's microphone meter wakes the window only while its bars show a level

* Feature map: the microphone meter rests in a quiet room
2026-10-31 12:33:36 -04:00
Dax 1018aecdbb Linux: ship the desktop entry as anomaly.hex.desktop (#582)
* Linux: ship the desktop entry as anomaly.hex.desktop (#579)

* Linux desktop entries: keep symlinks, tidy fallbacks at startup, address review

* fmt
2026-10-31 09:00:45 -04:00
Kit Langton 1e241ea593 Captures: rule offers count the session picked, not its repository (#560) 2026-10-30 22:02:22 -07:00
Kit Langton 99a1becd1e Roll in Abattoir's shared Rust lints (#557) 2026-10-30 21:49:20 -07:00
Kit Langton bed635bf79 Output: the agent card cycles through examples, written the way they ask (#548)
* Output: the agent card cycles through examples, each written the way it asks, and the spark flips smoothly between them (t694)

* Output: the old example waves out before the new one waves in, so wider words never overlap (t694)

* Format crates/capture as dev's fmt check wants (t694)

* Output goldens for the cycling agent card (t694)
2026-10-30 20:49:44 -07:00
Dax df47117bb9 Annotate on Windows: capture host, drawing overlay, and send to OpenCode (#539) 2026-10-30 22:13:11 -04:00
Kit Langton 668e981441 Capture: a permission helper instead of a silent failure, and no fake screen (#519)
* Capture: a permission helper instead of a silent failure, and no fake screen

A capture that starts without Screen Recording, Microphone, or
Accessibility is refused before it records, and the capsule opens a
helper: what's needed and why, Allow (macOS's prompt or System Settings
with the floating guide), Restart Hex when macOS needs one, then Capture.
A real capture never ships a synthetic frame: one written with no frames
goes out with its voice and marks, a 'No screen' note, and no contact
sheet.

* Allow the macOS-only capture needs on Linux
2026-10-30 15:50:16 -07:00
Kit Langton 1421b12306 feat(capture-core): add additive v1 take metadata and sidecar readers (#514) 2026-10-30 15:10:44 -07:00
Dax 0c45672abb Annotate: the pen draws on Linux; drop sends to a session that's gone (#498)
The ink overlay switched to its hit regions when drawing began, but only laid its view out again when the ink changed, so with nothing drawn yet it had no regions and every click and move went through to the app: the pen lit and nothing drew (the held key too). A drawing change now lays it out.

Reproduced in headless sway on apollo with dev-289 (no stroke) and fixed with this build (pointer moves and a drag draw on screen and land in scrawl.json; the pen clicks off through the overlay's hole over the capsule).

Queued sends give up at once when OpenCode says the session is gone (404), and after 20 tries at most, instead of retrying every 30 minutes for a day.
2026-10-30 13:54:55 -04:00