Martin Vogel e628d9d297 test(bench): make the py-lsp time budget a liveness backstop, not a perf gate ...

test_py_lsp_bench.c:262 failed the v0.10.0 release run TWICE on genuine
attempts (ubuntu-24.04-arm 3/3), while the SAME sha passed that shard in the
morning's dry run. A wall-clock bound on a shared 4-vCPU runner is not a
property of the code, and this repo's testing doctrine says exactly that:
perf tests assert a ratio; a time bound may exist only as a liveness backstop.

This test's perf content already IS ratio-form (resolution ratio with a
sanitizer-aware floor). The 150/1500 ms budget was the anti-pattern half.
It becomes a 30 s liveness backstop so a catastrophic hang still fails the
suite rather than the 900 s shard wall clock, and absolute timings stay where
they belong: scripts/benchmark-*.sh, which record rather than gate.

Signed-off-by: Martin Vogel <martin.vogel.tech@gmail.com>

2026-08-10 16:40:31 +02:00

..

fixtures

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

repro

fix(tests): portable env calls in the parallel-determinism repro

2026-08-03 01:51:30 +02:00

windows

test(windows): keep and dump the worker log for the failing CLI probe

2026-08-10 02:12:48 +02:00

grammar_cases.h

Add per-grammar regression suite across all 159 grammars

2026-06-05 21:53:25 +02:00

scale_contract.sh

Add per-grammar regression suite across all 159 grammars

2026-06-05 21:53:25 +02:00

smoke_guard.sh

feat: add coverage-aware agent integrations

2026-07-13 01:50:03 +02:00

test_ac.c

Resolve all clang-tidy, cppcheck, and clang-format warnings across 94 files

2026-03-15 22:37:34 +01:00

test_activation_transaction.c

fix(windows): absorb transient file locks when retiring a running image

2026-07-28 22:49:22 +02:00

test_agent_clients.c

feat(install): install generated pi and OpenCode extensions

2026-07-31 22:02:19 +02:00

test_agent_profiles.c

fix(install): declare a transport in generated Codex agent role TOMLs

2026-08-01 17:36:21 +04:00

test_arena.c

fix(arena): NULL-arena guard in cbm_arena_alloc; skip vendored/ dirs

2026-05-30 18:26:44 +02:00

test_artifact.c

fix(artifact): snapshot exports consistently and refuse corrupt imports

2026-07-11 03:28:32 +02:00

test_ast_profile.c

fix: char buf[1] = "X" → {'X'} for -Wunterminated-string-initialization on Windows/clang

2026-06-29 09:45:28 -06:00

test_build_dir_safety.sh

fix(daemon,win): CI-green fixes and a daemon-stability guard

2026-07-22 17:48:20 +02:00

test_c_lsp.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_call_reference_contract.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_cli.c

revert(release): re-embed runtime assets into the single shipped binary

2026-08-09 13:06:42 +02:00

test_config_json_like.c

feat(cli): expand agent integration coverage

2026-07-13 01:50:02 +02:00

test_config_text_edit.c

fix: eliminate installer filesystem races

2026-07-14 21:13:52 +02:00

test_config_toml_edit.c

style: apply current C formatting

2026-07-13 02:00:32 +02:00

test_config_yaml_edit.c

fix: eliminate installer filesystem races

2026-07-14 21:13:52 +02:00

test_configlink.c

WIP: strict linting + RAM-first pipeline (lint fixes pending)

2026-04-01 23:22:44 +02:00

test_convergence_probe.c

test(extract): bind the Java interface/enum method dedup fix (#1234)

2026-08-04 16:37:06 +02:00

test_cpp_index_hang.sh

Fix O(n^2) overload resolution in the C/C++ cross-LSP registry (#410)

2026-06-06 22:16:04 +02:00

test_cross_repo.c

fix: close remaining daemon coordination races

2026-07-18 15:26:38 +02:00

test_cs_lsp_bench.c

test: sanitizer-keyed budgets and a causality-based httpd interruption proof

2026-07-23 17:36:00 +02:00

test_cs_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_cypher.c

fix: bound response buffers, parse depth and glob matching

2026-08-05 23:27:48 +02:00

test_daemon_application.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_daemon_bootstrap.c

revert(release): re-embed runtime assets into the single shipped binary

2026-08-09 13:06:42 +02:00

test_daemon_frontend.c

daemon: permanent lifecycle, daemon-backed CLI/hooks, real-Windows hardening, long-path launcher transactions

2026-07-21 15:32:15 +02:00

test_daemon_ipc.c

Merge pull request #1226 from Oxygen56/fix/windows-werror-build

2026-07-31 01:53:49 +02:00

test_daemon_open_readiness.py

revert(release): re-embed runtime assets into the single shipped binary

2026-08-09 13:06:42 +02:00

test_daemon_runtime_contract.h

fix: stabilize cross-platform daemon coordination

2026-07-18 11:48:59 +02:00

test_daemon_runtime.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_daemon_smoke.py

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_daemon_version.c

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_daemon.c

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_diagnostics.c

daemon: permanent lifecycle, daemon-backed CLI/hooks, real-Windows hardening, long-path launcher transactions

2026-07-21 15:32:15 +02:00

test_discover.c

fix: size the compress path with size_t and prune the cache from the walk

2026-08-06 16:06:43 +02:00

test_dump_verify_io.c

Add post-dump plausibility gate returning status:degraded (#334)

2026-06-23 06:38:45 +09:00

test_dump_verify.c

Add post-dump plausibility gate returning status:degraded (#334)

2026-06-23 06:38:45 +09:00

test_dyn_array.c

Fix Windows build: add missing stdint.h include in test_dyn_array

2026-03-25 09:28:11 +01:00

test_edge_imports.c

fix(test): free the fixture project name before reindexing

2026-08-06 18:15:48 +02:00

test_edge_structural.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_edge_types_probe.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_extraction_imports.c

Add language-agnostic extraction reproduction suite (inheritance + imports)

2026-06-07 12:35:53 +02:00

test_extraction_inheritance.c

Fix CI lint: drop debug scaffolding, make lisp import walker iterative, apply clang-format

2026-06-08 22:55:23 +02:00

test_extraction.c

test(extract): bind the Java interface/enum method dedup fix (#1234)

2026-08-04 16:37:06 +02:00

test_fqn.c

fix(fqn): preserve full filename in File-node QNs so sibling files don't collide

2026-07-16 01:21:45 +02:00

test_framework.h

Forbid test skips and convert existing skips to hard failures

2026-06-05 21:53:25 +02:00

test_git_context.c

fix(test): guard git_context git helpers behind #ifndef _WIN32

2026-07-02 00:37:52 +02:00

test_gitignore.c

fix(test): guard the POSIX-only includes in the gitignore test

2026-08-06 03:30:32 +02:00

test_go_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_grammar_imports.c

Add per-grammar regression suite across all 159 grammars

2026-06-05 21:53:25 +02:00

test_grammar_labels.c

Merge remote-tracking branch 'origin/main' into qa/call-reference-rebase

2026-08-01 01:29:20 +02:00

test_grammar_probe_a.c

Add grammar-only probe suites (~35 code grammars); +1 new root-cause class

2026-06-07 19:13:01 +02:00

test_grammar_probe_b.c

Add grammar-only probe suites (~35 code grammars); +1 new root-cause class

2026-06-07 19:13:01 +02:00

test_grammar_probe_c.c

Add grammar-only probe suites (~35 code grammars); +1 new root-cause class

2026-06-07 19:13:01 +02:00

test_grammar_probe_d.c

fix(test): resolve 18 make-test regressions from the marathon batch

2026-06-27 16:23:26 +02:00

test_grammar_probe_e.c

Complete 159-grammar coverage: IDL/template/IaC/markup/remaining-code probes; +1 new class

2026-06-07 20:05:24 +02:00

test_grammar_probe_f.c

Complete 159-grammar coverage: IDL/template/IaC/markup/remaining-code probes; +1 new class

2026-06-07 20:05:24 +02:00

test_grammar_probe_g.c

fix(test): resolve 18 make-test regressions from the marathon batch

2026-06-27 16:23:26 +02:00

test_grammar_regression.c

Add Mojo language wiring

2026-07-08 00:05:19 +05:30

test_graph_buffer.c

fix(graph): IMPORTS edges keyed by local_name across buffer, store and dump

2026-07-03 20:16:39 +02:00

test_hash_table.c

perf(foundation): swap CBMHashTable internals to Verstable v2.2.1

2026-05-21 22:52:16 +02:00

test_helpers.h

fix: harden daemon release paths and verification

2026-07-24 16:08:42 +02:00

test_hook_conflict_notice.sh

fix(tests): resolve the prod binary from CBM_TEST_BINARY, not a hardcoded build/c

2026-08-06 00:33:34 +02:00

test_httpd.c

test(httpd): a missing embedded frontend is a permanent 404, not a retryable 503

2026-08-09 16:37:19 +02:00

test_incremental.c

fix(msan): split the known-red block by cause; fix the RSS one properly

2026-08-04 04:58:44 +02:00

test_index_resilience.c

feat(mcp): tree-format tool output, exactly-once pagination, lean defaults

2026-07-17 22:32:53 +02:00

test_index_supervisor.c

test(daemon): widen worker/frontend hang-guard deadlines for slow ARM CI

2026-07-19 00:42:19 +02:00

test_infrascan.c

fix: Reject filesystem paths in HTTP_CALLS route extraction so client routes can join server routes (#485)

2026-06-22 22:04:31 +02:00

test_integration.c

Merge remote-tracking branch 'origin/main' into feat/shared-coordination-daemon

2026-07-18 13:48:06 +02:00

test_java_lsp_coverage.c

feat(lsp): Java hybrid LSP resolver (type-aware calls, annotations, signatures)

2026-06-02 18:52:37 +02:00

test_java_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_kotlin_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_lang_contract.c

fix(test): free the fixture project name before reindexing

2026-08-06 18:15:48 +02:00

test_language.c

Merge pull request #605 from CooperSheroy/catalina/docs-contributing-current-suite-20260624

2026-07-31 03:42:43 +02:00

test_lock_registry.c

fix: harden cross-platform daemon startup smoke

2026-07-18 14:38:07 +02:00

test_log.c

fix(logging): use local log schema

2026-06-28 13:05:05 +02:00

test_lsp_resolution_probe.c

fix(test): free the fixture project name before reindexing

2026-08-06 18:15:48 +02:00

test_lz4.c

Resolve all clang-tidy, cppcheck, and clang-format warnings across 94 files

2026-03-15 22:37:34 +01:00

test_main.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_makefile_ts_runtime_dependencies.sh

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_matrix_known_classes.c

Fix CI lint: drop debug scaffolding, make lisp import walker iterative, apply clang-format

2026-06-08 22:55:23 +02:00

test_matrix_new_constructs.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_mcp.c

perf(mcp): stop repeating the payload in structuredContent (#1375)

2026-08-07 16:46:52 +02:00

test_mem.c

test(mem): assert the map contract the allocator can actually honour

2026-07-26 00:55:24 +02:00

test_node_creation_probe.c

Drop the nim grammar and refresh language counts

2026-06-12 02:17:39 +02:00

test_parallel_harness_contract.sh

test: make three Windows nondeterminisms deterministic

2026-07-29 17:05:10 +02:00

test_parallel.c

feat(pipeline): serialize and publish per-file LSP surfaces

2026-08-03 17:44:52 +02:00

test_parent_watchdog.sh

fix: harden daemon release paths and verification

2026-07-24 16:08:42 +02:00

test_parse_coverage.c

feat(index): missed graph in UI + read-time coverage hook + recovery subtraction

2026-07-08 19:13:25 +02:00

test_path_alias.c

fix(pipeline): honor discovery exclusions in pkgmap/path-alias/envscan walks

2026-07-03 19:57:01 +02:00

test_perl_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_php_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_pipeline.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_platform.c

daemon: permanent lifecycle, daemon-backed CLI/hooks, real-Windows hardening, long-path launcher transactions

2026-07-21 15:32:15 +02:00

test_private_file_lock.c

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_project_lock.c

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_py_lsp_bench.c

test(bench): make the py-lsp time budget a liveness backstop, not a perf gate

2026-08-10 16:40:31 +02:00

test_py_lsp_scale.c

perf(py_lsp): cap dedup window at 256 entries — 91.8x -> 31.4x scaling

2026-05-09 15:44:09 +02:00

test_py_lsp_stress.c

feat(py_lsp): close all stress gaps — lambda, dict-dispatch, async, callable, next, kwargs

2026-05-09 14:16:15 +02:00

test_py_lsp.c

wip: capture remaining semantic reference regressions

2026-07-18 15:52:50 +02:00

test_registry.c

fix(registry): don't swallow call suffixes on aliased-import direct hits

2026-07-10 21:07:11 +02:00

test_release_archive_extractor_contract.sh

test(release): launch the extractor via $BASH, not a bare bash

2026-08-09 20:15:31 +02:00

test_release_gate_chain_contract.sh

fix(release): skip_tests silently skipped smoke and soak too

2026-07-30 03:45:33 +02:00

test_route_canon.c

fix(routes): canonicalize path parameters so client calls match handlers

2026-06-23 13:52:08 -03:00

test_rust_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_scope.c

wip: capture remaining semantic reference regressions

2026-07-18 15:52:50 +02:00

test_script_exec_bit_contract.sh

fix(ci): mark the new lane scripts executable, and let the contract see them

2026-08-03 15:42:32 +02:00

test_security_fuzz_harness.sh

fix: stabilize cross-platform daemon coordination

2026-07-18 11:48:59 +02:00

test_security_strings_allowlist.sh

fix(ci): allow-list MSYS2 toolchain URL in binary string audit

2026-06-24 03:15:36 +02:00

test_security.c

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_semantic.c

feat: complete shared daemon lifecycle

2026-07-18 01:26:08 +02:00

test_simhash.c

test(similarity): cover the empty-graph qsort null base (#1367)

2026-08-06 18:33:13 +02:00

test_slab_alloc.c

test: add 56 unit tests for semantic, slab_alloc, and ast_profile modules

2026-06-28 21:57:35 -06:00

test_smoke_fixture_contract.sh

test(contracts): align the release contracts with the single-composition layout

2026-08-09 16:24:52 +02:00

test_soak_daemon_recovery_contract.sh

fix(test-infra): repair the native Windows soak transport and release checks

2026-07-25 00:37:05 +02:00

test_spawn_no_window_contract.sh

fix(windows): suppress the console window on the last spawn site (#1427)

2026-08-07 14:58:22 +02:00

test_sqlite_writer.c

fix(sqlite_writer): publish rebuilt db atomically

2026-07-13 11:43:00 +03:00

test_stack_overflow.c

test(so): document the POSIX GLR-cap branch as a bounded smoke, per falsification

2026-07-18 13:31:18 +02:00

test_store_arch.c

fix(store): clamp ADR render cursor to prevent stack overflow

2026-07-19 12:35:58 +05:30

test_store_bulk.c

Fix Windows bulk test + dual MCP config location + CONTRIBUTING.md

2026-03-20 20:32:38 +01:00

test_store_checkpoint.c

Merge remote-tracking branch 'origin/main' into qa/call-reference-rebase

2026-08-01 01:29:20 +02:00

test_store_edges.c

fix(graph): IMPORTS edges keyed by local_name across buffer, store and dump

2026-07-03 20:16:39 +02:00

test_store_nodes.c

feat(pipeline): closure-repair incremental route

2026-08-03 18:41:49 +02:00

test_store_pragmas.c

feat(mcp): tree-format tool output, exactly-once pagination, lean defaults

2026-07-17 22:32:53 +02:00

test_store_search.c

fix(store): reject null search handles

2026-07-13 01:48:29 +02:00

test_str_intern.c

Add 480+ tests, fix 3 bugs discovered by new test coverage

2026-03-24 23:48:23 +01:00

test_str_util.c

fix(foundation): properly escape JSON control characters as \u00XX

2026-06-24 20:33:52 +05:30

test_subprocess.c

daemon: permanent lifecycle, daemon-backed CLI/hooks, real-Windows hardening, long-path launcher transactions

2026-07-21 15:32:15 +02:00

test_traces.c

Add 480+ tests, fix 3 bugs discovered by new test coverage

2026-03-24 23:48:23 +01:00

test_ts_lsp.c

fix: preserve semantic graph relationships

2026-07-18 15:52:50 +02:00

test_type_rep.c

Fix uninitialized template-arg arrays binding stack garbage into type graphs

2026-06-10 12:11:02 +02:00

test_ui_dev_proxy_security.sh

daemon: permanent lifecycle, daemon-backed CLI/hooks, real-Windows hardening, long-path launcher transactions

2026-07-21 15:32:15 +02:00

test_ui.c

revert(release): re-embed runtime assets into the single shipped binary

2026-08-09 13:06:42 +02:00

test_userconfig.c

Add missing platform.h include for cbm_safe_getenv in userconfig test

2026-04-06 14:34:07 +02:00

test_vendored_integrity_contract.sh

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_venue_parity_contract.sh

test(venue): re-home the isolated-release-download guard

2026-08-09 17:17:05 +02:00

test_version_cohort.c

fix(win): reconcile the C suite with the managed-launcher contract

2026-07-23 00:53:41 +02:00

test_vm_worktree_manifest.sh

fix(release): externalize runtime assets and harden VT verification

2026-08-08 17:35:05 +02:00

test_vmem.c

Forbid test skips and convert existing skips to hard failures

2026-06-05 21:53:25 +02:00

test_vt_gate_policy_contract.sh

test(vt): the gate contract no longer claims zero tolerance

2026-08-09 16:43:04 +02:00

test_vt_release_notes_contract.sh

test(vt): drop the cmp dependency from the release-notes contract

2026-08-09 16:47:30 +02:00

test_watcher.c

test(watcher): key the blocked-git spawn-marker wait to a starved-runner budget

2026-07-27 23:05:16 +02:00

test_windows_bundle_contract.sh

test(contracts): align the release contracts with the single-composition layout

2026-08-09 16:24:52 +02:00

test_worker_error_response.sh

fix(tests): resolve the prod binary from CBM_TEST_BINARY, not a hardcoded build/c

2026-08-06 00:33:34 +02:00

test_worker_pool.c

Make parallel_for_actually_parallel deterministic

2026-06-06 19:48:48 +02:00

test_worker_watchdog.sh

harden: remove capability that should never have shipped

2026-07-29 23:50:53 +02:00

test_workspace.c

feat(foundation): per-project request manifest with content-keyed approval

2026-08-06 18:00:08 +02:00

test_yaml.c

Add 480+ tests, fix 3 bugs discovered by new test coverage

2026-03-24 23:48:23 +01:00

test_zstd.c

feat: add persistent artifact storage for team sharing

2026-04-15 23:56:03 +02:00