Files
codebase-memory-mcp/scripts
Andrew Hundt 7810ab55d7 feat(benchmark): calculate historical latency deltas
Add config_signature() and historical_delta_rows() to scripts/summarize-benchmark-results.py. Match baselines to latest candidates by exact config overrides and render baseline/latest ratios for incremental reindex, post-mutation fresh rebuild, and query latency beside both quality scores and the baseline correctness gate.

Add a matching-capability regression fixture in tests/test_summarize_benchmark_results.py. Verified 24 report/campaign tests and Ruff. The generated combined report now calculates 2.87x default, 2.73x rank-off, and 2.36x all-optional-off incremental gains over the 24ba checkpoint without concealing rejected upstream/trajectory quality.

Signed-off-by: Andrew Hundt <ATHundt@gmail.com>
2026-07-15 02:04:37 -04:00
..