The generated Historical performance deltas table divided latencies whenever config overrides matched, even when lifecycle outcomes differed. A rejected upstream freshness-policy cell and an accepted deferred-freshness latest cell could therefore display a speedup that was not quality comparable; single observations also lacked a row-level evidence warning.
Require both candidates to have accepted identical lifecycle decisions and equal measured overall, pair-F1, graph-fidelity, and task-success categories before computing ratios. Suppress all ratios for correctness/quality rejects or mismatched freshness decisions. Label quality-matched comparisons with fewer than three observations as descriptive only, and rename the section Quality-constrained cross-version timing.
Tests: uv run python -m unittest tests.test_summarize_benchmark_results tests.test_benchmark_campaign tests.test_benchmark_incremental_speed (112 passed); uv run ruff check scripts/summarize-benchmark-results.py tests/test_summarize_benchmark_results.py; git diff --cached --check.
Signed-off-by: Andrew Hundt <ATHundt@gmail.com>
Andrew Hundt
6caf420488