Files
codebase-memory-mcp/scripts
Andrew Hundt 843ce8c465 fix(benchmarks): preserve candidate capability support
Previous reports inferred every FAST-mode algorithm as applicable, so upstream/main was labeled rank-capable even though git grep at 2469ecc3 finds no cbm_pagerank_compute implementation. Campaign capabilities also affected identity but were not propagated into report inputs.

Add optional string-to-boolean capability_support to cell validation and SHA-256 identity. materialize_report_input() writes a deterministic derived JSON document with candidate support, source-result SHA-256, and cell identity while leaving immutable raw results unchanged. The summarizer now lets explicit unsupported metadata override mode-based applicability and accepts both dependencies and the retained auto_index_deps support key.

Tests: uv run python -m unittest tests.test_benchmark_campaign tests.test_summarize_benchmark_results -v (42 passed); uv run ruff check scripts/run-benchmark-campaign.py scripts/summarize-benchmark-results.py tests/test_benchmark_campaign.py tests/test_summarize_benchmark_results.py (passed); git diff --check (passed).
Signed-off-by: Andrew Hundt <ATHundt@gmail.com>
2026-07-16 07:55:29 -04:00
..