Files
codebase-memory-mcp/scripts
Andrew Hundt 0639cd6ab3 fix(benchmark): generate bounded correctness evidence
Add correctness_findings() in scripts/summarize-benchmark-results.py to report canonical count mismatches, bounded left/right witnesses, and failed task-oracle expectations without copying unbounded payloads into Markdown.

Correct the response-size footnote to identify the exact default tool-response payload and disclose the one-case/five-oracle sample basis. Cover the generated evidence and measurement wording in tests/test_summarize_benchmark_results.py; 27 benchmark unit tests and Ruff pass.

Signed-off-by: Andrew Hundt <ATHundt@gmail.com>
2026-07-14 14:43:56 -04:00
..