mirror of
https://github.com/headroomlabs-ai/headroom.git
synced 2026-11-22 15:10:00 +08:00
feat/https-compose-caddy
3
Commits
| Author | SHA1 | Message | Date | |
|---|---|---|---|---|
|
|
de8969267c |
chore(evals): remove dead and test-only eval helpers (#4079)
## Description This PR removes private, unexported helpers inside live eval modules that no product code, CI job, CLI command or doc calls. None of them is in an `__all__`, a package re-export, `docs/content/docs/` or a consumer repo. Two of them were reached only by tests; those test lines go with them. Refs #4136 ## Type of Change - [ ] Bug fix (non-breaking change that fixes an issue) - [ ] New feature (non-breaking change that adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to change) - [ ] Documentation update - [ ] Performance improvement - [x] Code refactoring (no functional changes) ## Changes Made - `headroom/evals/comprehensive_benchmark.py`: remove `TIER1_TASKS`, `TIER1_CODE_TASKS`, `EXTENDED_TASKS` and `TIER3_TASKS`. `suite_runner.py` defines its own task lists and only imports `DEFAULT_TASKS`/`run_lm_eval`. - `headroom/evals/memory/judge.py`: remove `create_batch_judge`. It is not exported from `headroom.evals.memory`. - `headroom/evals/metrics.py`: remove `compute_bleu`, which was test-only and not in `headroom.evals.__all__`. The "BLEU" mention in `headroom/evals/README.md` is left for the follow-up docs PR. - `headroom/evals/datasets.py`: remove `generate_retrieval_probes`, which was test-only and not exported. - Tests: drop the 4 `compute_bleu` asserts and the `generate_retrieval_probes` block, and rename the two test functions to match what they still cover. - Evidence: a word search (`rg -c -w <name>`) across the repo (code, tests, docs, wiki, CI) and the private consumer repos finds only each definition, plus the removed test lines. ## Testing - [x] Unit tests pass (`pytest`) - [x] Linting passes (`ruff check .`) - [x] Type checking passes (`mypy headroom`) - [ ] New tests added for new functionality - [ ] Manual testing performed ### Test Output ```text $ pytest -q tests/test_evals_metrics.py tests/test_evals_datasets.py tests/test_evals_cjk_tokenization.py tests/test_memory_eval.py tests/test_evals/test_comprehensive_benchmark_log_redaction.py tests/test_dataset_recall_runner.py tests/test_compression_fidelity_regression.py 53 passed in 4.70s $ ruff check (touched files) All checks passed! $ mypy headroom/evals/metrics.py headroom/evals/datasets.py headroom/evals/memory/judge.py headroom/evals/comprehensive_benchmark.py --ignore-missing-imports Success: no issues found in 4 source files ``` ## Real Behavior Proof - Environment: macOS, repo venv, branch checkout at |
||
|
|
efd2ac1ca4 |
chore: renormalize line endings to LF
`.gitattributes` declares `*.py text eol=lf` and `*.sh text eol=lf`, but 74 files (73 .py, 1 .sh) are stored in the index with CRLF line endings, violating that contract. Every macOS/Linux clone reports these files as "modified" on fresh checkout because git's diff engine sees the stored bytes don't match the attribute contract, even though the working tree and index match byte-for-byte. Running `git add --renormalize .` rewrites each affected blob so the stored form matches the attribute declaration. No semantic changes — every affected file's diff is "N insertions, N deletions" with inserts and deletes being the same lines modulo line endings. Follow-up commit adds `.git-blame-ignore-revs` so `git blame` / GitHub blame skip this mechanical commit. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> |
||
|
|
38bf3e639c |
test: expand coverage across helper slices
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> |