chore(eval): regenerate the stale synthetic-smoke report

Browse Source

The committed report predated the eval-isolation fix and still showed the
corruption fingerprint: rrf-no-trigram, rrf-inbox-1.0 and rrf-bm25-flat all
reported an identical ndcg@10 of 0.7777. Regenerated against a fresh copy of
eval/corpus in a temp dir (VAULT_DIR/INDEX_DB/CACHE_DB/HISTORY_DIR pointed
there) with the shipped defaults (rrf, dim 2560, MIN_SCORE unset) -- this is
a machinery check, not a tuning result, so no default changed. The three
ablation arms now report distinct scores (0.818 / 0.802 / 0.806); rrf and
rrf-inbox-1.0 legitimately match because none of the 12 seeded notes are in
inbox state. eval/README.md's conclusions (every CC arm's CI still overlaps
the RRF baseline's; defaults unchanged) still hold, so it is unchanged.

...

This commit is contained in:

Markus committed 2026-09-12 18:40:40 +00:00

1 parent 0bdda896f9

commit 0e06daa8ee

1 file changed

+3427 -3427

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

eval/results/2026-09-12-synthetic-smoke.json

+3427 -3427

File diff suppressed because it is too large. Load diff