Eval history

Every EVAL_LOG=1 run, recorded. Two metrics, kept separate: retrieval hit@k (did the gold chunk reach the generator) vs answer accuracy (was the final answer right). A green retrieval cell with a ✗ means good retrieval but a wrong answer; a red cell with a ✓ usually means the model answered from parametric memory, not the document.

View as timeline → — the runs in chronological order with the story and deltas.

embedder:ollama:nomic-embed-text ollama:qwen3-embedding:0.6b openai:Qwen/Qwen3-Embedding-8B ✕openai:jina-embeddings-v3

label:ab:chunk ab:embedder ab:planner ab:retrieval chunk:ctx-prefix deploy:final ✕deploy:pg-chunks_v2 deploy:pg-genfix deploy:pg-judged deploy:q8-sf deploy:q8-sf-xdocfix rerank:jina-rawtext rerank:jina-v2 rrf:vw1.0 rrf:vw1.2 tbl:f3-nomic tbl:family3 tbl:family3b tbl:inmem

Runs (0/25)

When	Config	Label	git	Retrieval	Answer	n

Per-case grid

Cell colour = retrieval (■ hit, ■ miss, ■ absent). Glyph = answer (✓/✗).

config