Skip to content

Evaluation and feedback

Two loops tell us whether Flo is getting better:

Loop When Question it answers Results
Eval on every merge After each staging sync Did this change break routing or grounding? Langfuse evaluation project, Experiments
Feedback and triage Every user 👍/👎, triaged nightly Where do real answers fail, and who should fix it? Langfuse live project, scores and a report

All judging uses flo-judge (Qwen2.5-7B), a different model from the one that answers, on its own GPU. See Models.