Post #4274518

xceval 0.4.0 for the new Evaluation framework is now out! It owns the full evaluation loop for coding agents: discover what can run, execute it, inspect the evidence, isolate failures, rerun selected samples, compare against a baseline, & enforce gates. https://github.com/rudrankriyam/Evaluations-Framework-CLI