Jake Hillion 42e1e7322b bench: restore --danger-delete-downloads planning phase (#1542) ...

c2f2111b extracted shared utilities from exo_bench.py into harness.py
but accidentally dropped the run_planning_phase function and
--danger-delete-downloads CLI argument in the process.

Restored run_planning_phase in harness.py (where its dependencies now
live) and re-added the --danger-delete-downloads argument to
add_common_instance_args. Re-wired the planning phase call in
exo_bench.py's main() before the benchmark loop.

2026-02-19 15:42:02 +00:00

..

src/exo_bench

bench: make exo-bench available via nix run on all platforms (#1415)

2026-02-06 21:07:17 +00:00

bench.toml

bench: add spec for automatic canary benchmarks (#1483)

2026-02-17 10:52:05 +00:00

eval_tool_calls.py

bench: restore --danger-delete-downloads planning phase (#1542)

2026-02-19 15:42:02 +00:00

exo_bench.py

bench: restore --danger-delete-downloads planning phase (#1542)

2026-02-19 15:42:02 +00:00

harness.py

bench: restore --danger-delete-downloads planning phase (#1542)

2026-02-19 15:42:02 +00:00

pyproject.toml

Fix tool calling (#1529)

2026-02-18 20:29:18 +00:00

scenarios.toml

feat: add prefill progress bar for long prompts (#1181)

2026-02-19 03:18:25 +00:00

single-m3-ultra.toml

bench: add spec for automatic canary benchmarks (#1483)

2026-02-17 10:52:05 +00:00