Jake Hillion 8d94eab6c6 bench: fix KeyError on DownloadCompleted total field ...

The bench harness accessed the serialized DownloadCompleted field as
"totalBytes", but the Python field is `total: Memory` which serializes
to "total" (not snake_case, so the camelCase alias generator leaves it
unchanged). This caused a KeyError when --danger-delete-downloads
needed to free disk space by deleting existing models.

Changed the key from "totalBytes" to "total" to match the actual
serialized JSON structure.

Test plan:
- CI
- Reproduced KeyError on unfixed code by filling disk on a test node
  to 14GB free and running exo-bench with a 16GB model
  (Meta-Llama-3.1-8B-Instruct-bf16) with --danger-delete-downloads
- Verified fixed code successfully deletes smaller models to free
  space and completes the benchmark run

2026-02-23 14:17:41 +00:00

..

src/exo_bench

bench: make exo-bench available via nix run on all platforms (#1415)

2026-02-06 21:07:17 +00:00

bench.toml

bench: add spec for automatic canary benchmarks (#1483)

2026-02-17 10:52:05 +00:00

eval_tool_calls.py

bench: restore --danger-delete-downloads planning phase (#1542)

2026-02-19 15:42:02 +00:00

exo_bench.py

bench: add download timing to bench output (#1566)

2026-02-20 15:33:08 +00:00

harness.py

bench: fix KeyError on DownloadCompleted total field

2026-02-23 14:17:41 +00:00

pyproject.toml

Fix tool calling (#1529)

2026-02-18 20:29:18 +00:00

scenarios.toml

feat: add prefill progress bar for long prompts (#1181)

2026-02-19 03:18:25 +00:00

single-m3-ultra.toml

bench: add spec for automatic canary benchmarks (#1483)

2026-02-17 10:52:05 +00:00