Evan Quiney 9b5cae3db6 auto bench (#1405) ...

runs exo_bench remotely with some nice git QoL

## usage
run tests/auto_bench.sh host1 [host2]

exo bench will be run on those hosts and its output saved to
bench/commit_hash/*.json on all models currently downloaded

2026-02-06 15:35:46 +00:00

..

auto_bench.sh

auto bench (#1405)

2026-02-06 15:35:46 +00:00

get_all_models_on_cluster.py

auto bench (#1405)

2026-02-06 15:35:46 +00:00

headless_runner.py

Normalize TextGenerationTaskParams.input to list[InputMessage] (#1360)

2026-02-03 06:01:56 -08:00

run_exo_on.sh

cancel downloads for deleted instances (#1393)

2026-02-05 18:16:43 +00:00

start_distributed_test.py

improve distributed testing (#1300)

2026-02-02 18:25:39 +00:00