Evan 370e6de078 api cancellation ...

closing the http request to the api now
- sends a cancellation from the api
- writes that canellation in the master
- worker plans off the cancellation
- runner observes that cancellation after every generation step (+1
communication per token)
- cancellation happens synchronously to prevent gpu locks

2026-02-05 16:00:01 +00:00

..

headless_runner.py

Normalize TextGenerationTaskParams.input to list[InputMessage] (#1360)

2026-02-03 06:01:56 -08:00

run_exo_on.sh

api cancellation

2026-02-05 16:00:01 +00:00

start_distributed_test.py

improve distributed testing (#1300)

2026-02-02 18:25:39 +00:00