Files
OpenLLM/openllm-python/src/openllm
Aaron Pham 3b2ac1cd59 feat: support continuous batching on generate (#375)
* feat: support continuous batching on `generate`

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: add changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
2023-09-19 03:04:59 -04:00
..
2023-08-15 02:11:14 -04:00