mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-19 12:58:00 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
43576fc8bb31467c648f0721c8bca2467d189d07
OpenLLM/openllm-python/tests/_strategies
History
Aaron Pham ad9107958d feat: continuous batching with vLLM (#349) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* feat: continuous batching

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: add changeloe

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: add one shot generation

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
2023-09-14 03:09:36 -04:00
..
__init__.py
refactor: monorepo (#203)
2023-08-15 02:11:14 -04:00
_configuration.py
feat: continuous batching with vLLM (#349)
2023-09-14 03:09:36 -04:00