Aaron Pham ad9107958d feat: continuous batching with vLLM (#349) ...

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* feat: continuous batching

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: add changeloe

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: add one shot generation

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

2023-09-14 03:09:36 -04:00

..

_strategies

feat: continuous batching with vLLM (#349)

2023-09-14 03:09:36 -04:00

models

fix(gptq): use upstream integration (#297)

2023-09-04 14:05:50 -04:00

__init__.py

fix: persistent styling between ruff and yapf (#279)

2023-08-30 11:37:41 -04:00

configuration_test.py

chore: ignore new lines split [skip ci]

2023-09-01 17:00:49 +00:00

conftest.py

fix(yapf): align weird new lines break [generated] [skip ci] (#284)

2023-09-01 05:34:22 -04:00

models_test.py

fix: persistent styling between ruff and yapf (#279)

2023-08-30 11:37:41 -04:00

package_test.py

chore: ignore new lines split [skip ci]

2023-09-01 17:00:49 +00:00

strategies_test.py

fix(yapf): align weird new lines break [generated] [skip ci] (#284)

2023-09-01 05:34:22 -04:00