Alan Poulain 88d7ba7ca8 fix(vllm): Make sure to use max number of GPUs available (#326) ...

* fix(serving): vllm bad num_gpus

Signed-off-by: Alan Poulain <contact@alanpoulain.eu>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

---------

Signed-off-by: Alan Poulain <contact@alanpoulain.eu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>

2023-09-12 12:45:00 -04:00

..

openllm

fix(vllm): Make sure to use max number of GPUs available (#326)

2023-09-12 12:45:00 -04:00