Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782) ...

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

2024-03-01 22:48:53 +01:00

..

backend_pb2_grpc.py

feat(petals): add backend (#1350)

2023-11-28 09:01:46 +01:00

backend_pb2.py

Bump vLLM version + more options when loading models in vLLM (#1782)

2024-03-01 22:48:53 +01:00

backend_petals.py

feat(petals): add backend (#1350)

2023-11-28 09:01:46 +01:00

Makefile

deps(conda): use transformers-env with vllm,exllama(2) (#1554)

2024-01-06 13:32:28 +01:00

petals.yml

fix(piper): pin petals, phonemize and espeak (#1393)

2023-12-07 22:58:41 +01:00

run.sh

deps(conda): use transformers-env with vllm,exllama(2) (#1554)

2024-01-06 13:32:28 +01:00

test_petals.py

feat(conda): share envs with transformer-based backends (#1465)

2023-12-21 08:35:15 +01:00

test.sh

deps(conda): use transformers-env with vllm,exllama(2) (#1554)

2024-01-06 13:32:28 +01:00