Bump vLLM version + more options when loading models in vLLM (#1782)

Browse Source

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

...

This commit is contained in:

Ludovic Leroux authored and GitHub committed 2024-03-01 22:48:53 +01:00

1 parent 1c312685aa

commit 939411300a

28 files changed

+736 -641

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

backend/python/diffusers/backend_pb2.py

+33 -33

File diff suppressed because one or more lines are too long.