mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-02-01 18:22:57 -05:00
Code Issues Packages Projects Releases Wiki Activity
Files
fix_eos
LocalAI/backend/python/vllm/backend_vllm.py
Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782) 
* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama
2024-03-01 22:48:53 +01:00

7.5 KiB
Raw Permalink Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink