mirror of https://github.com/mudler/LocalAI.git synced 2026-01-08 06:19:38 -05:00

Files

Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782 )

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

2024-03-01 22:48:53 +01:00

backend_pb2_grpc.py

2023-11-13 22:40:16 +01:00

backend_pb2.py

2024-03-01 22:48:53 +01:00

exllama.py

2023-12-05 08:15:37 +01:00

exllama.yml

2023-12-05 08:15:37 +01:00

install.sh

2024-03-01 22:48:53 +01:00

Makefile

2024-03-01 22:48:53 +01:00

README.md

2023-11-13 22:40:16 +01:00

run.sh

2024-03-01 22:48:53 +01:00

Creating a separate environment for the exllama project

make exllama