Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782) ...

* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama

2024-03-01 22:48:53 +01:00

..

base

MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728)

2024-02-21 01:21:19 +00:00

proto

Bump vLLM version + more options when loading models in vLLM (#1782)

2024-03-01 22:48:53 +01:00

backend.go

MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728)

2024-02-21 01:21:19 +00:00

client.go

MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728)

2024-02-21 01:21:19 +00:00

embed.go

MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728)

2024-02-21 01:21:19 +00:00

interface.go

MQTT Startup Refactoring Part 1: core/ packages part 1 (#1728)

2024-02-21 01:21:19 +00:00

server.go

feat(grpc): backend SPI pluggable in embedding mode (#1621)

2024-01-23 08:56:36 +01:00