mirror of https://github.com/mudler/LocalAI.git synced 2026-03-02 13:46:34 -05:00

Files

Ettore Di Giacinto 06cd9ef98d feat(extra-backends): Improvements, adding mamba example (#1618 )

* feat(extra-backends): Improvements

vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat

* examples(mamba-chat): add

* docs: update

2024-01-20 17:56:08 +01:00

backend_pb2_grpc.py

refactor: move backends into the backends directory (#1279 )

2023-11-13 22:40:16 +01:00

backend_pb2.py

feat(diffusers): update, add autopipeline, controlnet (#1432 )

2023-12-13 19:20:22 +01:00

backend_vllm.py

feat(extra-backends): Improvements, adding mamba example (#1618 )

2024-01-20 17:56:08 +01:00

Makefile

deps(conda): use transformers-env with vllm,exllama(2) (#1554 )

2024-01-06 13:32:28 +01:00

README.md

refactor: move backends into the backends directory (#1279 )

2023-11-13 22:40:16 +01:00

run.sh

deps(conda): use transformers-env with vllm,exllama(2) (#1554 )

2024-01-06 13:32:28 +01:00

test_backend_vllm.py

feat(conda): share envs with transformer-based backends (#1465 )

2023-12-21 08:35:15 +01:00

test.sh

deps(conda): use transformers-env with vllm,exllama(2) (#1554 )

2024-01-06 13:32:28 +01:00

README.md

Creating a separate environment for the vllm project

make vllm