mirror of https://github.com/mudler/LocalAI.git synced 2026-01-13 08:50:27 -05:00

Files

Ludovic Leroux 12c0d9443e feat: use tokenizer.apply_chat_template() in vLLM (#1990 )

Use tokenizer.apply_chat_template() in vLLM

Signed-off-by: Ludovic LEROUX <ludovic@inpher.io>

2024-04-11 19:20:22 +02:00

backend_pb2_grpc.py

2024-04-11 19:20:22 +02:00

backend_pb2.py

2024-04-11 19:20:22 +02:00

exllama.py

2023-12-05 08:15:37 +01:00

exllama.yml

2023-12-05 08:15:37 +01:00

install.sh

2024-03-07 14:37:45 +01:00

Makefile

2024-03-01 22:48:53 +01:00

README.md

2023-11-13 22:40:16 +01:00

run.sh

2024-03-01 22:48:53 +01:00

Creating a separate environment for the exllama project

make exllama