Logo
Explore Help
Register Sign In
mirror/LocalAI
Watch 1
Star 0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-09-12 22:33:54 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
12c0d9443ecfa7367e041b900a243e0c77726dce
LocalAI/backend/python/exllama
T
History
Ludovic Leroux 12c0d9443e feat: use tokenizer.apply_chat_template() in vLLM (#1990)
Use tokenizer.apply_chat_template() in vLLM

Signed-off-by: Ludovic LEROUX <ludovic@inpher.io>
2024-04-11 19:20:22 +02:00
..
backend_pb2_grpc.py
feat: use tokenizer.apply_chat_template() in vLLM (#1990)
2024-04-11 19:20:22 +02:00
backend_pb2.py
feat: use tokenizer.apply_chat_template() in vLLM (#1990)
2024-04-11 19:20:22 +02:00
exllama.py
exllama(v2): fix exllamav1, add exllamav2 (#1384)
2023-12-05 08:15:37 +01:00
exllama.yml
exllama(v2): fix exllamav1, add exllamav2 (#1384)
2023-12-05 08:15:37 +01:00
install.sh
feat(intel): add diffusers/transformers support (#1746)
2024-03-07 14:37:45 +01:00
Makefile
Bump vLLM version + more options when loading models in vLLM (#1782)
2024-03-01 22:48:53 +01:00
README.md
refactor: move backends into the backends directory (#1279)
2023-11-13 22:40:16 +01:00
run.sh
Bump vLLM version + more options when loading models in vLLM (#1782)
2024-03-01 22:48:53 +01:00

README.md

Creating a separate environment for the exllama project

make exllama
Reference in new issue View Git Blame Copy Permalink
Powered by Gitea Version: 1.28.0+dev-477-g8b6ad49a5f Page: 31ms Template: 2ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API