mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-04-03 06:31:46 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,171 Commits 85 Branches 140 Tags
53dbe36f32a0f7e1d4806217501be994525e075c
Commit Graph

3 Commits

Author SHA1 Message Date
Ettore Di Giacinto
cb7512734d transformers: correctly load automodels (#1643) 
* backends(transformers): use AutoModel with LLM types

* examples: animagine-xl

* Add codellama examples
 2024-01-26 00:13:21 +01:00
Ettore Di Giacinto
06cd9ef98d feat(extra-backends): Improvements, adding mamba example (#1618) 
* feat(extra-backends): Improvements

vllm: add max_tokens, wire up stream event
mamba: fixups, adding examples for mamba-chat

* examples(mamba-chat): add

* docs: update
 2024-01-20 17:56:08 +01:00
Ettore Di Giacinto
9e653d6abe feat: 🐍 add mamba support (#1589) 
feat(mamba): Initial import

This is a first iteration of the mamba backend, loosely based on
mamba-chat(https://github.com/havenhq/mamba-chat).
 2024-01-19 23:42:50 +01:00