mirror of
https://github.com/bentoml/OpenLLM.git
synced 2026-05-07 15:22:46 -04:00
3e32b24194e87d9a7e77e33d17189dc839e50168
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
OpenLLM
REST/gRPC API server for running any Open Large-Language Model - StableLM, Llama, Alpaca, Dolly, Flan-T5, and more
Powered by BentoML 🍱 + HuggingFace 🤗
Description
Languages
Python
95.9%
Shell
4.1%