mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-23 06:52:42 -05:00

Files

Chaoyu dd8b6050b2 feat: FLAN-T5 supports

- add infrastructure, to be implemented: cache, chat history

- Base Runnable Implementation, that fits LangChain API

- Added a Prompt descriptor and utils.

feat: license headers and auto factory impl and CLI

Auto construct args from pydantic config

Add auto factory for ease of use

only provide `/generate` to streamline UX experience

CLI > envvar > input contract for configuration

fix: serve from a thread

fix CLI args

chore: cleanup names and refactor imports

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

2023-05-03 17:50:14 -07:00

276 B

Raw Blame History

OpenLLM

REST/gRPC API server for running any Open Large-Language Model - StableLM, Llama, Alpaca, Dolly, Flan-T5, and more
Powered by BentoML 🍱 + HuggingFace 🤗

276 B Raw Blame History

OpenLLM

276 B

Raw Blame History