mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-24 07:17:53 -05:00

Go to file

Aaron 2a53faee9c infra: add structure and cleanup separation of tokenizer

since tokenizer are relatively light, all default LLM will bundle the
tokenizer with itself.

Maybe we can put the tokenizer in its own runner in the future

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

2023-05-05 11:57:39 -07:00

.github

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

examples

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

rules

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

src

infra: add structure and cleanup separation of tokenizer

2023-05-05 11:57:39 -07:00

tests

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

tools

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.bazelignore

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.bazelrc

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.bazelversion

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.gitignore

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

BUILD.bazel

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

LICENSE

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

package.json

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

pyproject.toml

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

README.md

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

WORKSPACE

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

README.md

OpenLLM

REST/gRPC API server for running any Open Large-Language Model - StableLM, Llama, Alpaca, Dolly, Flan-T5, and more
Powered by BentoML 🍱 + HuggingFace 🤗