mirror of https://github.com/bentoml/OpenLLM.git synced 2026-05-05 06:12:43 -04:00

Go to file

aarnphm-ec2-dev 765c1a6e5c feat: requires_gpu for specific LLM.

This will determine the behaviour of SUPPORTED_RESOURCES

TODO: Support TPU

supports for requirements for specific LLM

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

2023-05-25 16:22:06 -07:00

.github

fix(infra): feature_request.yml missing title

2023-05-23 16:54:38 -07:00

examples

feat: Adding central service definition and init openllm_client

2023-05-15 00:33:05 -07:00

rules

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

src

feat: requires_gpu for specific LLM.

2023-05-25 16:22:06 -07:00

tests

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

tools

feat: Adding central service definition and init openllm_client

2023-05-15 00:33:05 -07:00

typings

feat: codegen and bundle build

2023-05-15 18:22:25 -07:00

.bazelignore

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.bazelrc

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.bazelversion

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

.gitignore

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

BUILD.bazel

feat: Adding central service definition and init openllm_client

2023-05-15 00:33:05 -07:00

LICENSE

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

package.json

feat: Adding central service definition and init openllm_client

2023-05-15 00:33:05 -07:00

pyproject.toml

infra: Install BentoML from main and its auxilary dependencies

2023-05-25 16:22:06 -07:00

README.md

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

WORKSPACE

feat: FLAN-T5 supports

2023-05-03 17:50:14 -07:00

yarn.lock

feat: Adding central service definition and init openllm_client

2023-05-15 00:33:05 -07:00

README.md

OpenLLM

REST/gRPC API server for running any Open Large-Language Model - StableLM, Llama, Alpaca, Dolly, Flan-T5, and more
Powered by BentoML 🍱 + HuggingFace 🤗