OpenLLM

mirror/OpenLLM

Fork 0

mirror of https://github.com/bentoml/OpenLLM.git synced 2026-02-02 11:52:19 -05:00

Go to file

bojiang 0b93db47cd Merge openllm-next as openllm 0.6

2024-07-09 14:21:52 +08:00

.github

chore(deps): bump actions/upload-artifact from 4.3.3 to 4.3.4 (#1032 )

2024-07-08 22:07:52 -04:00

changelog.d

infra: prepare for release 0.5.0-alpha.15 [generated] [skip ci]

2024-05-27 17:53:45 +00:00

openllm_next

tem

2024-07-08 14:24:30 +08:00

tools

fix: correctly set quantise for non quantise options

2024-06-14 02:20:19 +00:00

.editorconfig

chore: upgrade to new vLLM schema

2024-06-02 15:52:45 +00:00

.envrc.template

chore(infra): ignore default command to speed up dev [skip ci]

2024-06-11 07:36:52 +00:00

.git_archival.txt

feat(ci): automatic release semver + git archival installation (#143 )

2023-07-25 04:18:49 -04:00

.git-blame-ignore-revs

chore: update blame ref [generated] [skip ci]

2024-03-15 05:36:19 -04:00

.gitattributes

clean 0.5

2024-07-09 14:21:44 +08:00

.gitignore

clean 0.5

2024-07-09 14:21:44 +08:00

.npmrc

feat: bootstrap documentation site (#252 )

2023-09-12 12:28:29 -04:00

.pre-commit-config.yaml

ci: pre-commit autoupdate [pre-commit.ci] (#1035 )

2024-07-08 22:07:27 -04:00

.prettierrc

infra: move out clojure to external (#593 )

2023-11-09 12:24:18 -05:00

.python-version-default

chore(qol): update CLI options and performance upgrade for build cache (#997 )

2024-05-26 04:17:23 -04:00

.ruff.toml

feat: 1.2 APIs (#821 )

2024-03-15 03:49:19 -04:00

.taplo.toml

fix(build): lock lower version based on each release and update infra (#686 )

2023-11-17 15:57:31 -05:00

CHANGELOG.md

infra: prepare for release 0.5.7 [generated] [skip ci]

2024-06-14 02:38:45 +00:00

CITATION.cff

docs: fix citation space (#1027 ) [skip ci]

2024-06-27 04:53:22 -04:00

DEVELOPMENT.md

clean 0.5

2024-07-09 14:21:44 +08:00

hatch.toml

chore: update scripts to simplify workload [skip ci]

2024-06-11 06:24:29 -04:00

LICENSE

feat: repo/model/serve

2024-05-18 12:41:54 +08:00

package.json

infra: prepare for release 0.5.7 [generated] [skip ci]

2024-06-14 02:38:45 +00:00

pyproject.toml

clean 0.5

2024-07-09 14:21:44 +08:00

pyrightconfig.json

feat: 1.2 APIs (#821 )

2024-03-15 03:49:19 -04:00

README.md

clean 0.5

2024-07-09 14:21:44 +08:00

wheels.sh

chore: cleanup pre-commit jobs and update usage

2023-09-05 10:06:36 -04:00

README.md

pip install .
openllm serve
# or openllm run

To find out what LLM models are already in your hands.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Acknowledgements

This project makes use of the following open-source projects:

bentoml/bentoml for production level model serving
blrchen/chatgpt-lite for a fancy Web Chat UI
chujiezheng/chat_templates

We are grateful to the developers and contributors of these projects for their hard work and dedication.