mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-06-12 02:20:32 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,292 Commits 6 Branches 194 Tags
59e8ef93dce2f0caa7b5c9bf9cd5f97a4f7ddbdf
Commit Graph

1292 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron
59e8ef93dc chore(deps): lock vLLM to 0.2.4 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-12 00:17:18 -05:00
Aaron Pham
08114410bc fix(openai): logprobs when echo is enabled (#761) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-10 18:09:25 -05:00
Aaron Pham
c3a0b5c39f feat(openai): supports echo (#760) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-10 13:19:40 -05:00
Aaron
bb4ed8b53c fix(llm): correct annotations definitions 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-09 09:59:02 -05:00
Aaron Pham
c0307c9d71 infra: bump to homebrew tap release to 0.4.35 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 08:48:05 +00:00
Aaron Pham
eeb3cbc2d1 infra: bump to dev version of 0.4.36.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 08:46:31 +00:00
Aaron Pham
8019fd84c8 infra: prepare for release 0.4.35 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.35 		2023-12-07 08:38:13 +00:00
Aaron Pham
6a185bc88e fix(logprobs): explicitly set logprobs=None (#757) 
logprobs=0 still outputs logprobs for one generation

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 03:36:39 -05:00
pre-commit-ci[bot]
d16b9804dc ci: pre-commit autoupdate [pre-commit.ci] (#753) 
updates:
- [github.com/pre-commit/mirrors-eslint: v8.54.0 → v8.55.0](https://github.com/pre-commit/mirrors-eslint/compare/v8.54.0...v8.55.0)
- [github.com/pre-commit/mirrors-prettier: v3.1.0 → v4.0.0-alpha.3](https://github.com/pre-commit/mirrors-prettier/compare/v3.1.0...v4.0.0-alpha.3)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-12-04 13:29:55 -05:00
dependabot[bot]
44fda647b3 chore(deps): bump taiki-e/install-action from 2.21.19 to 2.21.26 (#750) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.19 to 2.21.26.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](b61491983a...d211c4be5a)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:52 -05:00
dependabot[bot]
5c43cee299 chore(deps): bump docker/metadata-action from 5.0.0 to 5.2.0 (#751) 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 5.0.0 to 5.2.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Commits](96383f4557...e6428a5c4e)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:44 -05:00
dependabot[bot]
aa597d644f chore(deps): bump pypa/gh-action-pypi-publish from 1.8.10 to 1.8.11 (#749) 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.8.10 to 1.8.11.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](b7f401de30...2f6f737ca5)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:36 -05:00
Aaron
9a7e0cecf0 fix(types): makes sures mypy is running strict 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 09:42:24 -05:00
Aaron
9d1b16395e infra: remove redundant mypy config 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 09:33:52 -05:00
Aaron
55a0b2f825 fix(style): setup correct block format 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 07:58:35 -05:00
Aaron
b53559de6f fix(setter): correct item with the same kwargs with stubs 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 07:36:34 -05:00
Aaron Pham
c210ec03e3 infra: bump to homebrew tap release to 0.4.34 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 12:29:28 +00:00
Aaron Pham
20681e7a06 infra: bump to dev version of 0.4.35.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 12:28:18 +00:00
Aaron Pham
81688e0949 infra: prepare for release 0.4.34 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.34 		2023-11-30 12:17:48 +00:00
yansheng
3cb7f14fc1 feat(models): Support qwen (#742) 
* support qwen

* support qwen

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

* Update openllm-core/src/openllm_core/config/configuration_qwen.py

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* chore: update correct readme and supports qwen models

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: root <yansheng105@gmail.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-30 06:54:17 -05:00
Aaron Pham
c63bb82000 infra: bump to homebrew tap release to 0.4.33 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 18:12:43 +00:00
Aaron Pham
c1f6d966ba infra: bump to dev version of 0.4.34.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 18:11:44 +00:00
Aaron Pham
9fa0dee406 infra: prepare for release 0.4.33 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.33 		2023-11-29 18:01:13 +00:00
Aaron Pham
0909e08e3c fix(llm): remove unecessary parsing 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 18:00:08 +00:00
Aaron Pham
66b9b4a761 infra: bump to homebrew tap release to 0.4.32 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 07:50:59 +00:00
Aaron Pham
f620bd708b infra: bump to dev version of 0.4.33.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 07:49:33 +00:00
Aaron Pham
69deedd9b8 infra: prepare for release 0.4.32 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.32 		2023-11-29 07:39:42 +00:00
Aaron Pham
9706228956 chore(vllm): add arguments for gpu memory utilization 
Probably not going to fix anything, just delaying the problem.

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 06:45:14 +00:00
Aaron Pham
f0fa06004b chore: revert back previous backend support PyTorch (#739) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 01:44:41 -05:00
Aaron Pham
0ce7782c2c infra: update blame rev [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 07:05:07 +00:00
Aaron Pham
d04309188b chore(style): 2.7k 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 07:04:27 +00:00
Aaron
ce6efc2a9e chore(style): cleanup bytes 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 01:27:27 -05:00
dependabot[bot]
d859cb096d chore(deps): bump github/codeql-action from 2.22.7 to 2.22.8 (#734) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.22.7 to 2.22.8.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](66b90a5db1...407ffafae6)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-27 20:12:43 -05:00
dependabot[bot]
d3ae696b86 chore(deps): bump taiki-e/install-action from 2.21.17 to 2.21.19 (#735) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.17 to 2.21.19.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](ccc14bdc8d...b61491983a)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-27 20:12:35 -05:00
Aaron Pham
dd5c072d7e infra: bump to homebrew tap release to 0.4.31 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 23:59:31 +00:00
Aaron Pham
3b111a56af infra: bump to dev version of 0.4.32.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 23:58:31 +00:00
Aaron Pham
77af72ed2a infra: prepare for release 0.4.31 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.31 		2023-11-26 23:49:04 +00:00
Aaron
7bb53a7aa4 fix(client): include ability to getitem for sync client 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 18:48:01 -05:00
Aaron Pham
739eff3d21 fix(docs): remove invalid options (#733) 
fix(langchain): remove invalid options

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 05:04:54 -05:00
Aaron Pham
0417be3899 infra: bump to homebrew tap release to 0.4.30 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 10:04:38 +00:00
Aaron Pham
2811c118b1 infra: bump to dev version of 0.4.31.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 10:03:38 +00:00
Aaron Pham
e157d3aa9e infra: prepare for release 0.4.30 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.30 		2023-11-26 09:54:42 +00:00
Aaron
96318b65ee fix(sdk): remove broken sdk 
codespace now around 2.8k lines

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 04:53:36 -05:00
Aaron Pham
ed6a82a3f0 infra: bump to homebrew tap release to 0.4.29 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 07:59:59 +00:00
Aaron Pham
00fc002e31 infra: bump to dev version of 0.4.30.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 07:59:04 +00:00
Aaron Pham
f7a803dfa2 infra: prepare for release 0.4.29 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.29 		2023-11-26 07:50:48 +00:00
Aaron
43a96dab2c fix(gpus): disable slots for now to enable cached_property 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 02:49:48 -05:00
Aaron
21bf26583d infra: add git-blame-ignore-revs [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 01:46:34 -05:00
Aaron
69aae34cf4 fix(style): reduce boilerplate and format to custom logics 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 01:44:59 -05:00
Aaron Pham
b4ea4b3e99 infra: bump to homebrew tap release to 0.4.28 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 07:21:13 +00:00