mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-06-11 18:09:52 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,330 Commits 6 Branches 194 Tags
37dbccc3d70d89dba18b5bb006cbb76321fdea14
Commit Graph

1330 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pre-commit-ci[bot]
37dbccc3d7 ci: pre-commit autoupdate [pre-commit.ci] (#796) 
updates:
- [github.com/pre-commit/mirrors-eslint: v8.55.0 → v8.56.0](https://github.com/pre-commit/mirrors-eslint/compare/v8.55.0...v8.56.0)
- [github.com/pre-commit/mirrors-prettier: v4.0.0-alpha.4 → v4.0.0-alpha.7](https://github.com/pre-commit/mirrors-prettier/compare/v4.0.0-alpha.4...v4.0.0-alpha.7)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-12-18 12:00:28 -05:00
dependabot[bot]
a588a177aa chore(deps): bump actions/upload-artifact from 3.1.3 to 4.0.0 (#792) 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3.1.3 to 4.0.0.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](a8a3f3ad30...c7d193f32e)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 11:30:58 -05:00
dependabot[bot]
5fbfa3d197 chore(deps): bump actions/download-artifact from 3.0.2 to 4.0.0 (#791) 
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3.0.2 to 4.0.0.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](9bc31d5ccc...7a1cd3216c)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 11:29:56 -05:00
dependabot[bot]
90b2c51fba chore(deps): bump sigstore/cosign-installer from 3.2.0 to 3.3.0 (#793) 
Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/sigstore/cosign-installer/releases)
- [Commits](1fc5bd396d...9614fae9e5)

---
updated-dependencies:
- dependency-name: sigstore/cosign-installer
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 11:29:45 -05:00
dependabot[bot]
80dbf15e21 chore(deps): bump github/codeql-action from 2.22.9 to 3.22.11 (#794) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.22.9 to 3.22.11.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](c0d1daa7f7...b374143c11)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 11:29:33 -05:00
dependabot[bot]
f22b9284e3 chore(deps): bump taiki-e/install-action from 2.22.0 to 2.22.5 (#790) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.22.0 to 2.22.5.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](6ee6c3ab83...a1f180f99a)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-18 11:29:22 -05:00
Aaron Pham
1b3d737f8c docs: add notes about dtypes usage. (#786) 
Update README.md

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-16 06:56:14 -05:00
Aaron Pham
c8da65d2d9 infra: bump to homebrew tap release to 0.4.40 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-15 16:58:27 +00:00
Aaron Pham
cedfa80c45 infra: bump to dev version of 0.4.41.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-15 16:57:19 +00:00
Aaron Pham
2e8fc284f5 infra: prepare for release 0.4.40 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.40 		2023-12-15 16:46:12 +00:00
Aaron Pham
88b6d3d6de perf: upgrade mixtral to use expert parallelism (#783) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-15 11:45:08 -05:00
Aaron Pham
7d2c4a4f7a infra: update blame ignore to formatter hash (#782) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-14 17:28:42 -05:00
Aaron Pham
c8c9663d06 fix(infra): conform ruff to 150 LL (#781) 
Generally correctly format it with ruff format and manual style

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-14 17:27:32 -05:00
Aaron Pham
8d989767e8 infra: bump to homebrew tap release to 0.4.39 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-14 19:31:31 +00:00
Aaron Pham
21fdf2735c infra: bump to dev version of 0.4.40.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-14 19:30:14 +00:00
Aaron Pham
d4fbbcee34 infra: prepare for release 0.4.39 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.39 		2023-12-14 19:20:01 +00:00
Aaron Pham
44383528b5 fix(logprobs): correct check logprobs (#779) 
* fix(logprobs): correct check logprobs

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update changlog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-14 14:19:01 -05:00
Aaron Pham
ea272ba18c infra: bump to homebrew tap release to 0.4.38 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 23:37:15 +00:00
Aaron Pham
ab1bb806bc infra: bump to dev version of 0.4.39.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 23:36:06 +00:00
Aaron Pham
1dbae67172 infra: prepare for release 0.4.38 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.38 		2023-12-13 23:27:41 +00:00
Aaron Pham
0d83cefcb6 fix(mixtral): setup hack atm to load weights from pt specifically instead of safetensors (#776) 
fix(mixtral): setup hack atm to load weights from pt specifically
instead of safetensors

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 18:18:51 -05:00
Aaron Pham
2dbcfa8a0c fix(cli): correct set arguments for openllm import and openllm build (#775) 
* fix(cli): correct set arguments for `openllm import` and `openllm build`

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 15:52:59 -05:00
Aaron Pham
10f508d051 fix(mixtral): correct chat templates to remove additional spacing (#774) 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 12:34:06 -05:00
Aaron Pham
c81b4c47af infra: bump to homebrew tap release to 0.4.37 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 14:23:19 +00:00
Aaron Pham
c399d56995 infra: bump to dev version of 0.4.38.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 14:21:42 +00:00
Aaron Pham
8d9d212d61 infra: prepare for release 0.4.37 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.37 		2023-12-13 14:07:33 +00:00
Aaron Pham
69253b3462 chore: running all script when installation (#773) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 09:05:48 -05:00
Aaron Pham
3ab78cd105 feat(mixtral): correct support for mixtral (#772) 
feat(mixtral): support inference with pt

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-13 09:03:56 -05:00
Aaron Pham
eb310349c9 infra: bump to homebrew tap release to 0.4.36 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-12 06:46:16 +00:00
Aaron Pham
1f930b00f6 infra: bump to dev version of 0.4.37.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-12 06:44:35 +00:00
Aaron Pham
9cd1e44b1e infra: prepare for release 0.4.36 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.36 		2023-12-12 06:34:39 +00:00
Aaron Pham
d3328343d7 feat: mixtral support (#770) 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-12 01:33:13 -05:00
dependabot[bot]
b9260a8df3 chore(deps): bump github/codeql-action from 2.22.8 to 2.22.9 (#762) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.22.8 to 2.22.9.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](407ffafae6...c0d1daa7f7)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-12 00:19:55 -05:00
dependabot[bot]
022083033d chore(deps): bump aquasecurity/trivy-action from 0.14.0 to 0.16.0 (#763) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.14.0 to 0.16.0.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](2b6a709cf9...91713af97d)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-12 00:19:45 -05:00
dependabot[bot]
4180ec4029 chore(deps): bump taiki-e/install-action from 2.21.26 to 2.22.0 (#764) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.26 to 2.22.0.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](d211c4be5a...6ee6c3ab83)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-12 00:19:22 -05:00
dependabot[bot]
4aeff2b3a0 chore(deps): bump actions/setup-python from 4.7.1 to 5.0.0 (#765) 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 4.7.1 to 5.0.0.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](65d7f2d534...0a5c615913)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-12 00:19:09 -05:00
dependabot[bot]
1acc6f3a66 chore(deps): bump docker/metadata-action from 5.2.0 to 5.3.0 (#766) 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 5.2.0 to 5.3.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Commits](e6428a5c4e...31cebacef4)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-12 00:18:24 -05:00
pre-commit-ci[bot]
d879aea469 ci: pre-commit autoupdate [pre-commit.ci] (#767) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.1.6 → v0.1.7](https://github.com/astral-sh/ruff-pre-commit/compare/v0.1.6...v0.1.7)
- [github.com/pre-commit/mirrors-prettier: v4.0.0-alpha.3 → v4.0.0-alpha.4](https://github.com/pre-commit/mirrors-prettier/compare/v4.0.0-alpha.3...v4.0.0-alpha.4)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-12-12 00:18:14 -05:00
Aaron
59e8ef93dc chore(deps): lock vLLM to 0.2.4 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-12 00:17:18 -05:00
Aaron Pham
08114410bc fix(openai): logprobs when echo is enabled (#761) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-10 18:09:25 -05:00
Aaron Pham
c3a0b5c39f feat(openai): supports echo (#760) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-10 13:19:40 -05:00
Aaron
bb4ed8b53c fix(llm): correct annotations definitions 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-12-09 09:59:02 -05:00
Aaron Pham
c0307c9d71 infra: bump to homebrew tap release to 0.4.35 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 08:48:05 +00:00
Aaron Pham
eeb3cbc2d1 infra: bump to dev version of 0.4.36.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 08:46:31 +00:00
Aaron Pham
8019fd84c8 infra: prepare for release 0.4.35 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.35 		2023-12-07 08:38:13 +00:00
Aaron Pham
6a185bc88e fix(logprobs): explicitly set logprobs=None (#757) 
logprobs=0 still outputs logprobs for one generation

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-12-07 03:36:39 -05:00
pre-commit-ci[bot]
d16b9804dc ci: pre-commit autoupdate [pre-commit.ci] (#753) 
updates:
- [github.com/pre-commit/mirrors-eslint: v8.54.0 → v8.55.0](https://github.com/pre-commit/mirrors-eslint/compare/v8.54.0...v8.55.0)
- [github.com/pre-commit/mirrors-prettier: v3.1.0 → v4.0.0-alpha.3](https://github.com/pre-commit/mirrors-prettier/compare/v3.1.0...v4.0.0-alpha.3)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-12-04 13:29:55 -05:00
dependabot[bot]
44fda647b3 chore(deps): bump taiki-e/install-action from 2.21.19 to 2.21.26 (#750) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.19 to 2.21.26.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](b61491983a...d211c4be5a)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:52 -05:00
dependabot[bot]
5c43cee299 chore(deps): bump docker/metadata-action from 5.0.0 to 5.2.0 (#751) 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 5.0.0 to 5.2.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Commits](96383f4557...e6428a5c4e)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:44 -05:00
dependabot[bot]
aa597d644f chore(deps): bump pypa/gh-action-pypi-publish from 1.8.10 to 1.8.11 (#749) 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.8.10 to 1.8.11.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](b7f401de30...2f6f737ca5)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-12-04 08:43:36 -05:00