mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-04-30 11:55:06 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,501 Commits 6 Branches 194 Tags
20ac656018528eeb60fbd098ece4483653a02e66
Commit Graph

1501 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Pham (mbp16)
20ac656018 fix(deps): make sure core deps are available on setup 
Signed-off-by: Aaron Pham (mbp16) <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 12:44:22 -04:00
Aaron Pham (mbp16)
f4f7f16e81 chore(releases): remove deadcode 
Signed-off-by: Aaron Pham (mbp16) <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 12:37:50 -04:00
Aaron Pham (mbp16)
da42c269c9 fix(ci): remove checking for hatch 
since we don't use it on the script any longer.

Signed-off-by: Aaron Pham (mbp16) <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 12:12:40 -04:00
dependabot[bot]
5fcfa51573 chore(deps): bump taiki-e/install-action from 2.33.22 to 2.33.34 (#1000) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.33.22 to 2.33.34.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](c2927f0c5b...60784cb1f4)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-27 11:59:51 -04:00
paperspace
e84cd815e4 fix(releases): make sure to use correct hash 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 15:59:09 +00:00
paperspace
1eea284810 chore: update actions to v5 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 15:52:38 +00:00
Aaron
6d870c06a0 fix(ci): make sure to use distinct name pattern for v4 upload 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 22:25:03 -04:00
paperspace
6fad74e510 fix: setup python for binary distribution 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 17:29:14 +00:00
paperspace
479f44ce04 fix: make sure to separate PR and main run 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 17:24:16 +00:00
Aaron Pham
f248ea25cd feat(ci): running CI on paperspace (#998) 
* chore: update tiny script

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* feat(ci): running on paperspace machines

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update models and increase timeout readiness

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: schema validation for inputs and update client supporting stop

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update coverage config

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: remove some non-essentials

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update locks

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 13:14:54 -04:00
paperspace
a58e12d116 fix: ci 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 08:38:24 +00:00
Aaron Pham
3f048d8a5b chore(qol): update CLI options and performance upgrade for build cache (#997) 
* chore(qol): update CLI options and performance upgrade for build cache

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update default python version for dev

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* fix: install custom tar.gz models

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 04:17:23 -04:00
Aaron
bc0be036d5 infra: enable releases cycle for next dev versions 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 12:59:02 -04:00
Aaron
315aaa0c26 revert: "chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3 (#986)" 
This reverts commit dda3b1da3e.
 2024-05-23 12:55:11 -04:00
Aaron
bf31d3f9d6 revert: "chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7 (#990)" 
This reverts commit 346ab20cca.
 2024-05-23 12:55:01 -04:00
dependabot[bot]
346ab20cca chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7 (#990) 
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3.0.2 to 4.1.7.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](9bc31d5ccc...65a9edc588)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-23 12:51:35 -04:00
dependabot[bot]
dda3b1da3e chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3 (#986) 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3.1.3 to 4.3.3.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](a8a3f3ad30...65462800fd)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-23 12:51:18 -04:00
Aaron Pham
5e97329bcb infra: prepare 0.5 releases (#996) 
* chore: prepare for 0.5

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update changelogs

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: fix to lowest python version supported

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update scripts

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 12:50:01 -04:00
paperspace
a410b9cfe8 infra: update README 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 16:44:03 +00:00
Aaron Pham
fa850bafeb infra: prepare for release 0.5.0-alpha.14 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.14 		2024-05-23 14:43:49 +00:00
paperspace
cec0aa5487 fix(memory): correctly recommend instance types for cloud 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 14:42:39 +00:00
paperspace
db523e2940 chore(infra): add support for dry running versioning for releases 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 14:06:08 +00:00
Aaron Pham
97d76eec85 tests: add additional basic testing (#982) 
* chore: update rebase tests

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update partial clients before removing

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* fix: update clients parsing logics to work with 0.5

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: ignore ci runs as to run locally

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update async client tests

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update pre-commit

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 10:02:23 -04:00
Aaron Pham
5cb5203eea infra: prepare for release 0.5.0-alpha.13 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.13 		2024-05-22 15:17:25 +00:00
paperspace
b7193511e6 fix: correct update default value for dict unpacking 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-22 15:15:23 +00:00
Dennis Rall
362c099f97 fix(docs): update correct BentoML links (#995) 
Signed-off-by: Dennis Rall <56480601+dennisrall@users.noreply.github.com>
 2024-05-22 11:14:08 -04:00
dependabot[bot]
40db3dee08 chore(deps): bump aquasecurity/trivy-action from 0.19.0 to 0.20.0 (#991) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.19.0 to 0.20.0.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](d710430a67...b2933f565d)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:51 -04:00
dependabot[bot]
d72b4bf82d chore(deps): bump github/codeql-action from 3.25.3 to 3.25.5 (#992) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 3.25.3 to 3.25.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](d39d31e687...b7cec75265)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:40 -04:00
dependabot[bot]
95d471410d chore(deps): bump actions/checkout from 4.1.5 to 4.1.6 (#993) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.5 to 4.1.6.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](44c2b7a8a4...a5ac7e51b4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:29 -04:00
pre-commit-ci[bot]
a3553b9dd5 ci: pre-commit autoupdate [pre-commit.ci] (#994) 
updates:
- [github.com/pre-commit/mirrors-eslint: v9.2.0 → v9.3.0](https://github.com/pre-commit/mirrors-eslint/compare/v9.2.0...v9.3.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-05-22 11:00:19 -04:00
Aaron Pham
f97f5108c4 infra: prepare for release 0.5.0-alpha.12 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.12 		2024-05-14 06:44:07 +00:00
paperspace
e9246e7772 fix: make sure to only update fields when correct type is parse 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-14 06:42:46 +00:00
dependabot[bot]
03c51ab133 chore(deps): bump next from 13.4.8 to 14.1.1 (#983) 
Bumps [next](https://github.com/vercel/next.js) from 13.4.8 to 14.1.1.
- [Release notes](https://github.com/vercel/next.js/releases)
- [Changelog](https://github.com/vercel/next.js/blob/canary/release.js)
- [Commits](https://github.com/vercel/next.js/compare/v13.4.8...v14.1.1)

---
updated-dependencies:
- dependency-name: next
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 22:05:23 -04:00
dependabot[bot]
f285781a46 chore(deps): bump actions/checkout from 4.1.1 to 4.1.5 (#984) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.1 to 4.1.5.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](b4ffde65f4...44c2b7a8a4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 22:04:16 -04:00
dependabot[bot]
a9d1a8e78c chore(deps): bump taiki-e/install-action from 2.33.9 to 2.33.22 (#985) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.33.9 to 2.33.22.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](00a67321d6...c2927f0c5b)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 22:04:08 -04:00
pre-commit-ci[bot]
2ac065aad7 ci: pre-commit autoupdate [pre-commit.ci] (#989) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.4.3 → v0.4.4](https://github.com/astral-sh/ruff-pre-commit/compare/v0.4.3...v0.4.4)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-05-13 22:03:55 -04:00
dependabot[bot]
dd08d39507 chore(deps): bump softprops/action-gh-release from 1 to 2 (#987) 
Bumps [softprops/action-gh-release](https://github.com/softprops/action-gh-release) from 1 to 2.
- [Release notes](https://github.com/softprops/action-gh-release/releases)
- [Changelog](https://github.com/softprops/action-gh-release/blob/master/CHANGELOG.md)
- [Commits](de2c0eb89a...69320dbe05)

---
updated-dependencies:
- dependency-name: softprops/action-gh-release
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 21:06:13 -04:00
dependabot[bot]
b96bbb87e5 chore(deps): bump rlespinasse/github-slug-action from 4.4.1 to 4.5.0 (#988) 
Bumps [rlespinasse/github-slug-action](https://github.com/rlespinasse/github-slug-action) from 4.4.1 to 4.5.0.
- [Release notes](https://github.com/rlespinasse/github-slug-action/releases)
- [Commits](102b1a064a...797d688647)

---
updated-dependencies:
- dependency-name: rlespinasse/github-slug-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 21:06:01 -04:00
Aaron
97279f797c fix(ci): make sure to remove alpha version for minor 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-12 00:37:18 -04:00
Aaron Pham
d5447240ef infra: prepare for release 0.5.0-alpha.11 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.11 		2024-05-12 04:22:35 +00:00
paperspace
806308eed6 fix: one-shot generation not to concatenate duplicates 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-12 04:21:06 +00:00
paperspace
1d2e554a94 chore: disable progressbar for cleaner log trace 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-10 03:11:47 +00:00
Aaron Pham
a335312ce2 infra: prepare for release 0.5.0-alpha.10 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.10 		2024-05-09 22:37:31 +00:00
paperspace
9a961d9070 perf(build): improve preheating layers for caching dependencies 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 22:34:39 +00:00
Aaron Pham
03610d652d infra: prepare for release 0.5.0-alpha.9 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.9 		2024-05-09 21:16:45 +00:00
paperspace
8e82bd9600 chore: update streaming logics to respect cursor 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 21:13:28 +00:00
paperspace
dd79779e0e fix: update generate_stream to yield delta based on given index 
generation

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 20:18:00 +00:00
Aaron Pham
642cf6aaf2 infra: prepare for release 0.5.0-alpha.8 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.8 		2024-05-09 01:38:22 +00:00
paperspace
c9f8dbc767 feat: set options for 'gpu' for building recommendation 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 01:37:29 +00:00
Aaron Pham
5e444381bb infra: prepare for release 0.5.0-alpha.7 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.5.0-alpha.7 		2024-05-09 01:18:05 +00:00