mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-28 09:21:59 -05:00
Code Issues Packages Projects Releases Wiki Activity
1,574 Commits 6 Branches 194 Tags
a67ccdfd314158ccde3a5a3678622b6da279b1aa
Commit Graph

297 Commits

Author SHA1 Message Date
Aaron Pham
a67ccdfd31 chore: increase command timeout for ssh_actions 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2024-06-17 11:57:44 -04:00
dependabot[bot]
6cd245598a chore(deps): bump pypa/gh-action-pypi-publish from 1.8.14 to 1.9.0 (#1016) 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.8.14 to 1.9.0.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](81e9d935c8...ec4db0b4dd)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-17 11:32:51 -04:00
dependabot[bot]
3910a7912f chore(deps): bump actions/checkout from 4.1.6 to 4.1.7 (#1017) [skip ci] 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.6 to 4.1.7.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](a5ac7e51b4...692973e3d9)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-17 11:32:40 -04:00
dependabot[bot]
970e13fed7 chore(deps): bump taiki-e/install-action from 2.38.0 to 2.39.1 (#1018) [skip ci] 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.38.0 to 2.39.1.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](d0c2bb4cff...47943d5b8d)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-17 11:32:25 -04:00
Aaron Pham
8079d4dd70 chore(ci): always accept flake config 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2024-06-14 02:57:11 +00:00
Aaron Pham
3251ad1f2c chore(ci): remove redudant installation 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2024-06-13 22:37:05 -04:00
Aaron Pham
db0e6df7f1 fix(ci): set autogenerated tokens [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 11:27:44 -04:00
Aaron Pham
7d501d6778 chore: export machine id and ip correspondingly 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 10:09:02 -04:00
Aaron Pham
b3b1c63a9f fix(ci): pass correct variables 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:52:43 -04:00
Aaron Pham
7bccecd2f0 fix(ci): specifying network_id from secrets 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:42:05 -04:00
Aaron Pham
7116c69da5 fix: masks shells 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:34:52 -04:00
Aaron Pham
6cdcb0d20a chore(infra): add masks 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:32:16 -04:00
Aaron Pham
eaf5dafca9 feat(infra): add support for autogenerate CI runners 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:27:30 -04:00
Aaron Pham
59c184be18 fix(ci): set absolute path for nix for non-interactive shell 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 09:56:25 +00:00
Aaron Pham
6ca39486a0 feat(nix): reproducible scripts [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-06-11 08:10:26 +00:00
dependabot[bot]
1abc44d4bc chore(deps): bump taiki-e/install-action from 2.34.0 to 2.38.0 (#1011) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.34.0 to 2.38.0.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](4e38715ddc...d0c2bb4cff)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-11 01:10:48 -04:00
dependabot[bot]
295bfcb589 chore(deps): bump taiki-e/install-action from 2.33.34 to 2.34.0 (#1006) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.33.34 to 2.34.0.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](60784cb1f4...4e38715ddc)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-06-03 16:46:13 -04:00
paperspace
a93da12084 chore: upgrade to new vLLM schema 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-06-02 15:52:45 +00:00
paperspace
2e7592cd45 fix(ci): no need to install default packages 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-06-02 14:27:54 +00:00
paperspace
8fea50dfdb feat: update ROCm check for syspath 
See #950 for more information

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-06-02 14:20:23 +00:00
Aaron Pham
439f10c786 chore(ci): make sure binary depends on publish to avoid race condition 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-28 22:48:08 -04:00
Aaron Pham
fd527352b2 chore(ci): cleanup unnecessary dev refresh cycle 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 14:34:33 -04:00
dependabot[bot]
5fcfa51573 chore(deps): bump taiki-e/install-action from 2.33.22 to 2.33.34 (#1000) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.33.22 to 2.33.34.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](c2927f0c5b...60784cb1f4)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-27 11:59:51 -04:00
paperspace
e84cd815e4 fix(releases): make sure to use correct hash 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 15:59:09 +00:00
paperspace
1eea284810 chore: update actions to v5 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-27 15:52:38 +00:00
Aaron
6d870c06a0 fix(ci): make sure to use distinct name pattern for v4 upload 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 22:25:03 -04:00
paperspace
6fad74e510 fix: setup python for binary distribution 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 17:29:14 +00:00
paperspace
479f44ce04 fix: make sure to separate PR and main run 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 17:24:16 +00:00
Aaron Pham
f248ea25cd feat(ci): running CI on paperspace (#998) 
* chore: update tiny script

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* feat(ci): running on paperspace machines

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update models and increase timeout readiness

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: schema validation for inputs and update client supporting stop

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update coverage config

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: remove some non-essentials

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update locks

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 13:14:54 -04:00
paperspace
a58e12d116 fix: ci 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-26 08:38:24 +00:00
Aaron
bc0be036d5 infra: enable releases cycle for next dev versions 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 12:59:02 -04:00
Aaron
315aaa0c26 revert: "chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3 (#986)" 
This reverts commit dda3b1da3e.
 2024-05-23 12:55:11 -04:00
Aaron
bf31d3f9d6 revert: "chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7 (#990)" 
This reverts commit 346ab20cca.
 2024-05-23 12:55:01 -04:00
dependabot[bot]
346ab20cca chore(deps): bump actions/download-artifact from 3.0.2 to 4.1.7 (#990) 
Bumps [actions/download-artifact](https://github.com/actions/download-artifact) from 3.0.2 to 4.1.7.
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](9bc31d5ccc...65a9edc588)

---
updated-dependencies:
- dependency-name: actions/download-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-23 12:51:35 -04:00
dependabot[bot]
dda3b1da3e chore(deps): bump actions/upload-artifact from 3.1.3 to 4.3.3 (#986) 
Bumps [actions/upload-artifact](https://github.com/actions/upload-artifact) from 3.1.3 to 4.3.3.
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](a8a3f3ad30...65462800fd)

---
updated-dependencies:
- dependency-name: actions/upload-artifact
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-23 12:51:18 -04:00
Aaron Pham
97d76eec85 tests: add additional basic testing (#982) 
* chore: update rebase tests

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update partial clients before removing

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* fix: update clients parsing logics to work with 0.5

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: ignore ci runs as to run locally

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update async client tests

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* chore: update pre-commit

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-23 10:02:23 -04:00
dependabot[bot]
40db3dee08 chore(deps): bump aquasecurity/trivy-action from 0.19.0 to 0.20.0 (#991) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.19.0 to 0.20.0.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](d710430a67...b2933f565d)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:51 -04:00
dependabot[bot]
d72b4bf82d chore(deps): bump github/codeql-action from 3.25.3 to 3.25.5 (#992) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 3.25.3 to 3.25.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](d39d31e687...b7cec75265)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:40 -04:00
dependabot[bot]
95d471410d chore(deps): bump actions/checkout from 4.1.5 to 4.1.6 (#993) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.5 to 4.1.6.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](44c2b7a8a4...a5ac7e51b4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-22 11:00:29 -04:00
dependabot[bot]
f285781a46 chore(deps): bump actions/checkout from 4.1.1 to 4.1.5 (#984) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 4.1.1 to 4.1.5.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](b4ffde65f4...44c2b7a8a4)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 22:04:16 -04:00
dependabot[bot]
a9d1a8e78c chore(deps): bump taiki-e/install-action from 2.33.9 to 2.33.22 (#985) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.33.9 to 2.33.22.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](00a67321d6...c2927f0c5b)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 22:04:08 -04:00
dependabot[bot]
dd08d39507 chore(deps): bump softprops/action-gh-release from 1 to 2 (#987) 
Bumps [softprops/action-gh-release](https://github.com/softprops/action-gh-release) from 1 to 2.
- [Release notes](https://github.com/softprops/action-gh-release/releases)
- [Changelog](https://github.com/softprops/action-gh-release/blob/master/CHANGELOG.md)
- [Commits](de2c0eb89a...69320dbe05)

---
updated-dependencies:
- dependency-name: softprops/action-gh-release
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 21:06:13 -04:00
dependabot[bot]
b96bbb87e5 chore(deps): bump rlespinasse/github-slug-action from 4.4.1 to 4.5.0 (#988) 
Bumps [rlespinasse/github-slug-action](https://github.com/rlespinasse/github-slug-action) from 4.4.1 to 4.5.0.
- [Release notes](https://github.com/rlespinasse/github-slug-action/releases)
- [Commits](102b1a064a...797d688647)

---
updated-dependencies:
- dependency-name: rlespinasse/github-slug-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-13 21:06:01 -04:00
dependabot[bot]
43eed3cc90 chore(deps): bump peter-evans/create-pull-request from 5.0.2 to 6.0.5 (#976) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-08 14:51:58 -04:00
dependabot[bot]
46433bc745 chore(deps): bump docker/setup-buildx-action from 3.2.0 to 3.3.0 (#975) 
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 3.2.0 to 3.3.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases)
- [Commits](2b51285047...d70bba72b1)

---
updated-dependencies:
- dependency-name: docker/setup-buildx-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-07 17:27:33 -04:00
dependabot[bot]
3cf71016af chore(deps): bump github/codeql-action from 3.24.9 to 3.25.3 (#977) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 3.24.9 to 3.25.3.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](1b1aada464...d39d31e687)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-07 17:27:18 -04:00
dependabot[bot]
70ca537cb4 chore(deps): bump docker/login-action from 3.0.0 to 3.1.0 (#978) 
Bumps [docker/login-action](https://github.com/docker/login-action) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](343f7c4344...e92390c5fb)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-07 17:27:07 -04:00
dependabot[bot]
0556812419 chore(deps): bump docker/build-push-action from 5.1.0 to 5.3.0 (#979) 
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 5.1.0 to 5.3.0.
- [Release notes](https://github.com/docker/build-push-action/releases)
- [Commits](4a13e500e5...2cdde995de)

---
updated-dependencies:
- dependency-name: docker/build-push-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-05-07 17:26:53 -04:00
dependabot[bot]
67f755487a chore(deps): bump pypa/gh-action-pypi-publish from 1.8.11 to 1.8.14 (#958) 
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.8.11 to 1.8.14.
- [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases)
- [Commits](2f6f737ca5...81e9d935c8)

---
updated-dependencies:
- dependency-name: pypa/gh-action-pypi-publish
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-04-29 20:58:58 -04:00
dependabot[bot]
07008b7c9e chore(deps): bump actions/setup-python from 5.0.0 to 5.1.0 (#955) 
Bumps [actions/setup-python](https://github.com/actions/setup-python) from 5.0.0 to 5.1.0.
- [Release notes](https://github.com/actions/setup-python/releases)
- [Commits](0a5c615913...82c7e631bb)

---
updated-dependencies:
- dependency-name: actions/setup-python
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-04-29 20:56:29 -04:00