mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-30 18:32:18 -05:00
Code Issues Packages Projects Releases Wiki Activity
770 Commits 6 Branches 194 Tags
v0.3.2
Commit Graph

770 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Pham
fd18c8be01 infra: prepare for release 0.3.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.2 		2023-09-06 19:03:40 +00:00
Aaron
675b372981 fix: synchronize device for inference 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 14:08:52 -04:00
Aaron Pham
030a861a08 infra: bump to homebrew tap release to 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:03:04 +00:00
Aaron Pham
b281cb6466 infra: bump to dev version of 0.3.2.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:01:30 +00:00
Aaron Pham
b61005424b infra: prepare for release 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.1 		2023-09-06 17:49:58 +00:00
Aaron Pham
52e04dc982 revert: disable compiled wheels for now (#304) 
* revert: disable compiled wheels for now

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: add changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: compiled

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: ignore pyright

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 13:44:41 -04:00
Aaron
887ffa9aa0 chore: cleanup pre-commit jobs and update usage 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 10:06:36 -04:00
Sherlock Xu
c59b3a03b5 docs: cleanup README.md landing page (#302) 
* Update the readme

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

* fix type

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* Update README.md

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 07:51:40 -04:00
aarnphm-ec2-dev
f43c721579 chore: only add bentomodel branch during generated service with 
OpenLLM

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 01:08:23 +00:00
Aaron Pham
3818bfefaf infra: bump to homebrew tap release to 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:18:46 +00:00
Aaron Pham
e68c9c5e4d infra: bump to dev version of 0.3.1.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:15:42 +00:00
Aaron Pham
06a68ade7d infra: prepare for release 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.0 		2023-09-04 19:03:41 +00:00
Aaron
5eea40a599 chore(readme): update README for release [generated] [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 15:02:01 -04:00
dependabot[bot]
68de4f9d04 chore(deps): bump @mui/x-data-grid from 6.11.2 to 6.12.1 (#288) 
Bumps [@mui/x-data-grid](https://github.com/mui/mui-x/tree/HEAD/packages/grid/x-data-grid) from 6.11.2 to 6.12.1.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.12.1/packages/grid/x-data-grid)

---
updated-dependencies:
- dependency-name: "@mui/x-data-grid"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:44 -04:00
dependabot[bot]
8707a4ebe4 chore(deps): bump @mui/base from 5.0.0-beta.12 to 5.0.0-beta.13 (#287) 
Bumps [@mui/base](https://github.com/mui/material-ui/tree/HEAD/packages/mui-base) from 5.0.0-beta.12 to 5.0.0-beta.13.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/HEAD/packages/mui-base)

---
updated-dependencies:
- dependency-name: "@mui/base"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:35 -04:00
dependabot[bot]
bce350c04f chore(deps): bump @mui/material from 5.14.6 to 5.14.7 (#289) 
Bumps [@mui/material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-material) from 5.14.6 to 5.14.7.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.7/packages/mui-material)

---
updated-dependencies:
- dependency-name: "@mui/material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:29 -04:00
dependabot[bot]
7310ce9b9f chore(deps): bump @mui/icons-material from 5.14.6 to 5.14.7 (#290) 
Bumps [@mui/icons-material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-icons-material) from 5.14.6 to 5.14.7.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.7/packages/mui-icons-material)

---
updated-dependencies:
- dependency-name: "@mui/icons-material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:06:30 -04:00
dependabot[bot]
5c546587fc chore(deps): bump @mui/x-date-pickers from 6.12.0 to 6.12.1 (#291) 
Bumps [@mui/x-date-pickers](https://github.com/mui/mui-x/tree/HEAD/packages/x-date-pickers) from 6.12.0 to 6.12.1.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.12.1/packages/x-date-pickers)

---
updated-dependencies:
- dependency-name: "@mui/x-date-pickers"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 14:06:21 -04:00
pre-commit-ci[bot]
e5de0ee31e ci: pre-commit autoupdate [pre-commit.ci] (#298) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.0.286 → v0.0.287](https://github.com/astral-sh/ruff-pre-commit/compare/v0.0.286...v0.0.287)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-04 14:06:05 -04:00
Aaron Pham
956b3a53bc fix(gptq): use upstream integration (#297) 
* wip

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* feat: GPTQ transformers integration

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* fix: only load if variable is available and add changelog

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* chore: remove boilerplate check

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 14:05:50 -04:00
dependabot[bot]
3da869e728 chore(deps): bump crazy-max/ghaction-import-gpg from 5.3.0 to 5.4.0 (#293) 
Bumps [crazy-max/ghaction-import-gpg](https://github.com/crazy-max/ghaction-import-gpg) from 5.3.0 to 5.4.0.
- [Release notes](https://github.com/crazy-max/ghaction-import-gpg/releases)
- [Commits](72b6676b71...d6f3f49f33)

---
updated-dependencies:
- dependency-name: crazy-max/ghaction-import-gpg
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:56:35 -04:00
dependabot[bot]
eb089af0bf chore(deps): bump github/codeql-action from 2.21.4 to 2.21.5 (#292) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.21.4 to 2.21.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](a09933a12a...00e563ead9)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:56:18 -04:00
dependabot[bot]
5675d7cfe8 chore(deps): bump aquasecurity/trivy-action from 559eb1224e654a86c844a795e6702a0742c60c72 to fbd16365eb88e12433951383f5e99bd901fc618f (#294) 
chore(deps): bump aquasecurity/trivy-action

Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 559eb1224e654a86c844a795e6702a0742c60c72 to fbd16365eb88e12433951383f5e99bd901fc618f.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](559eb1224e...fbd16365eb)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:42 -04:00
dependabot[bot]
ad5b826825 chore(deps): bump taiki-e/install-action from 2.17.2 to 2.17.8 (#295) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.17.2 to 2.17.8.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](f0d0def1e2...6801bd56b9)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:25 -04:00
dependabot[bot]
31689a92c7 chore(deps): bump sigstore/cosign-installer from 3.1.1 to 3.1.2 (#296) 
Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.1.1 to 3.1.2.
- [Release notes](https://github.com/sigstore/cosign-installer/releases)
- [Commits](6e04d228eb...11086d2504)

---
updated-dependencies:
- dependency-name: sigstore/cosign-installer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:13 -04:00
aarnphm-ec2-dev
a981c7104a infra: add blame rev 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 17:01:40 +00:00
aarnphm-ec2-dev
7d893e6cd2 chore: ignore new lines split [skip ci] 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 17:00:49 +00:00
Aaron Pham
608de0b667 fix(serving): vllm distributed size (#285) 
* chore(weights): ignore gguf pattern for non GGML backend

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* chore: correct fix num_gpus to be divisble by 2

This depends on the attention_heads from given models

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 12:37:10 -04:00
Aaron Pham
b7af7765d4 fix(yapf): align weird new lines break [generated] [skip ci] (#284) 
fix(yapf): align weird new lines break

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 05:34:22 -04:00
Aaron Pham
3e45530abd refactor(breaking): unify LLM API (#283) 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 05:15:19 -04:00
Aaron
35601dab20 fix(ci): correct set path for auto UI build 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 15:18:53 -04:00
GutZuFusss
d1c391b5bb fix(clojure): weird characters over model dropdowns on container (#280) 
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 15:17:01 -04:00
Aaron
b4f052eff5 infra: update to google style [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:53:02 -04:00
Aaron
b545ad2ad1 style: google 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:52:35 -04:00
Aaron
e2ba6a92a6 revert: "chore: remove ignore blame" 
This reverts commit 1e70b7314c.
 2023-08-30 13:13:03 -04:00
Aaron
1e70b7314c chore: remove ignore blame 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:11:32 -04:00
Aaron Pham
c9cef1d773 fix: persistent styling between ruff and yapf (#279) 2023-08-30 11:37:41 -04:00
Aaron Pham
f678f71e18 infra(clojure): update build dependencies (#278) 2023-08-29 17:06:41 -04:00
dependabot[bot]
2fd4b77594 chore(deps): bump @mui/x-date-pickers from 6.11.2 to 6.12.0 (#263) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-29 00:14:58 -04:00
dependabot[bot]
7a2ba00170 chore(deps): bump @mui/material from 5.14.5 to 5.14.6 (#266) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-29 00:12:24 -04:00
dependabot[bot]
f215443bf4 chore(deps): bump @mui/base from 5.0.0-beta.11 to 5.0.0-beta.12 (#264) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-29 00:12:12 -04:00
dependabot[bot]
9301d31ce8 chore(deps-dev): bump shadow-cljs from 2.25.2 to 2.25.3 (#262) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:27:12 -04:00
dependabot[bot]
8f037f5723 chore(deps): bump @mui/icons-material from 5.14.3 to 5.14.6 (#265) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:27:01 -04:00
dependabot[bot]
793c6c9082 chore(deps): bump taiki-e/install-action from 2.16.0 to 2.17.2 (#268) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:26:43 -04:00
dependabot[bot]
31f19ab936 chore(deps): bump aws-actions/configure-aws-credentials from 2.2.0 to 3.0.1 (#270) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:26:29 -04:00
dependabot[bot]
6ca15ad1c9 chore(deps): bump docker/setup-buildx-action from 2.9.1 to 2.10.0 (#271) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:26:20 -04:00
pre-commit-ci[bot]
f23aad8a40 ci: pre-commit autoupdate [pre-commit.ci] (#273) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-08-28 15:25:56 -04:00
dependabot[bot]
1796e90a47 chore(deps): bump actions/checkout from 3.5.3 to 3.6.0 (#269) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:24:32 -04:00
dependabot[bot]
dd8d587641 chore(deps): bump bentoml/setup-bentoml-action from 59beefe94e2e8f8ebbedf555fc86bd5d1ae0a708 to d4010d8303684b183f45b33c6a44644f81337bdb (#267) 
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-08-28 15:20:28 -04:00
Aaron Pham
2036d4e015 chore(build): use latest vllm pre-built kernel (#261) 2023-08-26 09:02:52 -04:00