mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-04-22 16:07:24 -04:00
Code Issues Packages Projects Releases Wiki Activity
784 Commits 6 Branches 194 Tags
be46683490627ebf8a193785903f42e26faef8ff
Commit Graph

784 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
pre-commit-ci[bot]
be46683490 ci: pre-commit autoupdate [pre-commit.ci] (#325) 
updates:
- [github.com/RobertCraigie/pyright-python: v1.1.324 → v1.1.326](https://github.com/RobertCraigie/pyright-python/compare/v1.1.324...v1.1.326)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-11 14:31:45 -04:00
aarnphm-ec2-dev
2e1b51422f fix(embeddings): update to the latest API name 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 18:31:50 +00:00
aarnphm-ec2-dev
bbc6abe904 fix(ci): make sure to lock build to 0.10 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 17:48:16 +00:00
aarnphm-ec2-dev
c7f915fa71 chore: update documentation wrt to envvar correctness 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 17:43:03 +00:00
aarnphm-ec2-dev
f917898867 chore: update langchain examples 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 03:35:10 +00:00
aarnphm-ec2-dev
8530a067ea chore(serialisation): dump quantization_config.json to conform with 
optimum load

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 16:50:50 +00:00
Sherlock Xu
6b6cf7a9cb dos: correct typo on headline (#305) 
fix typo

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
 2023-09-07 10:35:12 -04:00
Aaron
0d50aa00b9 chore: add openllm-core as meta dependencies 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 10:31:40 -04:00
Aaron Pham
c690bcf31d infra: bump to homebrew tap release to 0.3.3 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 02:05:16 +00:00
Aaron Pham
098a6f3349 infra: bump to dev version of 0.3.4.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 02:03:52 +00:00
Aaron Pham
7e2c8428bb infra: prepare for release 0.3.3 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.3 		2023-09-07 01:51:18 +00:00
aarnphm-ec2-dev
8173cb09a5 fix(quantize): dyn quant for int8 and int4 
only set tokenizer when it is gptq

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 01:48:45 +00:00
Aaron Pham
dd120d8516 infra: bump to homebrew tap release to 0.3.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 19:15:50 +00:00
Aaron Pham
9cf8422d26 infra: bump to dev version of 0.3.3.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 19:14:27 +00:00
Aaron Pham
fd18c8be01 infra: prepare for release 0.3.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.2 		2023-09-06 19:03:40 +00:00
Aaron
675b372981 fix: synchronize device for inference 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 14:08:52 -04:00
Aaron Pham
030a861a08 infra: bump to homebrew tap release to 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:03:04 +00:00
Aaron Pham
b281cb6466 infra: bump to dev version of 0.3.2.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:01:30 +00:00
Aaron Pham
b61005424b infra: prepare for release 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.1 		2023-09-06 17:49:58 +00:00
Aaron Pham
52e04dc982 revert: disable compiled wheels for now (#304) 
* revert: disable compiled wheels for now

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: add changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: compiled

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: ignore pyright

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 13:44:41 -04:00
Aaron
887ffa9aa0 chore: cleanup pre-commit jobs and update usage 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 10:06:36 -04:00
Sherlock Xu
c59b3a03b5 docs: cleanup README.md landing page (#302) 
* Update the readme

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

* fix type

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* Update README.md

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 07:51:40 -04:00
aarnphm-ec2-dev
f43c721579 chore: only add bentomodel branch during generated service with 
OpenLLM

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 01:08:23 +00:00
Aaron Pham
3818bfefaf infra: bump to homebrew tap release to 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:18:46 +00:00
Aaron Pham
e68c9c5e4d infra: bump to dev version of 0.3.1.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:15:42 +00:00
Aaron Pham
06a68ade7d infra: prepare for release 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.0 		2023-09-04 19:03:41 +00:00
Aaron
5eea40a599 chore(readme): update README for release [generated] [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 15:02:01 -04:00
dependabot[bot]
68de4f9d04 chore(deps): bump @mui/x-data-grid from 6.11.2 to 6.12.1 (#288) 
Bumps [@mui/x-data-grid](https://github.com/mui/mui-x/tree/HEAD/packages/grid/x-data-grid) from 6.11.2 to 6.12.1.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.12.1/packages/grid/x-data-grid)

---
updated-dependencies:
- dependency-name: "@mui/x-data-grid"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:44 -04:00
dependabot[bot]
8707a4ebe4 chore(deps): bump @mui/base from 5.0.0-beta.12 to 5.0.0-beta.13 (#287) 
Bumps [@mui/base](https://github.com/mui/material-ui/tree/HEAD/packages/mui-base) from 5.0.0-beta.12 to 5.0.0-beta.13.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/HEAD/packages/mui-base)

---
updated-dependencies:
- dependency-name: "@mui/base"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:35 -04:00
dependabot[bot]
bce350c04f chore(deps): bump @mui/material from 5.14.6 to 5.14.7 (#289) 
Bumps [@mui/material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-material) from 5.14.6 to 5.14.7.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.7/packages/mui-material)

---
updated-dependencies:
- dependency-name: "@mui/material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:40:29 -04:00
dependabot[bot]
7310ce9b9f chore(deps): bump @mui/icons-material from 5.14.6 to 5.14.7 (#290) 
Bumps [@mui/icons-material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-icons-material) from 5.14.6 to 5.14.7.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.7/packages/mui-icons-material)

---
updated-dependencies:
- dependency-name: "@mui/icons-material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 14:06:30 -04:00
dependabot[bot]
5c546587fc chore(deps): bump @mui/x-date-pickers from 6.12.0 to 6.12.1 (#291) 
Bumps [@mui/x-date-pickers](https://github.com/mui/mui-x/tree/HEAD/packages/x-date-pickers) from 6.12.0 to 6.12.1.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.12.1/packages/x-date-pickers)

---
updated-dependencies:
- dependency-name: "@mui/x-date-pickers"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 14:06:21 -04:00
pre-commit-ci[bot]
e5de0ee31e ci: pre-commit autoupdate [pre-commit.ci] (#298) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.0.286 → v0.0.287](https://github.com/astral-sh/ruff-pre-commit/compare/v0.0.286...v0.0.287)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-04 14:06:05 -04:00
Aaron Pham
956b3a53bc fix(gptq): use upstream integration (#297) 
* wip

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* feat: GPTQ transformers integration

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* fix: only load if variable is available and add changelog

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* chore: remove boilerplate check

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 14:05:50 -04:00
dependabot[bot]
3da869e728 chore(deps): bump crazy-max/ghaction-import-gpg from 5.3.0 to 5.4.0 (#293) 
Bumps [crazy-max/ghaction-import-gpg](https://github.com/crazy-max/ghaction-import-gpg) from 5.3.0 to 5.4.0.
- [Release notes](https://github.com/crazy-max/ghaction-import-gpg/releases)
- [Commits](72b6676b71...d6f3f49f33)

---
updated-dependencies:
- dependency-name: crazy-max/ghaction-import-gpg
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:56:35 -04:00
dependabot[bot]
eb089af0bf chore(deps): bump github/codeql-action from 2.21.4 to 2.21.5 (#292) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.21.4 to 2.21.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](a09933a12a...00e563ead9)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:56:18 -04:00
dependabot[bot]
5675d7cfe8 chore(deps): bump aquasecurity/trivy-action from 559eb1224e654a86c844a795e6702a0742c60c72 to fbd16365eb88e12433951383f5e99bd901fc618f (#294) 
chore(deps): bump aquasecurity/trivy-action

Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 559eb1224e654a86c844a795e6702a0742c60c72 to fbd16365eb88e12433951383f5e99bd901fc618f.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](559eb1224e...fbd16365eb)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:42 -04:00
dependabot[bot]
ad5b826825 chore(deps): bump taiki-e/install-action from 2.17.2 to 2.17.8 (#295) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.17.2 to 2.17.8.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](f0d0def1e2...6801bd56b9)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:25 -04:00
dependabot[bot]
31689a92c7 chore(deps): bump sigstore/cosign-installer from 3.1.1 to 3.1.2 (#296) 
Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.1.1 to 3.1.2.
- [Release notes](https://github.com/sigstore/cosign-installer/releases)
- [Commits](6e04d228eb...11086d2504)

---
updated-dependencies:
- dependency-name: sigstore/cosign-installer
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-04 11:55:13 -04:00
aarnphm-ec2-dev
a981c7104a infra: add blame rev 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 17:01:40 +00:00
aarnphm-ec2-dev
7d893e6cd2 chore: ignore new lines split [skip ci] 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 17:00:49 +00:00
Aaron Pham
608de0b667 fix(serving): vllm distributed size (#285) 
* chore(weights): ignore gguf pattern for non GGML backend

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

* chore: correct fix num_gpus to be divisble by 2

This depends on the attention_heads from given models

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 12:37:10 -04:00
Aaron Pham
b7af7765d4 fix(yapf): align weird new lines break [generated] [skip ci] (#284) 
fix(yapf): align weird new lines break

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 05:34:22 -04:00
Aaron Pham
3e45530abd refactor(breaking): unify LLM API (#283) 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-01 05:15:19 -04:00
Aaron
35601dab20 fix(ci): correct set path for auto UI build 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 15:18:53 -04:00
GutZuFusss
d1c391b5bb fix(clojure): weird characters over model dropdowns on container (#280) 
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 15:17:01 -04:00
Aaron
b4f052eff5 infra: update to google style [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:53:02 -04:00
Aaron
b545ad2ad1 style: google 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:52:35 -04:00
Aaron
e2ba6a92a6 revert: "chore: remove ignore blame" 
This reverts commit 1e70b7314c.
 2023-08-30 13:13:03 -04:00
Aaron
1e70b7314c chore: remove ignore blame 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-08-30 13:11:32 -04:00