mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-06-12 10:29:36 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,058 Commits 6 Branches 194 Tags
e0632a85ede6205621561ba6f4115ee4fa5e76ce
Commit Graph

1058 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
dependabot[bot]
b21df86c10 chore(deps-dev): bump prettier from 3.0.2 to 3.0.3 (#338) 
Bumps [prettier](https://github.com/prettier/prettier) from 3.0.2 to 3.0.3.
- [Release notes](https://github.com/prettier/prettier/releases)
- [Changelog](https://github.com/prettier/prettier/blob/main/CHANGELOG.md)
- [Commits](https://github.com/prettier/prettier/compare/3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: prettier
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 17:06:13 -04:00
dependabot[bot]
ace4e1b6ce chore(deps): bump @tailwindcss/forms from 0.5.3 to 0.5.6 (#332) 
Bumps [@tailwindcss/forms](https://github.com/tailwindlabs/tailwindcss-forms) from 0.5.3 to 0.5.6.
- [Release notes](https://github.com/tailwindlabs/tailwindcss-forms/releases)
- [Changelog](https://github.com/tailwindlabs/tailwindcss-forms/blob/master/CHANGELOG.md)
- [Commits](https://github.com/tailwindlabs/tailwindcss-forms/compare/v0.5.3...v0.5.6)

---
updated-dependencies:
- dependency-name: "@tailwindcss/forms"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 16:19:39 -04:00
dependabot[bot]
77da6e619c chore(deps-dev): bump turbo from 1.10.12 to 1.10.13 (#344) 
Bumps [turbo](https://github.com/vercel/turbo) from 1.10.12 to 1.10.13.
- [Release notes](https://github.com/vercel/turbo/releases)
- [Changelog](https://github.com/vercel/turbo/blob/main/release.md)
- [Commits](https://github.com/vercel/turbo/compare/v1.10.12...v1.10.13)

---
updated-dependencies:
- dependency-name: turbo
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 16:19:18 -04:00
dependabot[bot]
662e5cfc12 chore(deps): bump nextra-theme-docs from 2.11.1 to 2.12.3 (#345) 
Bumps [nextra-theme-docs](https://github.com/shuding/nextra) from 2.11.1 to 2.12.3.
- [Release notes](https://github.com/shuding/nextra/releases)
- [Commits](https://github.com/shuding/nextra/compare/nextra-theme-docs@2.11.1...nextra-theme-docs@2.12.3)

---
updated-dependencies:
- dependency-name: nextra-theme-docs
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 16:16:35 -04:00
dependabot[bot]
dcc1c0f42f chore(deps): bump @mui/icons-material from 5.14.7 to 5.14.8 (#346) 
Bumps [@mui/icons-material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-icons-material) from 5.14.7 to 5.14.8.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.8/packages/mui-icons-material)

---
updated-dependencies:
- dependency-name: "@mui/icons-material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 16:16:18 -04:00
Aaron
c6c23bc959 fix(actions): hermetic dependencies 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-12 13:44:18 -04:00
dependabot[bot]
04e479d35f chore(deps): bump docker/setup-qemu-action from 2.2.0 to 3.0.0 (#328) 
Bumps [docker/setup-qemu-action](https://github.com/docker/setup-qemu-action) from 2.2.0 to 3.0.0.
- [Release notes](https://github.com/docker/setup-qemu-action/releases)
- [Commits](2b82ce82d5...68827325e0)

---
updated-dependencies:
- dependency-name: docker/setup-qemu-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:26:53 -04:00
dependabot[bot]
e3466ff908 chore(deps): bump docker/setup-buildx-action from 2.10.0 to 3.0.0 (#329) 
Bumps [docker/setup-buildx-action](https://github.com/docker/setup-buildx-action) from 2.10.0 to 3.0.0.
- [Release notes](https://github.com/docker/setup-buildx-action/releases)
- [Commits](885d1462b8...f95db51fdd)

---
updated-dependencies:
- dependency-name: docker/setup-buildx-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:26:32 -04:00
dependabot[bot]
6c5baa04ab chore(deps): bump docker/metadata-action from 4.6.0 to 5.0.0 (#330) 
Bumps [docker/metadata-action](https://github.com/docker/metadata-action) from 4.6.0 to 5.0.0.
- [Release notes](https://github.com/docker/metadata-action/releases)
- [Upgrade guide](https://github.com/docker/metadata-action/blob/master/UPGRADE.md)
- [Commits](818d4b7b91...96383f4557)

---
updated-dependencies:
- dependency-name: docker/metadata-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:26:12 -04:00
dependabot[bot]
f46eefc215 chore(deps): bump docker/login-action from 2.2.0 to 3.0.0 (#331) 
Bumps [docker/login-action](https://github.com/docker/login-action) from 2.2.0 to 3.0.0.
- [Release notes](https://github.com/docker/login-action/releases)
- [Commits](465a07811f...343f7c4344)

---
updated-dependencies:
- dependency-name: docker/login-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:24:33 -04:00
dependabot[bot]
4dfc9320a4 chore(deps): bump docker/build-push-action from 4.2.1 to 5.0.0 (#327) 
Bumps [docker/build-push-action](https://github.com/docker/build-push-action) from 4.2.1 to 5.0.0.
- [Release notes](https://github.com/docker/build-push-action/releases)
- [Commits](0a97817b6a...0565240e2d)

---
updated-dependencies:
- dependency-name: docker/build-push-action
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:23:40 -04:00
Aaron
797b98370b chore(infra): increase max number of PR [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-12 13:21:39 -04:00
dependabot[bot]
83156f3fb9 chore(deps): bump @mui/x-date-pickers from 6.12.1 to 6.13.0 (#314) 
Bumps [@mui/x-date-pickers](https://github.com/mui/mui-x/tree/HEAD/packages/x-date-pickers) from 6.12.1 to 6.13.0.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.13.0/packages/x-date-pickers)

---
updated-dependencies:
- dependency-name: "@mui/x-date-pickers"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:19:42 -04:00
dependabot[bot]
f1b8c8bf3a chore(deps): bump @mui/x-data-grid from 6.12.1 to 6.13.0 (#317) 
Bumps [@mui/x-data-grid](https://github.com/mui/mui-x/tree/HEAD/packages/grid/x-data-grid) from 6.12.1 to 6.13.0.
- [Release notes](https://github.com/mui/mui-x/releases)
- [Changelog](https://github.com/mui/mui-x/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/mui-x/commits/v6.13.0/packages/grid/x-data-grid)

---
updated-dependencies:
- dependency-name: "@mui/x-data-grid"
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:16:17 -04:00
dependabot[bot]
c2c53640e8 chore(deps): bump @mui/material from 5.14.7 to 5.14.8 (#315) 
Bumps [@mui/material](https://github.com/mui/material-ui/tree/HEAD/packages/mui-material) from 5.14.7 to 5.14.8.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/v5.14.8/packages/mui-material)

---
updated-dependencies:
- dependency-name: "@mui/material"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 13:16:00 -04:00
Alan Poulain
88d7ba7ca8 fix(vllm): Make sure to use max number of GPUs available (#326) 
* fix(serving): vllm bad num_gpus

Signed-off-by: Alan Poulain <contact@alanpoulain.eu>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

---------

Signed-off-by: Alan Poulain <contact@alanpoulain.eu>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-12 12:45:00 -04:00
Aaron Pham
fddd0bf95e feat: bootstrap documentation site (#252) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: GutZuFusss <leon.ikinger@googlemail.com>
Co-authored-by: GutZuFusss <leon.ikinger@googlemail.com>
 2023-09-12 12:28:29 -04:00
Aaron
7d128b8959 fix(cron): make sure to use correct PAT with workflow permisision 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-12 12:13:06 -04:00
dependabot[bot]
9b5d6b2281 chore(deps): bump @mui/base from 5.0.0-beta.13 to 5.0.0-beta.14 (#318) 
Bumps [@mui/base](https://github.com/mui/material-ui/tree/HEAD/packages/mui-base) from 5.0.0-beta.13 to 5.0.0-beta.14.
- [Release notes](https://github.com/mui/material-ui/releases)
- [Changelog](https://github.com/mui/material-ui/blob/master/CHANGELOG.md)
- [Commits](https://github.com/mui/material-ui/commits/HEAD/packages/mui-base)

---
updated-dependencies:
- dependency-name: "@mui/base"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-12 12:04:12 -04:00
dependabot[bot]
9e267ff0a6 chore(deps-dev): bump shadow-cljs from 2.25.3 to 2.25.4 (#316) 
Bumps [shadow-cljs](https://github.com/thheller/shadow-cljs) from 2.25.3 to 2.25.4.
- [Changelog](https://github.com/thheller/shadow-cljs/blob/master/CHANGELOG.md)
- [Commits](https://github.com/thheller/shadow-cljs/commits)

---
updated-dependencies:
- dependency-name: shadow-cljs
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-11 15:41:11 -04:00
dependabot[bot]
50dac70d7a chore(deps): bump aws-actions/configure-aws-credentials from 3.0.1 to 3.0.2 (#319) 
chore(deps): bump aws-actions/configure-aws-credentials

Bumps [aws-actions/configure-aws-credentials](https://github.com/aws-actions/configure-aws-credentials) from 3.0.1 to 3.0.2.
- [Release notes](https://github.com/aws-actions/configure-aws-credentials/releases)
- [Changelog](https://github.com/aws-actions/configure-aws-credentials/blob/main/CHANGELOG.md)
- [Commits](04b98b3f9e...50ac8dd1e1)

---
updated-dependencies:
- dependency-name: aws-actions/configure-aws-credentials
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-11 15:40:55 -04:00
Aaron
70f4ccfae6 fix(ratchet): lock correctly on cron job 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-11 15:09:49 -04:00
dependabot[bot]
2a1bcb6dc2 chore(deps): bump actions/checkout from 3.6.0 to 4.0.0 (#322) 
Bumps [actions/checkout](https://github.com/actions/checkout) from 3.6.0 to 4.0.0.
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](f43a0e5ff2...3df4ab11eb)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-11 14:35:10 -04:00
dependabot[bot]
9306755731 chore(deps): bump crazy-max/ghaction-import-gpg from 5.4.0 to 6.0.0 (#323) 
Bumps [crazy-max/ghaction-import-gpg](https://github.com/crazy-max/ghaction-import-gpg) from 5.4.0 to 6.0.0.
- [Release notes](https://github.com/crazy-max/ghaction-import-gpg/releases)
- [Commits](d6f3f49f33...82a020f1f7)

---
updated-dependencies:
- dependency-name: crazy-max/ghaction-import-gpg
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-09-11 14:32:14 -04:00
pre-commit-ci[bot]
be46683490 ci: pre-commit autoupdate [pre-commit.ci] (#325) 
updates:
- [github.com/RobertCraigie/pyright-python: v1.1.324 → v1.1.326](https://github.com/RobertCraigie/pyright-python/compare/v1.1.324...v1.1.326)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-09-11 14:31:45 -04:00
aarnphm-ec2-dev
2e1b51422f fix(embeddings): update to the latest API name 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 18:31:50 +00:00
aarnphm-ec2-dev
bbc6abe904 fix(ci): make sure to lock build to 0.10 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 17:48:16 +00:00
aarnphm-ec2-dev
c7f915fa71 chore: update documentation wrt to envvar correctness 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 17:43:03 +00:00
aarnphm-ec2-dev
f917898867 chore: update langchain examples 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-08 03:35:10 +00:00
aarnphm-ec2-dev
8530a067ea chore(serialisation): dump quantization_config.json to conform with 
optimum load

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 16:50:50 +00:00
Sherlock Xu
6b6cf7a9cb dos: correct typo on headline (#305) 
fix typo

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
 2023-09-07 10:35:12 -04:00
Aaron
0d50aa00b9 chore: add openllm-core as meta dependencies 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 10:31:40 -04:00
Aaron Pham
c690bcf31d infra: bump to homebrew tap release to 0.3.3 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 02:05:16 +00:00
Aaron Pham
098a6f3349 infra: bump to dev version of 0.3.4.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 02:03:52 +00:00
Aaron Pham
7e2c8428bb infra: prepare for release 0.3.3 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.3 		2023-09-07 01:51:18 +00:00
aarnphm-ec2-dev
8173cb09a5 fix(quantize): dyn quant for int8 and int4 
only set tokenizer when it is gptq

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-07 01:48:45 +00:00
Aaron Pham
dd120d8516 infra: bump to homebrew tap release to 0.3.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 19:15:50 +00:00
Aaron Pham
9cf8422d26 infra: bump to dev version of 0.3.3.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 19:14:27 +00:00
Aaron Pham
fd18c8be01 infra: prepare for release 0.3.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.2 		2023-09-06 19:03:40 +00:00
Aaron
675b372981 fix: synchronize device for inference 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 14:08:52 -04:00
Aaron Pham
030a861a08 infra: bump to homebrew tap release to 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:03:04 +00:00
Aaron Pham
b281cb6466 infra: bump to dev version of 0.3.2.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 18:01:30 +00:00
Aaron Pham
b61005424b infra: prepare for release 0.3.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.1 		2023-09-06 17:49:58 +00:00
Aaron Pham
52e04dc982 revert: disable compiled wheels for now (#304) 
* revert: disable compiled wheels for now

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: add changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: compiled

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: ignore pyright

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-06 13:44:41 -04:00
Aaron
887ffa9aa0 chore: cleanup pre-commit jobs and update usage 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 10:06:36 -04:00
Sherlock Xu
c59b3a03b5 docs: cleanup README.md landing page (#302) 
* Update the readme

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

* fix type

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>

* Update README.md

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Sherlock113 <sherlockxu07@gmail.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 07:51:40 -04:00
aarnphm-ec2-dev
f43c721579 chore: only add bentomodel branch during generated service with 
OpenLLM

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-09-05 01:08:23 +00:00
Aaron Pham
3818bfefaf infra: bump to homebrew tap release to 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:18:46 +00:00
Aaron Pham
e68c9c5e4d infra: bump to dev version of 0.3.1.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-09-04 20:15:42 +00:00
Aaron Pham
06a68ade7d infra: prepare for release 0.3.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.0 		2023-09-04 19:03:41 +00:00