mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-03-09 02:32:51 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,018 Commits 6 Branches 194 Tags
387637405daa231b40eaeddc7faac942cbcb9b4e
Commit Graph

1018 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Pham
387637405d fix(gptq): update config fields (#585) 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 05:20:30 -05:00
Aaron Pham
85a7243ac3 fix: device imports using strategies (#584) 
* fix: device imports using strategies

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* chore: support trust_remote_code for vLLM runners

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 05:10:50 -05:00
Aaron
6d81fbbccd fix(infra): add coverage config 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 04:08:08 -05:00
dependabot[bot]
35661d7c8c chore(deps): bump sigstore/cosign-installer from 3.1.2 to 3.2.0 (#582) 
Bumps [sigstore/cosign-installer](https://github.com/sigstore/cosign-installer) from 3.1.2 to 3.2.0.
- [Release notes](https://github.com/sigstore/cosign-installer/releases)
- [Commits](11086d2504...1fc5bd396d)

---
updated-dependencies:
- dependency-name: sigstore/cosign-installer
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-08 02:59:49 -05:00
dependabot[bot]
0d76a4c935 chore(deps): bump taiki-e/install-action from 2.21.7 to 2.21.8 (#581) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.7 to 2.21.8.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](11dea51b35...b4f94d4449)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-08 02:59:34 -05:00
dependabot[bot]
0e1ed391e4 chore(deps): bump aquasecurity/trivy-action from 0.13.1 to 0.14.0 (#583) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.13.1 to 0.14.0.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](f78e9ecf42...2b6a709cf9)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-08 02:59:26 -05:00
Aaron Pham
c90d510589 infra: disable npm updates and correct python packages (#580) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 02:58:05 -05:00
Aaron Pham
ea42108e45 chore(service): cleanup API (#579) 
* chore(service): cleanup API

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: running tools

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* fix: tests import

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 02:53:08 -05:00
Aaron Pham
7398ae0486 refactor(strategies): move logics into openllm-python (#578) 
fix(strategies): move to openllm

Strategies shouldn't be a part of openllm-core

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 02:23:08 -05:00
Aaron Pham
7f46aa3475 fix(stubs): update initialisation types (#577) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 01:30:46 -05:00
Aaron Pham
97d7c38fea refactor: cleanup typing to expose correct API (#576) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-08 01:24:03 -05:00
Aaron Pham
c40d4c1016 fix(examples): correct dependencies in requirements.txt [skip ci] (#575) 
Update requirements.txt

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 23:02:53 -05:00
Aaron Pham
30d8981916 chore(openai): simplify client examples (#574) 
* chore(openai): simplify client examples

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* chore: fix spacing

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 23:01:14 -05:00
Aaron Pham
cfd09bfc47 chore(runner): yield the outputs directly (#573) 
update openai client examples to >1

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-11-07 22:34:11 -05:00
Aaron Pham
b3c4e204b2 infra: bump to homebrew tap release to 0.4.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 22:55:47 +00:00
Aaron Pham
1d5a8d021f infra: bump to dev version of 0.4.1.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 22:53:55 +00:00
Aaron Pham
8ffab93d39 infra: prepare for release 0.4.0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.0 		2023-11-07 22:42:22 +00:00
Aaron Pham
4d356f4b72 feat: Mistral support (#571) 
* feat: Mistral support

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

* chore: fix style

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update README docs about mistral

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-11-07 17:28:02 -05:00
Aaron Pham
d9a7b6a147 fix(client): one-shot generation construction (#570) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 17:14:39 -05:00
Aaron Pham
272b185ee7 chore(examples): update openai client (#568) 
chore: update openai client examples

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 16:42:32 -05:00
Aaron Pham
dc27b0e727 fix: update build dependencies and format chat prompt (#569) 
chore: update correct check and format prompt

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-07 16:42:20 -05:00
Aaron Pham
8fade070f3 infra: update docs on serving fine-tuning layers (#567) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 21:34:44 -05:00
Aaron
b158609e95 docs: update BentoML integration 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 20:57:51 -05:00
Aaron
4550b2548b docs: update readme for HF agent 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 20:55:10 -05:00
Aaron
8aca432df5 chore(examples): add logprobs check on PyTorch 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 20:52:49 -05:00
Aaron Pham
2287173c47 fix(openai): stop is not available in config (#566) 
This is now inference arguments, instead of config

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 20:47:50 -05:00
Aaron Pham
e2029c934b perf: unify LLM interface (#518) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-11-06 20:39:43 -05:00
Abhishek
f2639879af feat: support toggle TLS verification (#532) 
Signed-off-by: Abhishek <59995387+ABHISHEK03312@users.noreply.github.com>
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: abhishek <abhishek_vaidyanathan@ensigninfosecurity.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
Co-authored-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-06 13:34:53 -05:00
dependabot[bot]
b4bf5a35e6 chore(deps-dev): bump @typescript-eslint/eslint-plugin from 6.9.0 to 6.10.0 (#564) 
chore(deps-dev): bump @typescript-eslint/eslint-plugin

Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 6.9.0 to 6.10.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v6.10.0/packages/eslint-plugin)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/eslint-plugin"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:19:52 -05:00
dependabot[bot]
b84a2753c7 chore(deps-dev): bump @types/react from 18.2.20 to 18.2.35 (#559) 
Bumps [@types/react](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react) from 18.2.20 to 18.2.35.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react)

---
updated-dependencies:
- dependency-name: "@types/react"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:17:44 -05:00
dependabot[bot]
28b4166f37 chore(deps): bump @vercel/og from 0.5.18 to 0.5.20 (#556) 
Bumps @vercel/og from 0.5.18 to 0.5.20.

---
updated-dependencies:
- dependency-name: "@vercel/og"
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:17:25 -05:00
dependabot[bot]
0bfa4930e4 chore(deps-dev): bump eslint from 8.47.0 to 8.53.0 (#558) 
Bumps [eslint](https://github.com/eslint/eslint) from 8.47.0 to 8.53.0.
- [Release notes](https://github.com/eslint/eslint/releases)
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md)
- [Commits](https://github.com/eslint/eslint/compare/v8.47.0...v8.53.0)

---
updated-dependencies:
- dependency-name: eslint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:17:13 -05:00
dependabot[bot]
dc5c3a1f16 chore(deps): bump taiki-e/install-action from 2.21.3 to 2.21.7 (#561) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.3 to 2.21.7.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](285bd10d1c...11dea51b35)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:17:02 -05:00
dependabot[bot]
711f6fed8e chore(deps): bump aquasecurity/trivy-action from 0.13.0 to 0.13.1 (#562) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.13.0 to 0.13.1.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](b77b85c025...f78e9ecf42)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-06 13:16:54 -05:00
pre-commit-ci[bot]
141007af68 ci: pre-commit autoupdate [pre-commit.ci] (#563) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.1.3 → v0.1.4](https://github.com/astral-sh/ruff-pre-commit/compare/v0.1.3...v0.1.4)
- [github.com/pre-commit/mirrors-eslint: v8.52.0 → v8.53.0](https://github.com/pre-commit/mirrors-eslint/compare/v8.52.0...v8.53.0)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-11-06 13:16:45 -05:00
Aaron Pham
ae20480589 infra: bump to homebrew tap release to 0.3.14 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-04 09:17:09 +00:00
Aaron Pham
a326d2b190 infra: bump to dev version of 0.3.15.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-04 09:16:13 +00:00
Aaron Pham
729d47a86c infra: prepare for release 0.3.14 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.3.14 		2023-11-04 09:05:08 +00:00
Aaron Pham
72c6005d3b chore(inference): update vllm to 0.2.1.post1 and update config parsing (#554) 
chore(dependencies): update vllm to 0.2.1.post1 and update config
parsing
 2023-11-04 04:01:56 -04:00
XunchaoZ
440e3d646f fix: Max new tokens (#550) 
Bug fix for retrieving user input max_new_tokens
 2023-11-03 13:44:25 -04:00
dependabot[bot]
84ac2dd485 chore(deps-dev): bump eslint from 8.47.0 to 8.52.0 (#541) 
Bumps [eslint](https://github.com/eslint/eslint) from 8.47.0 to 8.52.0.
- [Release notes](https://github.com/eslint/eslint/releases)
- [Changelog](https://github.com/eslint/eslint/blob/main/CHANGELOG.md)
- [Commits](https://github.com/eslint/eslint/compare/v8.47.0...v8.52.0)

---
updated-dependencies:
- dependency-name: eslint
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-01 17:43:08 -04:00
dependabot[bot]
2b8eb17ec0 chore(deps-dev): bump @edge-runtime/vm from 3.1.4 to 3.1.6 (#540) 
Bumps [@edge-runtime/vm](https://github.com/vercel/edge-runtime/tree/HEAD/packages/vm) from 3.1.4 to 3.1.6.
- [Release notes](https://github.com/vercel/edge-runtime/releases)
- [Changelog](https://github.com/vercel/edge-runtime/blob/main/packages/vm/CHANGELOG.md)
- [Commits](https://github.com/vercel/edge-runtime/commits/@edge-runtime/vm@3.1.6/packages/vm)

---
updated-dependencies:
- dependency-name: "@edge-runtime/vm"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-01 17:42:56 -04:00
dependabot[bot]
ea96adc7ec chore(deps-dev): bump @typescript-eslint/eslint-plugin from 6.8.0 to 6.9.0 (#537) 
chore(deps-dev): bump @typescript-eslint/eslint-plugin

Bumps [@typescript-eslint/eslint-plugin](https://github.com/typescript-eslint/typescript-eslint/tree/HEAD/packages/eslint-plugin) from 6.8.0 to 6.9.0.
- [Release notes](https://github.com/typescript-eslint/typescript-eslint/releases)
- [Changelog](https://github.com/typescript-eslint/typescript-eslint/blob/main/packages/eslint-plugin/CHANGELOG.md)
- [Commits](https://github.com/typescript-eslint/typescript-eslint/commits/v6.9.0/packages/eslint-plugin)

---
updated-dependencies:
- dependency-name: "@typescript-eslint/eslint-plugin"
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-31 07:24:40 -04:00
dependabot[bot]
071b6c73f0 chore(deps-dev): bump @types/react from 18.2.20 to 18.2.33 (#542) 
Bumps [@types/react](https://github.com/DefinitelyTyped/DefinitelyTyped/tree/HEAD/types/react) from 18.2.20 to 18.2.33.
- [Release notes](https://github.com/DefinitelyTyped/DefinitelyTyped/releases)
- [Commits](https://github.com/DefinitelyTyped/DefinitelyTyped/commits/HEAD/types/react)

---
updated-dependencies:
- dependency-name: "@types/react"
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-31 07:23:36 -04:00
xianxian.zhang
e1e365ddc1 fix: update llama2 notebook example (#516) 
* fix: update llama2 notebook example

* fix: signing commit test
 2023-10-31 15:41:43 +08:00
dependabot[bot]
d806add09f chore(deps): bump github/codeql-action from 2.22.4 to 2.22.5 (#544) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.22.4 to 2.22.5.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](49abf0ba24...74483a38d3)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-31 02:17:08 -04:00
dependabot[bot]
6d136bf90e chore(deps): bump aquasecurity/trivy-action from 0.12.0 to 0.13.0 (#545) 
Bumps [aquasecurity/trivy-action](https://github.com/aquasecurity/trivy-action) from 0.12.0 to 0.13.0.
- [Release notes](https://github.com/aquasecurity/trivy-action/releases)
- [Commits](fbd16365eb...b77b85c025)

---
updated-dependencies:
- dependency-name: aquasecurity/trivy-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-31 02:16:57 -04:00
pre-commit-ci[bot]
b59975035c ci: pre-commit autoupdate [pre-commit.ci] (#548) 
updates:
- [github.com/astral-sh/ruff-pre-commit: v0.1.1 → v0.1.3](https://github.com/astral-sh/ruff-pre-commit/compare/v0.1.1...v0.1.3)

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-10-31 02:16:43 -04:00
dependabot[bot]
b1bf3d71ce chore(deps): bump taiki-e/install-action from 2.20.15 to 2.21.3 (#546) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.20.15 to 2.21.3.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](212ce016f0...285bd10d1c)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-10-31 02:16:34 -04:00
Aaron Pham
c810467664 infra: bump to homebrew tap release to 0.3.13 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-10-31 05:38:46 +00:00