mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-03-05 07:36:15 -05:00
Code Issues Packages Projects Releases Wiki Activity
1,267 Commits 6 Branches 194 Tags
f620bd708beb65c751bc0a6683ff68ee0795d00e
Commit Graph

1267 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Pham
f620bd708b infra: bump to dev version of 0.4.33.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 07:49:33 +00:00
Aaron Pham
69deedd9b8 infra: prepare for release 0.4.32 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.32 		2023-11-29 07:39:42 +00:00
Aaron Pham
9706228956 chore(vllm): add arguments for gpu memory utilization 
Probably not going to fix anything, just delaying the problem.

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 06:45:14 +00:00
Aaron Pham
f0fa06004b chore: revert back previous backend support PyTorch (#739) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-29 01:44:41 -05:00
Aaron Pham
0ce7782c2c infra: update blame rev [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 07:05:07 +00:00
Aaron Pham
d04309188b chore(style): 2.7k 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 07:04:27 +00:00
Aaron
ce6efc2a9e chore(style): cleanup bytes 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-28 01:27:27 -05:00
dependabot[bot]
d859cb096d chore(deps): bump github/codeql-action from 2.22.7 to 2.22.8 (#734) 
Bumps [github/codeql-action](https://github.com/github/codeql-action) from 2.22.7 to 2.22.8.
- [Release notes](https://github.com/github/codeql-action/releases)
- [Changelog](https://github.com/github/codeql-action/blob/main/CHANGELOG.md)
- [Commits](66b90a5db1...407ffafae6)

---
updated-dependencies:
- dependency-name: github/codeql-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-27 20:12:43 -05:00
dependabot[bot]
d3ae696b86 chore(deps): bump taiki-e/install-action from 2.21.17 to 2.21.19 (#735) 
Bumps [taiki-e/install-action](https://github.com/taiki-e/install-action) from 2.21.17 to 2.21.19.
- [Release notes](https://github.com/taiki-e/install-action/releases)
- [Changelog](https://github.com/taiki-e/install-action/blob/main/CHANGELOG.md)
- [Commits](ccc14bdc8d...b61491983a)

---
updated-dependencies:
- dependency-name: taiki-e/install-action
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-27 20:12:35 -05:00
Aaron Pham
dd5c072d7e infra: bump to homebrew tap release to 0.4.31 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 23:59:31 +00:00
Aaron Pham
3b111a56af infra: bump to dev version of 0.4.32.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 23:58:31 +00:00
Aaron Pham
77af72ed2a infra: prepare for release 0.4.31 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.31 		2023-11-26 23:49:04 +00:00
Aaron
7bb53a7aa4 fix(client): include ability to getitem for sync client 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 18:48:01 -05:00
Aaron Pham
739eff3d21 fix(docs): remove invalid options (#733) 
fix(langchain): remove invalid options

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 05:04:54 -05:00
Aaron Pham
0417be3899 infra: bump to homebrew tap release to 0.4.30 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 10:04:38 +00:00
Aaron Pham
2811c118b1 infra: bump to dev version of 0.4.31.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 10:03:38 +00:00
Aaron Pham
e157d3aa9e infra: prepare for release 0.4.30 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.30 		2023-11-26 09:54:42 +00:00
Aaron
96318b65ee fix(sdk): remove broken sdk 
codespace now around 2.8k lines

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 04:53:36 -05:00
Aaron Pham
ed6a82a3f0 infra: bump to homebrew tap release to 0.4.29 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 07:59:59 +00:00
Aaron Pham
00fc002e31 infra: bump to dev version of 0.4.30.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 07:59:04 +00:00
Aaron Pham
f7a803dfa2 infra: prepare for release 0.4.29 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.29 		2023-11-26 07:50:48 +00:00
Aaron
43a96dab2c fix(gpus): disable slots for now to enable cached_property 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 02:49:48 -05:00
Aaron
21bf26583d infra: add git-blame-ignore-revs [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 01:46:34 -05:00
Aaron
69aae34cf4 fix(style): reduce boilerplate and format to custom logics 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-26 01:44:59 -05:00
Aaron Pham
b4ea4b3e99 infra: bump to homebrew tap release to 0.4.28 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 07:21:13 +00:00
Aaron Pham
753b49c647 infra: bump to dev version of 0.4.29.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 07:20:18 +00:00
Aaron Pham
e27764fe6b infra: prepare for release 0.4.28 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.28 		2023-11-24 07:09:06 +00:00
MingLiangDai
7b8d9024c4 fix(baichuan): supported from baichuan 2 from now on. (#728) 
* config support multiple architectures

* chore: only support baichuan2 from now on

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update notes

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: run script [skip ci]

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 02:07:06 -05:00
Aaron
39ecc73a50 infra: bump to dev version of 0.4.28.dev0 [generated] [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:54:46 -05:00
Aaron Pham
d8a783772d infra: prepare for release 0.4.27 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.27 		2023-11-24 06:25:16 +00:00
Aaron
b4c9971678 fix(build): explicitly not lock packages 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:21:29 -05:00
Aaron
d0e12b1fb8 fix(metadata): remove unused packages 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:19:09 -05:00
Aaron
7dd4e3ac4b fix(build): don't lock packages for now, but do lock base requirements 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:17:45 -05:00
Aaron
7beaa92c2b fix(types): using correct refactored literal 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:14:29 -05:00
Aaron Pham
aab173cd99 refactor: focus (#730) 
* perf: remove based images

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: update changelog

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: move dockerifle to run on release only

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: cleanup unused types

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-24 01:11:31 -05:00
Aaron Pham
52a44b1bfa chore: cleanup loader (#729) 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 21:51:51 -05:00
Aaron Pham
5442d9cd10 fix(trust_remote_code): handle args correctly (#727) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 17:03:13 -05:00
Aaron Pham
79c9608735 infra: reduce wait time to around 7 mins (#726) 
Seems like the release process for PyPI usually takes from 4-7 minutes

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 07:28:36 -05:00
Aaron Pham
831bb8c497 infra: bump to homebrew tap release to 0.4.26 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 11:59:36 +00:00
Aaron Pham
80842ad501 infra: bump to dev version of 0.4.27.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 11:58:42 +00:00
Aaron Pham
7eae50377d infra: prepare for release 0.4.26 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.26 		2023-11-22 11:50:50 +00:00
Aaron Pham
b28b5269b5 feat(openai): chat templates and complete control of prompt generation (#725) 
* feat(openai): chat templates and complete control of prompt generation

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* fix: correctly use base chat templates

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

* fix: remove symlink

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 06:49:14 -05:00
Aaron Pham
7aa0918a6f fix(client): correct schemas parser from correct response output (#724) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 05:01:35 -05:00
Aaron Pham
f83f64ffd7 fix(infra): setup higher timer for building container images (#723) 
* fix(infra): setup higher timer for building container images

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

* chore: remove invalid tests

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 05:00:33 -05:00
Aaron Pham
6dd07580e2 infra: bump to homebrew tap release to 0.4.25 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 09:35:41 +00:00
Aaron Pham
1876609a67 infra: bump to dev version of 0.4.26.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 09:34:22 +00:00
Aaron Pham
0189342730 infra: prepare for release 0.4.25 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
v0.4.25 		2023-11-22 09:22:45 +00:00
Aaron Pham
63d86faa32 fix(openai): correct stop tokens and finish_reason state (#722) 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 04:21:13 -05:00
Aaron Pham
06626e7d1e infra: bump to homebrew tap release to 0.4.24 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 06:51:39 +00:00
Aaron Pham
c9b23638a5 infra: bump to dev version of 0.4.25.dev0 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-11-22 06:50:35 +00:00