mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-01-04 05:29:17 -05:00
Code Issues Packages Projects Releases Wiki Activity
1,478 Commits 4 Branches 194 Tags
5cb5203eea6323bee3eca9bda96d70868fdc8616
Commit Graph

321 Commits

Author SHA1 Message Date
Aaron Pham
5cb5203eea infra: prepare for release 0.5.0-alpha.13 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-22 15:17:25 +00:00
paperspace
b7193511e6 fix: correct update default value for dict unpacking 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-22 15:15:23 +00:00
Aaron Pham
f97f5108c4 infra: prepare for release 0.5.0-alpha.12 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-14 06:44:07 +00:00
paperspace
e9246e7772 fix: make sure to only update fields when correct type is parse 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-14 06:42:46 +00:00
Aaron Pham
d5447240ef infra: prepare for release 0.5.0-alpha.11 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-12 04:22:35 +00:00
paperspace
806308eed6 fix: one-shot generation not to concatenate duplicates 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-12 04:21:06 +00:00
paperspace
1d2e554a94 chore: disable progressbar for cleaner log trace 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-10 03:11:47 +00:00
Aaron Pham
a335312ce2 infra: prepare for release 0.5.0-alpha.10 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 22:37:31 +00:00
paperspace
9a961d9070 perf(build): improve preheating layers for caching dependencies 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 22:34:39 +00:00
Aaron Pham
03610d652d infra: prepare for release 0.5.0-alpha.9 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 21:16:45 +00:00
paperspace
8e82bd9600 chore: update streaming logics to respect cursor 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 21:13:28 +00:00
paperspace
dd79779e0e fix: update generate_stream to yield delta based on given index 
generation

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 20:18:00 +00:00
Aaron Pham
642cf6aaf2 infra: prepare for release 0.5.0-alpha.8 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 01:38:22 +00:00
paperspace
c9f8dbc767 feat: set options for 'gpu' for building recommendation 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 01:37:29 +00:00
Aaron Pham
5e444381bb infra: prepare for release 0.5.0-alpha.7 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 01:18:05 +00:00
paperspace
852b82d25b fix: make sure to export correct json config 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 01:14:12 +00:00
Aaron Pham
de5e01cb47 infra: prepare for release 0.5.0-alpha.6 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 00:08:18 +00:00
paperspace
6726f6ae3e fix: make sure to add cpu to number 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-09 00:06:10 +00:00
Aaron Pham
d02f267fc7 infra: prepare for release 0.5.0-alpha.5 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-08 23:37:42 +00:00
Aaron Pham
0a1bcacbc4 infra: prepare for release 0.5.0-alpha.4 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-05-08 23:22:33 +00:00
paperspace
526a770a06 chore: update base requirements to 0.4.2 
Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-05-08 18:46:13 +00:00
Aaron Pham
42417dbdbf fix: make sure to respect additional parameters parse (#981) 2024-05-08 13:53:56 -04:00
Aaron Pham
43b635fbfd fix: update correct CompletionOutput object (#973) 
* fix: update correct CompletionOutput object

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

* fix: revert to correct version

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>

---------

Signed-off-by: paperspace <29749331+aarnphm@users.noreply.github.com>
 2024-04-30 15:06:46 -04:00
Aaron
66de54eae7 chore: update default params as pydantic fields 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-04-03 15:50:37 -04:00
Aaron Pham
135503017d infra: prepare for release 0.5.0-alpha.3 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 04:36:56 +00:00
Aaron Pham
32f4dff83b fix: explicitly pass only non-null value 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 04:35:47 +00:00
Aaron Pham
1d817a7e01 fix: add support for min_tokens 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 04:22:14 +00:00
Aaron Pham
5c0d2787c0 feat: add dbrx support 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 04:10:19 +00:00
Aaron Pham
e9e6434012 infra: prepare for release 0.5.0-alpha.2 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 03:49:09 +00:00
Aaron Pham
4661838964 chore: move out the template to separate files 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-04-02 03:24:26 +00:00
Aaron Pham
67ab9b5762 fix: swagger showing for subpath 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-22 02:24:22 +00:00
Aaron Pham
3ef93fe371 chore: update support development_mode as DEBUG and support for RELOAD 
envvar

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-22 01:19:32 +00:00
Aaron Pham
80b35f0d72 revert: correct type for openapi schema generation 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-21 07:51:00 +00:00
Aaron Pham
51bec78ee9 fix(load): make sure to respect MAX_MODEL_LEN from env 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-21 07:44:49 +00:00
Aaron
295a3b1061 chore(codegen): update generated var to read from envvar 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-20 21:51:39 -04:00
Aaron Pham
12ac99867f infra: prepare for release 0.5.0-alpha.1 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-21 01:37:56 +00:00
Aaron Pham
f0ab6d44fa fix: make sure to include new implementation in bundle build 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-20 22:11:53 +00:00
Aaron
5c8c30a70b fix: uses --pre for alpha releases for now 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-20 13:38:10 -04:00
Aaron
2ddbe4eb22 fix(service): remove mounting ASGI app 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-20 11:51:09 -04:00
Aaron Pham
824ff68818 chore: update local script and update service 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-15 20:29:49 +00:00
Aaron
727361ced7 chore: running updated ruff formatter [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-15 05:35:24 -04:00
Aaron
c34db550a6 fix(build): explicit set to use alpha version 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-15 05:33:18 -04:00
Aaron
0274fb4c11 fix: don't lock openllm to support alpha release 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2024-03-15 05:29:35 -04:00
Aaron Pham
58c741c5aa infra: prepare for release 0.5.0-alpha [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-03-15 08:46:18 +00:00
Aaron Pham
072b3e97ec feat: 1.2 APIs (#821) 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-03-15 03:49:19 -04:00
Aaron
e3392476be revert: "ci: pre-commit autoupdate [pre-commit.ci] (#931)" 
This reverts commit 7b00c84c2a.
 2024-03-15 03:47:23 -04:00
pre-commit-ci[bot]
7b00c84c2a ci: pre-commit autoupdate [pre-commit.ci] (#931) 
* ci: pre-commit autoupdate [pre-commit.ci]

updates:
- [github.com/astral-sh/ruff-pre-commit: v0.2.2 → v0.3.2](https://github.com/astral-sh/ruff-pre-commit/compare/v0.2.2...v0.3.2)
- [github.com/pre-commit/mirrors-eslint: v9.0.0-beta.0 → v9.0.0-beta.2](https://github.com/pre-commit/mirrors-eslint/compare/v9.0.0-beta.0...v9.0.0-beta.2)

* ci: auto fixes from pre-commit.ci

For more information, see https://pre-commit.ci

---------

Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2024-03-15 03:46:28 -04:00
Aaron Pham
1b54d64eb0 infra: prepare for release 0.4.44 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-02-06 03:07:09 +00:00
Zhao Shenyang
3299f463a6 fix: remove vllm dependency for pytorch bento (#893) 2024-02-05 18:36:14 -05:00
Aaron Pham
fe44c843ec infra: prepare for release 0.4.43 [generated] [skip ci] 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2024-02-05 10:48:05 +00:00