mirror/OpenLLM
1
0
Fork 0
mirror of https://github.com/bentoml/OpenLLM.git synced 2026-04-26 10:01:30 -04:00
Code Issues Packages Projects Releases Wiki Activity
329 Commits 6 Branches 194 Tags
e69d3f9ca0eebdfe86f8a32e1bb18ac20fee7651
Commit Graph

329 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Aaron Pham
e69d3f9ca0 chore: update bug-report 
Kindly ask user to provide their system information

Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-06-20 21:49:35 -04:00
Ikko Eltociear Ashimine
9c6b43b163 docs: rename camel case to official Hugging Face name (#39) 2023-06-20 12:02:03 -04:00
aarnphm-ec2-dev
d33149d758 fix(log): repr the given LLMConfig in debug mode 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 18:20:18 +00:00
Aaron Pham
ca802d9d1a fix: agent log (#37) 2023-06-19 14:11:39 -04:00
Aaron Pham [bot]
78a537079e infra: bump to dev version of 0.1.9.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 18:08:32 +00:00
aarnphm-ec2-dev
70c7c0a9b7 fix(cli): use correct API for client 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 18:04:27 +00:00
Aaron Pham [bot]
6bbbefd06a infra: prepare for release 0.1.8 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.8 		2023-06-19 18:02:08 +00:00
aarnphm-ec2-dev
6d43bdbcdb fix(instruct): remove breakpoint 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 18:00:00 +00:00
Aaron
9139e6f290 docs: update README to use OPT as example 
This helps with system with lower memory and RAM

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 13:40:10 -04:00
Aaron Pham [bot]
0e3f8d2fba infra: bump to dev version of 0.1.8.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 17:30:50 +00:00
Aaron Pham [bot]
9a6af97356 infra: prepare for release 0.1.7 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.7 		2023-06-19 17:27:52 +00:00
Aaron
752c2e60a5 fix: remove direct url reference 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 13:25:29 -04:00
aarnphm-ec2-dev
feb0c53146 fix(timeout): increase default timeout to avoid asyncio error 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 17:02:42 +00:00
Aaron
58758f8241 fix(dolly_v2): gc collect after import 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 12:28:13 -04:00
Aaron
4f1fee4bee fix(ci): install towncrier for changelog automation 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 06:32:15 -04:00
Aaron
1ed0ae7787 fix(log): make sure to configure OpenLLM logs correctly 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 06:19:06 -04:00
Aaron
2244cce5bd fix(config): __getitem__ to get the value instead of member of class 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 05:35:11 -04:00
Aaron
622a2fb37d fix: separate hatch config 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-19 03:39:05 -04:00
Aaron
e3fad40f21 fix(env): make tests with extra-dependencies 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-18 23:58:03 -04:00
Aaron Pham
03758a5487 fix(tools): adhere to style guidelines (#31) 2023-06-18 20:03:17 -04:00
Aaron
a7a6775c68 chore: add banner for OpenLLM 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-18 05:55:38 -04:00
Aaron
33d3523e5b chore(readme): update docs and warning notes 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-18 01:39:15 -04:00
Aaron Pham
4fcd7c8ac9 integration: HuggingFace Agent (#29) 
Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com>
 2023-06-18 00:13:53 -04:00
aarnphm-ec2-dev
fe8da4e8a9 fix(tests): ensure_available on tests 
Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-17 15:12:28 +00:00
Aaron
8bd7351d3c chore: update new gif 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-17 10:56:32 -04:00
Aaron
5a6f42ee99 infra: fix generated release link for towncrier [skip ci] 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-17 09:20:34 -04:00
Aaron Pham [bot]
9be65a813b infra: bump to dev version of 0.1.7.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-17 13:12:46 +00:00
Aaron Pham [bot]
ed398c38f8 infra: prepare for release 0.1.6 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.6 		2023-06-17 13:02:47 +00:00
Aaron Pham
6f724416c0 perf: build quantization and better transformer behaviour (#28) 
Fixes quantization_config and low_cpu_mem_usage to be available on PyTorch implementation only

See changelog for more details on #28
 2023-06-17 08:56:14 -04:00
Aaron
233d4697b5 chore: update __all__ to take into _extra_objects 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-16 18:13:35 -04:00
Aaron Pham
ded8a9f809 feat: quantization (#27) 2023-06-16 18:10:50 -04:00
Aaron Pham
19bc7e3116 feat: fine-tuning [part 1] (#23) 2023-06-16 00:19:01 -04:00
Aaron
b9ff4ab92a chore: flatten examples llm-config 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 18:39:33 -04:00
Aaron
e4b7714756 chore(js): update metadata 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 13:18:05 -04:00
Aaron Pham
850cf791ef chore: fix README.md 
Signed-off-by: Aaron Pham <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 09:37:46 -04:00
Chaoyu
dc50a2e7e5 docs: add LangChain and BentoML Examples (#25) 
Co-authored-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 06:14:37 -04:00
Aaron Pham
5e1445218b refactor: toplevel CLI (#26) 
Move up CLI outside of the factory function to simplify workflow
 2023-06-15 02:32:46 -04:00
Aaron Pham [bot]
9a6a976ce1 infra: bump to dev version of 0.1.6.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 06:16:12 +00:00
Aaron Pham [bot]
bb425b89d9 infra: prepare for release 0.1.5 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.5 		2023-06-15 06:05:35 +00:00
Aaron
528f76e1d0 fix(client): using httpx for running calls within async context 
This is so that client.query works within a async context

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 01:58:49 -04:00
aarnphm-ec2-dev
b3d924e6d6 fix(dolly): make sure to use GPU when available 
map device_map to auto when GPU is available

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-15 05:53:14 +00:00
aarnphm-ec2-dev
dfe71d7867 chore(cli): redirect download models into subcontext 
utilise click subcontext for nicer CLI interaction

Signed-off-by: aarnphm-ec2-dev <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 11:44:39 +00:00
Aaron
d7e92ae525 feat(cli): --device all --workers-per-resource 
synonymous to the configuration arguments

add support for --device all

Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 06:36:54 -04:00
Aaron
d07cc95ea0 ci: add hatch to dev envs 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 03:48:05 -04:00
Aaron Pham [bot]
123d9c442f infra: bump to dev version of 0.1.5.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 07:43:54 +00:00
Aaron Pham [bot]
f9c0a1093b infra: prepare for release 0.1.4 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.4 		2023-06-14 07:33:16 +00:00
Aaron
be41c23c10 codegen: remove black as dependencies 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 03:22:05 -04:00
Aaron
50d59cdf8d types: rename interface 
Signed-off-by: Aaron <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 02:45:34 -04:00
Aaron Pham [bot]
47da1916ad infra: bump to dev version of 0.1.4.dev0 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
 2023-06-14 05:56:49 +00:00
Aaron Pham [bot]
52d786edc7 infra: prepare for release 0.1.3 [generated] 
Signed-off-by: Aaron Pham [bot] <29749331+aarnphm@users.noreply.github.com>
v0.1.3 		2023-06-14 05:46:29 +00:00