Commit Graph

125 Commits

Author SHA1 Message Date
bojiang
2005cd4e83 Update README.md 2024-07-04 14:51:54 +08:00
bojiang
2e29469c5d Merge remote-tracking branch 'recipe/main' 2024-07-04 14:43:36 +08:00
Aaron Pham
6d061ce8a3 feat: DEVELOPMENT.md (#9)
* feat: DEVELOPMENT.md

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: update callout

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

---------

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-07-04 11:23:14 +08:00
xianxian.zhang
2a9e16d148 feat: add phi3 (llamacpp backed) (#6)
* feat: add phi3 gguf

* chore: del alias

* chore: update bentofile.yaml

* chore: add ui

* chore: clean code

* clean names

---------

Co-authored-by: bojiang <bojiang_@outlook.com>
2024-07-04 11:21:56 +08:00
bojiang
9bfe6e9991 chore(clean): reset configs 2024-07-04 10:52:43 +08:00
bojiang
c29decacf3 fix(ux): cloud login prompt 2024-07-04 10:45:58 +08:00
bojiang
8d1405d875 chore(ux): feedback 2024-07-04 02:14:29 +08:00
bojiang
0d16358911 fix(chatts): add fastapi 2024-07-03 20:37:43 +08:00
xianxian.zhang
34a09db9b9 fix: Resource schema (#4) 2024-07-03 20:33:29 +08:00
bojiang
ef45ca611e refactor: use openai client in run 2024-07-03 20:28:46 +08:00
bojiang
17a3535991 refactor: label based alias 2024-07-03 19:33:41 +08:00
bojiang
a7adfa4712 fix: venv 2024-07-03 17:32:21 +08:00
bojiang
5a57731094 take analytic out 2024-07-03 15:31:50 +08:00
bojiang
1a6f15d376 change labels 2024-07-03 15:00:43 +08:00
bojiang
016b7b016d refactor: alias 2024-07-03 14:50:32 +08:00
bojiang
5d914aa2bc add labels 2024-07-03 14:50:31 +08:00
bojiang
aae59277e1 tts ui 2024-07-03 14:40:48 +08:00
bojiang
f303d6a6f0 chattts 2024-07-03 14:40:48 +08:00
bojiang
3a926e35b2 fix ui for cloud 2024-07-03 14:40:46 +08:00
Rick Zhou
2fdeb4a3e7 Merge pull request #7 from bentoml/pr-mixtral-support
[Model Support] Support Mixtral 8x7b model
2024-07-02 23:35:20 -07:00
Rick Zhou
6a6d74ad84 Merge pull request #8 from bentoml/pr-local-run-fix
fix: Fix bug with local run with system prompt
2024-07-02 23:23:32 -07:00
Rick Zhou
c6f5004de6 fix: Fix bug with local run with system prompt 2024-07-03 04:52:12 +00:00
Rick Zhou
1822f5ae17 [Model Support] Support Mixtral 8x7b model 2024-07-03 02:51:26 +00:00
bojiang
b09339947d fix: config 2024-07-02 22:24:47 +08:00
bojiang
50fa598a9d chore: add clean command 2024-07-02 19:19:48 +08:00
bojiang
3114bbed8d chore: make command outputs orange 2024-07-02 17:37:42 +08:00
bojiang
f613a8330a fix uv 2024-07-02 17:27:15 +08:00
bojiang
9fc103b14d fix: gpu detection 2024-07-02 17:25:34 +08:00
Aaron Pham
1c0bfc1d37 feat: add support for tracking (#2)
* feat: add support for tracking

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: add some sane defaults

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

* chore: update to use event_type to openllm_cli

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>

---------

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
2024-07-02 14:54:08 +08:00
Frost Ming
750025664c feat: Use uv for venv management (#3)
* feat: Use uv for venv management

Signed-off-by: Frost Ming <me@frostming.com>

* fix: exe suffix

Signed-off-by: Frost Ming <me@frostming.com>

---------

Signed-off-by: Frost Ming <me@frostming.com>
2024-07-02 14:52:08 +08:00
bojiang
d3d08f20d6 add warning for nvidia compute_capability 2024-07-02 14:49:55 +08:00
bojiang
7baac978fe chore: output level 2024-07-01 17:56:38 +08:00
bojiang
a3f9aaf35d various fixes 2024-06-27 17:10:28 +08:00
Frost Ming
04a1a87d97 fix: specify the message schema for chat endpoint (#5) 2024-06-27 08:52:40 +08:00
bojiang
a8a5122c5e chore: ui nits 2024-06-26 10:52:19 +08:00
bojiang
23692f34b9 refactor: clean 2024-06-26 10:52:19 +08:00
bojiang
20e6ed26b3 refactor: openllm hello 2024-06-26 10:52:19 +08:00
github-actions[bot]
25baeab5dd Sync chat UI from main repository 2024-06-21 04:16:17 +00:00
bojiang
effac3d348 Update README.md 2024-06-21 11:50:04 +08:00
bojiang
60a7a5d79a Update README.md 2024-06-21 11:49:39 +08:00
Rick Zhou
5e3111e271 chore: update UI serving logic 2024-06-20 18:22:26 +00:00
Rick Zhou
b5341fdb36 fix: make compatible with vllm 0.4.3 API 2024-06-20 17:24:31 +00:00
Rick Zhou
b1ad075795 fix: update chaat UI 2024-06-19 09:07:07 +00:00
bojiang
22f346a06b Update requirements.txt (#4) 2024-06-17 13:25:06 +08:00
bojiang
d2f1bf76a5 fix: service_home label 2024-06-12 21:37:19 +08:00
bojiang
042492055a mount ui to /chat 2024-06-12 20:04:14 +08:00
bojiang
f718e045d5 fix: io types 2024-06-12 20:04:14 +08:00
bojiang
c5e8a0af14 fix: chatui 2024-06-12 20:04:14 +08:00
bojiang
dc8a1ef8ee add chatui 2024-06-12 20:04:14 +08:00
bojiang
ebed5331e3 not work 2024-06-12 20:04:14 +08:00