mirror of
https://github.com/bentoml/OpenLLM.git
synced 2026-01-21 05:49:50 -05:00
Commit Graph
Select branches
Hide Pull Requests
dependabot/github_actions/actions-dependencies-67da17a5df
dependabot/pip/production-dependencies-041ea65659
main
pre-commit-ci-update-config
#1
#10
#1000
#1001
#1002
#1004
#1005
#1006
#1007
#1008
#1011
#1012
#1013
#1016
#1017
#1018
#1019
#102
#1022
#1023
#1024
#1027
#1029
#103
#1030
#1031
#1032
#1033
#1034
#1035
#1036
#1038
#1040
#1041
#1043
#1045
#1046
#1047
#1048
#105
#1051
#1052
#1054
#1056
#1057
#1058
#1059
#106
#1060
#1061
#1065
#1066
#1067
#1069
#107
#1070
#1071
#1072
#1073
#1074
#1075
#1077
#1079
#1080
#1081
#1082
#1084
#1085
#1086
#1087
#1088
#1089
#1090
#1091
#1092
#1093
#1094
#1095
#1096
#1097
#1098
#1099
#110
#1100
#1102
#1103
#1104
#1105
#1106
#1107
#1108
#1109
#1110
#1111
#1113
#1114
#1116
#1117
#1118
#1119
#1120
#1121
#1122
#1123
#1124
#1125
#1126
#1127
#1128
#113
#1130
#1131
#1132
#1133
#1134
#1135
#1138
#1139
#114
#1140
#1141
#1142
#1143
#1144
#1145
#1146
#1147
#1148
#1149
#115
#1150
#1151
#1152
#1153
#1154
#1155
#1156
#1157
#1158
#1159
#116
#1160
#1161
#1162
#1163
#1164
#1165
#1166
#1167
#1169
#117
#1170
#1171
#1173
#1174
#1175
#1176
#1177
#1179
#118
#1180
#1181
#1182
#1183
#1187
#1188
#1189
#119
#1190
#1191
#1192
#1193
#1194
#1195
#1196
#1197
#1198
#1199
#12
#1200
#1202
#1203
#1204
#1205
#1206
#1207
#1208
#1209
#1210
#1210
#1211
#1211
#1212
#1213
#1214
#1215
#1216
#1216
#122
#126
#128
#129
#130
#131
#132
#133
#134
#137
#138
#139
#141
#142
#143
#144
#145
#146
#148
#150
#151
#152
#153
#154
#155
#160
#161
#162
#163
#164
#165
#166
#167
#168
#169
#17
#170
#171
#173
#174
#176
#177
#178
#179
#18
#181
#182
#183
#184
#185
#186
#187
#188
#189
#19
#190
#191
#193
#197
#199
#2
#200
#201
#203
#207
#208
#211
#212
#213
#215
#216
#217
#218
#219
#22
#220
#221
#222
#223
#224
#227
#228
#23
#230
#232
#240
#242
#243
#244
#245
#246
#249
#25
#250
#251
#252
#255
#256
#257
#26
#260
#261
#262
#263
#264
#265
#266
#267
#268
#269
#27
#270
#271
#273
#278
#279
#28
#280
#283
#284
#285
#287
#288
#289
#29
#290
#291
#292
#293
#294
#295
#296
#297
#298
#302
#304
#305
#31
#314
#315
#316
#317
#318
#319
#320
#321
#322
#323
#324
#325
#326
#327
#328
#329
#330
#331
#332
#333
#334
#335
#336
#337
#338
#339
#340
#341
#342
#343
#344
#345
#346
#349
#35
#351
#352
#353
#355
#356
#357
#358
#359
#360
#361
#362
#363
#364
#365
#366
#367
#368
#369
#37
#370
#371
#372
#373
#374
#375
#376
#378
#379
#380
#381
#382
#383
#384
#389
#39
#390
#391
#392
#393
#394
#395
#396
#397
#398
#399
#4
#400
#401
#402
#403
#404
#405
#406
#407
#411
#412
#413
#414
#417
#423
#424
#425
#426
#427
#428
#429
#430
#431
#432
#433
#434
#435
#436
#437
#438
#439
#440
#441
#45
#455
#456
#457
#458
#459
#460
#461
#462
#463
#464
#465
#466
#467
#468
#469
#470
#471
#472
#473
#474
#475
#477
#478
#479
#480
#482
#483
#484
#485
#486
#487
#488
#489
#490
#491
#492
#493
#494
#495
#496
#497
#499
#5
#50
#500
#501
#502
#503
#504
#506
#508
#509
#51
#510
#511
#516
#518
#519
#52
#521
#522
#523
#524
#525
#526
#527
#528
#529
#530
#532
#533
#535
#536
#537
#538
#539
#54
#540
#541
#542
#544
#545
#546
#548
#549
#550
#554
#556
#557
#558
#559
#56
#560
#561
#562
#563
#564
#565
#566
#567
#568
#569
#57
#570
#571
#573
#574
#575
#576
#577
#578
#579
#58
#580
#581
#582
#583
#584
#585
#586
#587
#588
#589
#590
#591
#592
#593
#594
#595
#597
#599
#6
#60
#600
#601
#602
#605
#606
#609
#610
#611
#612
#613
#614
#615
#616
#617
#618
#619
#620
#621
#622
#623
#624
#625
#626
#627
#628
#629
#630
#631
#632
#633
#634
#635
#636
#637
#638
#639
#64
#640
#642
#643
#644
#645
#646
#647
#648
#651
#652
#653
#654
#655
#657
#658
#659
#66
#660
#661
#662
#663
#664
#665
#667
#668
#669
#671
#672
#673
#674
#675
#676
#677
#678
#679
#68
#680
#681
#682
#683
#684
#686
#687
#689
#690
#691
#692
#693
#694
#695
#698
#699
#7
#70
#700
#701
#702
#703
#704
#705
#706
#707
#708
#709
#71
#711
#712
#713
#714
#715
#716
#717
#718
#719
#72
#720
#721
#722
#723
#724
#725
#726
#727
#728
#729
#730
#733
#734
#735
#739
#74
#742
#749
#75
#750
#751
#753
#757
#76
#760
#761
#762
#763
#764
#765
#766
#767
#770
#772
#773
#774
#775
#776
#779
#781
#782
#783
#786
#789
#790
#791
#792
#793
#794
#796
#797
#798
#799
#8
#80
#805
#807
#808
#811
#812
#813
#814
#815
#816
#817
#818
#819
#821
#823
#824
#825
#826
#830
#831
#832
#833
#834
#836
#837
#838
#84
#841
#842
#843
#844
#845
#846
#847
#848
#85
#854
#855
#856
#857
#858
#866
#867
#868
#869
#87
#870
#877
#878
#879
#88
#880
#881
#883
#884
#885
#886
#887
#888
#889
#89
#890
#891
#892
#893
#896
#897
#898
#899
#9
#90
#906
#907
#908
#909
#91
#912
#913
#915
#916
#917
#918
#919
#92
#920
#923
#925
#928
#93
#931
#932
#933
#935
#938
#939
#940
#941
#942
#943
#945
#946
#947
#949
#95
#950
#953
#954
#955
#956
#957
#958
#959
#963
#964
#969
#970
#973
#974
#975
#976
#977
#978
#979
#98
#980
#981
#982
#983
#984
#985
#986
#987
#988
#989
#990
#991
#992
#993
#994
#995
#996
#997
#998
#999
v0.0.10
v0.0.11
v0.0.12
v0.0.13
v0.0.14
v0.0.15
v0.0.16
v0.0.17
v0.0.18
v0.0.19
v0.0.21
v0.0.22
v0.0.23
v0.0.24
v0.0.25
v0.0.26
v0.0.27
v0.0.28
v0.0.29
v0.0.30
v0.0.31
v0.0.32
v0.0.33
v0.0.34
v0.0.4
v0.0.5
v0.0.6
v0.0.7
v0.0.8
v0.0.9
v0.1.0
v0.1.1
v0.1.10
v0.1.11
v0.1.12
v0.1.13
v0.1.14
v0.1.15
v0.1.16
v0.1.17
v0.1.18
v0.1.19
v0.1.2
v0.1.20
v0.1.3
v0.1.4
v0.1.5
v0.1.6
v0.1.7
v0.1.8
v0.1.9
v0.2.0
v0.2.1
v0.2.10
v0.2.11
v0.2.12
v0.2.13
v0.2.14
v0.2.15
v0.2.16
v0.2.17
v0.2.18
v0.2.19
v0.2.2
v0.2.20
v0.2.21
v0.2.22
v0.2.23
v0.2.24
v0.2.25
v0.2.26
v0.2.27
v0.2.3
v0.2.4
v0.2.5
v0.2.6
v0.2.7
v0.2.8
v0.2.9
v0.3.0
v0.3.1
v0.3.10
v0.3.11
v0.3.12
v0.3.13
v0.3.14
v0.3.2
v0.3.3
v0.3.4
v0.3.5
v0.3.6
v0.3.7
v0.3.8
v0.3.9
v0.4.0
v0.4.1
v0.4.10
v0.4.11
v0.4.12
v0.4.13
v0.4.14
v0.4.15
v0.4.16
v0.4.17
v0.4.18
v0.4.19
v0.4.2
v0.4.20
v0.4.21
v0.4.22
v0.4.23
v0.4.24
v0.4.25
v0.4.26
v0.4.27
v0.4.28
v0.4.29
v0.4.3
v0.4.30
v0.4.31
v0.4.32
v0.4.33
v0.4.34
v0.4.35
v0.4.36
v0.4.37
v0.4.38
v0.4.39
v0.4.4
v0.4.40
v0.4.41
v0.4.42
v0.4.43
v0.4.44
v0.4.5
v0.4.6
v0.4.7
v0.4.8
v0.4.9
v0.5.0
v0.5.0-alpha
v0.5.0-alpha.1
v0.5.0-alpha.10
v0.5.0-alpha.11
v0.5.0-alpha.12
v0.5.0-alpha.13
v0.5.0-alpha.14
v0.5.0-alpha.15
v0.5.0-alpha.2
v0.5.0-alpha.3
v0.5.0-alpha.4
v0.5.0-alpha.5
v0.5.0-alpha.6
v0.5.0-alpha.7
v0.5.0-alpha.8
v0.5.0-alpha.9
v0.5.1
v0.5.2
v0.5.3
v0.5.4
v0.5.5
v0.5.6
v0.5.7
v0.6.0
v0.6.1
v0.6.10
v0.6.11
v0.6.12
v0.6.13
v0.6.14
v0.6.15
v0.6.16
v0.6.17
v0.6.18
v0.6.19
v0.6.2
v0.6.20
v0.6.21
v0.6.22
v0.6.23
v0.6.24
v0.6.25
v0.6.26
v0.6.27
v0.6.28
v0.6.29
v0.6.3
v0.6.30
v0.6.4
v0.6.5
v0.6.6
v0.6.7
v0.6.8
v0.6.9
Select branches
Hide Pull Requests
dependabot/github_actions/actions-dependencies-67da17a5df
dependabot/pip/production-dependencies-041ea65659
main
pre-commit-ci-update-config
#1
#10
#1000
#1001
#1002
#1004
#1005
#1006
#1007
#1008
#1011
#1012
#1013
#1016
#1017
#1018
#1019
#102
#1022
#1023
#1024
#1027
#1029
#103
#1030
#1031
#1032
#1033
#1034
#1035
#1036
#1038
#1040
#1041
#1043
#1045
#1046
#1047
#1048
#105
#1051
#1052
#1054
#1056
#1057
#1058
#1059
#106
#1060
#1061
#1065
#1066
#1067
#1069
#107
#1070
#1071
#1072
#1073
#1074
#1075
#1077
#1079
#1080
#1081
#1082
#1084
#1085
#1086
#1087
#1088
#1089
#1090
#1091
#1092
#1093
#1094
#1095
#1096
#1097
#1098
#1099
#110
#1100
#1102
#1103
#1104
#1105
#1106
#1107
#1108
#1109
#1110
#1111
#1113
#1114
#1116
#1117
#1118
#1119
#1120
#1121
#1122
#1123
#1124
#1125
#1126
#1127
#1128
#113
#1130
#1131
#1132
#1133
#1134
#1135
#1138
#1139
#114
#1140
#1141
#1142
#1143
#1144
#1145
#1146
#1147
#1148
#1149
#115
#1150
#1151
#1152
#1153
#1154
#1155
#1156
#1157
#1158
#1159
#116
#1160
#1161
#1162
#1163
#1164
#1165
#1166
#1167
#1169
#117
#1170
#1171
#1173
#1174
#1175
#1176
#1177
#1179
#118
#1180
#1181
#1182
#1183
#1187
#1188
#1189
#119
#1190
#1191
#1192
#1193
#1194
#1195
#1196
#1197
#1198
#1199
#12
#1200
#1202
#1203
#1204
#1205
#1206
#1207
#1208
#1209
#1210
#1210
#1211
#1211
#1212
#1213
#1214
#1215
#1216
#1216
#122
#126
#128
#129
#130
#131
#132
#133
#134
#137
#138
#139
#141
#142
#143
#144
#145
#146
#148
#150
#151
#152
#153
#154
#155
#160
#161
#162
#163
#164
#165
#166
#167
#168
#169
#17
#170
#171
#173
#174
#176
#177
#178
#179
#18
#181
#182
#183
#184
#185
#186
#187
#188
#189
#19
#190
#191
#193
#197
#199
#2
#200
#201
#203
#207
#208
#211
#212
#213
#215
#216
#217
#218
#219
#22
#220
#221
#222
#223
#224
#227
#228
#23
#230
#232
#240
#242
#243
#244
#245
#246
#249
#25
#250
#251
#252
#255
#256
#257
#26
#260
#261
#262
#263
#264
#265
#266
#267
#268
#269
#27
#270
#271
#273
#278
#279
#28
#280
#283
#284
#285
#287
#288
#289
#29
#290
#291
#292
#293
#294
#295
#296
#297
#298
#302
#304
#305
#31
#314
#315
#316
#317
#318
#319
#320
#321
#322
#323
#324
#325
#326
#327
#328
#329
#330
#331
#332
#333
#334
#335
#336
#337
#338
#339
#340
#341
#342
#343
#344
#345
#346
#349
#35
#351
#352
#353
#355
#356
#357
#358
#359
#360
#361
#362
#363
#364
#365
#366
#367
#368
#369
#37
#370
#371
#372
#373
#374
#375
#376
#378
#379
#380
#381
#382
#383
#384
#389
#39
#390
#391
#392
#393
#394
#395
#396
#397
#398
#399
#4
#400
#401
#402
#403
#404
#405
#406
#407
#411
#412
#413
#414
#417
#423
#424
#425
#426
#427
#428
#429
#430
#431
#432
#433
#434
#435
#436
#437
#438
#439
#440
#441
#45
#455
#456
#457
#458
#459
#460
#461
#462
#463
#464
#465
#466
#467
#468
#469
#470
#471
#472
#473
#474
#475
#477
#478
#479
#480
#482
#483
#484
#485
#486
#487
#488
#489
#490
#491
#492
#493
#494
#495
#496
#497
#499
#5
#50
#500
#501
#502
#503
#504
#506
#508
#509
#51
#510
#511
#516
#518
#519
#52
#521
#522
#523
#524
#525
#526
#527
#528
#529
#530
#532
#533
#535
#536
#537
#538
#539
#54
#540
#541
#542
#544
#545
#546
#548
#549
#550
#554
#556
#557
#558
#559
#56
#560
#561
#562
#563
#564
#565
#566
#567
#568
#569
#57
#570
#571
#573
#574
#575
#576
#577
#578
#579
#58
#580
#581
#582
#583
#584
#585
#586
#587
#588
#589
#590
#591
#592
#593
#594
#595
#597
#599
#6
#60
#600
#601
#602
#605
#606
#609
#610
#611
#612
#613
#614
#615
#616
#617
#618
#619
#620
#621
#622
#623
#624
#625
#626
#627
#628
#629
#630
#631
#632
#633
#634
#635
#636
#637
#638
#639
#64
#640
#642
#643
#644
#645
#646
#647
#648
#651
#652
#653
#654
#655
#657
#658
#659
#66
#660
#661
#662
#663
#664
#665
#667
#668
#669
#671
#672
#673
#674
#675
#676
#677
#678
#679
#68
#680
#681
#682
#683
#684
#686
#687
#689
#690
#691
#692
#693
#694
#695
#698
#699
#7
#70
#700
#701
#702
#703
#704
#705
#706
#707
#708
#709
#71
#711
#712
#713
#714
#715
#716
#717
#718
#719
#72
#720
#721
#722
#723
#724
#725
#726
#727
#728
#729
#730
#733
#734
#735
#739
#74
#742
#749
#75
#750
#751
#753
#757
#76
#760
#761
#762
#763
#764
#765
#766
#767
#770
#772
#773
#774
#775
#776
#779
#781
#782
#783
#786
#789
#790
#791
#792
#793
#794
#796
#797
#798
#799
#8
#80
#805
#807
#808
#811
#812
#813
#814
#815
#816
#817
#818
#819
#821
#823
#824
#825
#826
#830
#831
#832
#833
#834
#836
#837
#838
#84
#841
#842
#843
#844
#845
#846
#847
#848
#85
#854
#855
#856
#857
#858
#866
#867
#868
#869
#87
#870
#877
#878
#879
#88
#880
#881
#883
#884
#885
#886
#887
#888
#889
#89
#890
#891
#892
#893
#896
#897
#898
#899
#9
#90
#906
#907
#908
#909
#91
#912
#913
#915
#916
#917
#918
#919
#92
#920
#923
#925
#928
#93
#931
#932
#933
#935
#938
#939
#940
#941
#942
#943
#945
#946
#947
#949
#95
#950
#953
#954
#955
#956
#957
#958
#959
#963
#964
#969
#970
#973
#974
#975
#976
#977
#978
#979
#98
#980
#981
#982
#983
#984
#985
#986
#987
#988
#989
#990
#991
#992
#993
#994
#995
#996
#997
#998
#999
v0.0.10
v0.0.11
v0.0.12
v0.0.13
v0.0.14
v0.0.15
v0.0.16
v0.0.17
v0.0.18
v0.0.19
v0.0.21
v0.0.22
v0.0.23
v0.0.24
v0.0.25
v0.0.26
v0.0.27
v0.0.28
v0.0.29
v0.0.30
v0.0.31
v0.0.32
v0.0.33
v0.0.34
v0.0.4
v0.0.5
v0.0.6
v0.0.7
v0.0.8
v0.0.9
v0.1.0
v0.1.1
v0.1.10
v0.1.11
v0.1.12
v0.1.13
v0.1.14
v0.1.15
v0.1.16
v0.1.17
v0.1.18
v0.1.19
v0.1.2
v0.1.20
v0.1.3
v0.1.4
v0.1.5
v0.1.6
v0.1.7
v0.1.8
v0.1.9
v0.2.0
v0.2.1
v0.2.10
v0.2.11
v0.2.12
v0.2.13
v0.2.14
v0.2.15
v0.2.16
v0.2.17
v0.2.18
v0.2.19
v0.2.2
v0.2.20
v0.2.21
v0.2.22
v0.2.23
v0.2.24
v0.2.25
v0.2.26
v0.2.27
v0.2.3
v0.2.4
v0.2.5
v0.2.6
v0.2.7
v0.2.8
v0.2.9
v0.3.0
v0.3.1
v0.3.10
v0.3.11
v0.3.12
v0.3.13
v0.3.14
v0.3.2
v0.3.3
v0.3.4
v0.3.5
v0.3.6
v0.3.7
v0.3.8
v0.3.9
v0.4.0
v0.4.1
v0.4.10
v0.4.11
v0.4.12
v0.4.13
v0.4.14
v0.4.15
v0.4.16
v0.4.17
v0.4.18
v0.4.19
v0.4.2
v0.4.20
v0.4.21
v0.4.22
v0.4.23
v0.4.24
v0.4.25
v0.4.26
v0.4.27
v0.4.28
v0.4.29
v0.4.3
v0.4.30
v0.4.31
v0.4.32
v0.4.33
v0.4.34
v0.4.35
v0.4.36
v0.4.37
v0.4.38
v0.4.39
v0.4.4
v0.4.40
v0.4.41
v0.4.42
v0.4.43
v0.4.44
v0.4.5
v0.4.6
v0.4.7
v0.4.8
v0.4.9
v0.5.0
v0.5.0-alpha
v0.5.0-alpha.1
v0.5.0-alpha.10
v0.5.0-alpha.11
v0.5.0-alpha.12
v0.5.0-alpha.13
v0.5.0-alpha.14
v0.5.0-alpha.15
v0.5.0-alpha.2
v0.5.0-alpha.3
v0.5.0-alpha.4
v0.5.0-alpha.5
v0.5.0-alpha.6
v0.5.0-alpha.7
v0.5.0-alpha.8
v0.5.0-alpha.9
v0.5.1
v0.5.2
v0.5.3
v0.5.4
v0.5.5
v0.5.6
v0.5.7
v0.6.0
v0.6.1
v0.6.10
v0.6.11
v0.6.12
v0.6.13
v0.6.14
v0.6.15
v0.6.16
v0.6.17
v0.6.18
v0.6.19
v0.6.2
v0.6.20
v0.6.21
v0.6.22
v0.6.23
v0.6.24
v0.6.25
v0.6.26
v0.6.27
v0.6.28
v0.6.29
v0.6.3
v0.6.30
v0.6.4
v0.6.5
v0.6.6
v0.6.7
v0.6.8
v0.6.9
-
79c9608735
infra: reduce wait time to around 7 mins (#726)
Aaron Pham
2023-11-22 07:28:36 -05:00 -
831bb8c497
infra: bump to homebrew tap release to 0.4.26 [generated] [skip ci]
Aaron Pham
2023-11-22 11:59:36 +00:00 -
80842ad501
infra: bump to dev version of 0.4.27.dev0 [generated] [skip ci]
Aaron Pham
2023-11-22 11:58:42 +00:00 -
7eae50377d
infra: prepare for release 0.4.26 [generated] [skip ci]
v0.4.26
Aaron Pham
2023-11-22 11:50:50 +00:00 -
b28b5269b5
feat(openai): chat templates and complete control of prompt generation (#725)
Aaron Pham
2023-11-22 06:49:14 -05:00 -
7aa0918a6f
fix(client): correct schemas parser from correct response output (#724)
Aaron Pham
2023-11-22 05:01:35 -05:00 -
f83f64ffd7
fix(infra): setup higher timer for building container images (#723)
Aaron Pham
2023-11-22 05:00:33 -05:00 -
6dd07580e2
infra: bump to homebrew tap release to 0.4.25 [generated] [skip ci]
Aaron Pham
2023-11-22 09:35:41 +00:00 -
1876609a67
infra: bump to dev version of 0.4.26.dev0 [generated] [skip ci]
Aaron Pham
2023-11-22 09:34:22 +00:00 -
0189342730
infra: prepare for release 0.4.25 [generated] [skip ci]
v0.4.25
Aaron Pham
2023-11-22 09:22:45 +00:00 -
63d86faa32
fix(openai): correct stop tokens and finish_reason state (#722)
Aaron Pham
2023-11-22 04:21:13 -05:00 -
06626e7d1e
infra: bump to homebrew tap release to 0.4.24 [generated] [skip ci]
Aaron Pham
2023-11-22 06:51:39 +00:00 -
c9b23638a5
infra: bump to dev version of 0.4.25.dev0 [generated] [skip ci]
Aaron Pham
2023-11-22 06:50:35 +00:00 -
7f09f9daf2
infra: prepare for release 0.4.24 [generated] [skip ci]
v0.4.24
Aaron Pham
2023-11-22 06:34:30 +00:00 -
d697ea3903
fix(image): setup correct installation
Aaron
2023-11-22 01:33:26 -05:00 -
9f84b8b945
infra: bump to homebrew tap release to 0.4.23 [generated] [skip ci]
Aaron Pham
2023-11-22 06:26:20 +00:00 -
1df549f76a
infra: bump to dev version of 0.4.24.dev0 [generated] [skip ci]
Aaron Pham
2023-11-22 06:25:32 +00:00 -
85e03a4b92
infra: prepare for release 0.4.23 [generated] [skip ci]
v0.4.23
Aaron Pham
2023-11-22 06:16:49 +00:00 -
38b7c44df0
fix(base-image): update base image to include cuda for now (#720)
Aaron Pham
2023-11-22 01:15:19 -05:00 -
8bb2742a9a
chore(types): append additional types change (#719)
Aaron Pham
2023-11-21 22:38:20 -05:00 -
04ef08a7f8
chore(strategy): compact and add stubs (#718)
Aaron Pham
2023-11-21 21:49:28 -05:00 -
909db8c3bf
refactor: reduce compiled cacheline
Aaron Pham
2023-11-22 02:27:42 +00:00 -
77bd6f090a
chore(logger): fix warnings and streamline style (#717)
Aaron Pham
2023-11-21 18:54:51 -05:00 -
d53cf234bd
fix(api-server): correct set generation from LLM class
Aaron Pham
2023-11-21 10:38:36 +00:00 -
2821e172ef
fix(examples): use non-chat models
Aaron Pham
2023-11-21 10:11:35 +00:00 -
93709f1d66
fix(infra): remove unless exclude
Aaron
2023-11-21 05:04:47 -05:00 -
14242a7ab8
fix(utils): correct import
Aaron
2023-11-21 05:03:20 -05:00 -
c33b071ee4
refactor: delete unused code (#716)
Aaron Pham
2023-11-21 04:39:48 -05:00 -
a8a9f154ce
fix(ci): tests (#715)
Aaron Pham
2023-11-21 03:05:22 -05:00 -
e70246ca5d
feat(generation): add support for eos_token_id (#714)
Aaron Pham
2023-11-21 02:01:36 -05:00 -
fde78a2c78
chore: cleanup unused prompt templates (#713)
Aaron Pham
2023-11-21 01:56:51 -05:00 -
e6b9a749a4
infra: bump to homebrew tap release to 0.4.22 [generated] [skip ci]
Aaron Pham
2023-11-21 01:50:09 +00:00 -
be7a4bf576
infra: bump to dev version of 0.4.23.dev0 [generated] [skip ci]
Aaron Pham
2023-11-21 01:49:02 +00:00 -
f3fd32d596
infra: prepare for release 0.4.22 [generated] [skip ci]
v0.4.22
Aaron Pham
2023-11-21 01:38:46 +00:00 -
ad4f388c98
refactor: update runner helpers and add max_model_len (#712)
Aaron Pham
2023-11-20 20:37:15 -05:00 -
8fc5f1f70c
infra: bump to homebrew tap release to 0.4.21 [generated] [skip ci]
Aaron Pham
2023-11-20 22:50:00 +00:00 -
aac92f40ac
infra: bump to dev version of 0.4.22.dev0 [generated] [skip ci]
Aaron Pham
2023-11-20 22:48:59 +00:00 -
4c4bc82a47
infra: prepare for release 0.4.21 [generated] [skip ci]
v0.4.21
Aaron Pham
2023-11-20 22:32:44 +00:00 -
00e2666e48
fix(build): contraint packages for bentoml >1.1.10
Aaron
2023-11-20 17:30:21 -05:00 -
1f2cdc8021
chore(deps): bump github/codeql-action from 2.22.5 to 2.22.7 (#707)
dependabot[bot]
2023-11-20 17:22:49 -05:00 -
62da3a7fe5
chore(deps): bump docker/build-push-action from 5.0.0 to 5.1.0 (#708)
dependabot[bot]
2023-11-20 17:22:41 -05:00 -
b1ee1ce2a1
chore(deps): bump taiki-e/install-action from 2.21.11 to 2.21.17 (#709)
dependabot[bot]
2023-11-20 17:22:30 -05:00 -
d7bb0ab197
ci: pre-commit autoupdate [pre-commit.ci] (#711)
pre-commit-ci[bot]
2023-11-20 17:22:19 -05:00 -
c25f69fddc
infra: bump to homebrew tap release to 0.4.20 [generated] [skip ci]
Aaron Pham
2023-11-20 22:19:49 +00:00 -
5491fe30b0
infra: bump to dev version of 0.4.21.dev0 [generated] [skip ci]
Aaron Pham
2023-11-20 22:18:14 +00:00 -
204cbd43d2
infra: prepare for release 0.4.20 [generated] [skip ci]
v0.4.20
Aaron Pham
2023-11-20 22:09:47 +00:00 -
f753662ae6
fix(build): only load model when eager is True
Aaron
2023-11-20 17:06:25 -05:00 -
5b92e848e2
fix: raises error if backend is not supported
Aaron
2023-11-20 17:03:30 -05:00 -
3769ca73a9
infra: bump to homebrew tap release to 0.4.19 [generated] [skip ci]
Aaron Pham
2023-11-20 08:19:58 +00:00 -
82ee9e845a
infra: bump to dev version of 0.4.20.dev0 [generated] [skip ci]
Aaron Pham
2023-11-20 08:19:02 +00:00 -
46d6fcca98
infra: prepare for release 0.4.19 [generated] [skip ci]
v0.4.19
Aaron Pham
2023-11-20 08:06:53 +00:00 -
12b2b8ed21
fix: remove prompt template
Aaron Pham
2023-11-20 08:04:40 +00:00 -
41c857f292
fix: set correct type annotations
Aaron Pham
2023-11-20 07:17:38 +00:00 -
7e2aa80a8c
infra: bump to homebrew tap release to 0.4.18 [generated] [skip ci]
Aaron Pham
2023-11-20 05:25:42 +00:00 -
d82896a80c
infra: bump to dev version of 0.4.19.dev0 [generated] [skip ci]
Aaron Pham
2023-11-20 05:24:31 +00:00 -
c1f86bda16
infra: prepare for release 0.4.18 [generated] [skip ci]
v0.4.18
Aaron Pham
2023-11-20 05:15:14 +00:00 -
513c08ccda
feat(openai): dynamic model_type registration (#704)
Aaron Pham
2023-11-20 00:13:45 -05:00 -
6505abdb44
chore: update lower bound version of bentoml to avoid breakage (#703)
Aaron Pham
2023-11-19 23:09:14 -05:00 -
ed01080c1b
infra: bump to homebrew tap release to 0.4.17 [generated] [skip ci]
Aaron Pham
2023-11-20 03:55:05 +00:00 -
7b89fde99e
infra: bump to dev version of 0.4.18.dev0 [generated] [skip ci]
Aaron Pham
2023-11-20 03:54:07 +00:00 -
d1915d7a9e
infra: prepare for release 0.4.17 [generated] [skip ci]
v0.4.17
Aaron Pham
2023-11-20 03:43:21 +00:00 -
4491aa54d0
fix(backend): correct use variable for backend when initialisation (#702)
Aaron Pham
2023-11-19 22:42:25 -05:00 -
44f05da845
infra: update generate notes and better local handle (#701)
Aaron Pham
2023-11-19 17:50:23 -05:00 -
83f95c74ff
infra: bump to homebrew tap release to 0.4.16 [generated] [skip ci]
Aaron Pham
2023-11-19 15:53:11 +00:00 -
184c6739d1
infra: bump to dev version of 0.4.17.dev0 [generated] [skip ci]
Aaron Pham
2023-11-19 15:50:55 +00:00 -
e9207ff683
infra: prepare for release 0.4.16 [generated] [skip ci]
v0.4.16
Aaron Pham
2023-11-19 15:41:03 +00:00 -
cb4386b013
fix(release): remove unecessary check for client dependencies [skip ci]
Aaron
2023-11-19 10:38:59 -05:00 -
1968704b71
chore: update changelog [skip ci] (#700)
Aaron Pham
2023-11-19 10:30:48 -05:00 -
d80c392661
chore: update documentation about runtime (#699)
Aaron Pham
2023-11-19 10:27:07 -05:00 -
816c1ee80e
feat(engine): CTranslate2 (#698)
Aaron Pham
2023-11-19 10:25:08 -05:00 -
539f250c0f
feat(vllm): bump to 0.2.2 (#695)
Aaron Pham
2023-11-19 02:52:32 -05:00 -
206521e02d
feat(ctranslate): initial infrastructure support (#694)
Aaron Pham
2023-11-19 01:48:33 -05:00 -
93ffb29e9f
infra: bump to homebrew tap release to 0.4.15 [generated] [skip ci]
Aaron Pham
2023-11-19 00:57:03 +00:00 -
4d3e221168
infra: bump to dev version of 0.4.16.dev0 [generated] [skip ci]
Aaron Pham
2023-11-19 00:56:11 +00:00 -
c19654adf3
infra: prepare for release 0.4.15 [generated] [skip ci]
v0.4.15
Aaron Pham
2023-11-19 00:47:18 +00:00 -
099cc22a94
chore: update documentation (#693)
Aaron Pham
2023-11-18 19:44:52 -05:00 -
1831d8f129
feat: heuristics logprobs (#692)
Aaron Pham
2023-11-18 19:26:20 -05:00 -
4499469efb
fix(annotations): check library through find_spec (#691)
Aaron Pham
2023-11-18 02:02:16 -05:00 -
e9a89b7a7e
fix(cattrs): strictly lock <23.2 until we upgrade validation logic (#690)
Aaron Pham
2023-11-17 17:11:15 -05:00 -
3d204e9cea
infra: bump to homebrew tap release to 0.4.14 [generated] [skip ci]
Aaron Pham
2023-11-17 22:07:26 +00:00 -
781ae72c6f
infra: bump to dev version of 0.4.15.dev0 [generated] [skip ci]
Aaron Pham
2023-11-17 22:04:01 +00:00 -
5402db1e61
infra: prepare for release 0.4.14 [generated] [skip ci]
v0.4.14
Aaron Pham
2023-11-17 21:54:10 +00:00 -
0891cde0b6
fix(dependencies): ignore broken cattrs release (#689)
Aaron Pham
2023-11-17 16:52:58 -05:00 -
131f3f5dc3
infra: bump to homebrew tap release to 0.4.13 [generated] [skip ci]
Aaron Pham
2023-11-17 21:18:13 +00:00 -
1c5d07d60c
infra: bump to dev version of 0.4.14.dev0 [generated] [skip ci]
Aaron Pham
2023-11-17 21:17:18 +00:00 -
e14f3ffed5
infra: prepare for release 0.4.13 [generated] [skip ci]
v0.4.13
Aaron Pham
2023-11-17 21:06:56 +00:00 -
c03e3bebb3
fix(infra): prepare correct dependencies for release [skip ci] (#687)
Aaron Pham
2023-11-17 16:02:25 -05:00 -
80ed400646
fix(build): lock lower version based on each release and update infra (#686)
Aaron Pham
2023-11-17 15:57:31 -05:00 -
e01f93f0c3
examples: improve instructions and cleanup simple API server (#684)
Aaron Pham
2023-11-17 11:53:56 -05:00 -
381d740a7a
fix(llm): remove unnecessary check (#683)
Aaron Pham
2023-11-17 11:23:22 -05:00 -
10471f7e4e
infra: bump to homebrew tap release to 0.4.12 [generated] [skip ci]
Aaron Pham
2023-11-17 16:05:37 +00:00 -
89c49f3a4f
infra: bump to dev version of 0.4.13.dev0 [generated] [skip ci]
Aaron Pham
2023-11-17 16:04:37 +00:00 -
65370f6919
infra: prepare for release 0.4.12 [generated] [skip ci]
v0.4.12
Aaron Pham
2023-11-17 15:54:41 +00:00 -
14b3ceb436
fix(torch_dtype): correctly infer based on options (#682)
Aaron Pham
2023-11-17 10:52:05 -05:00 -
7402408c5f
fix(envvar): explicitly set NVIDIA_DRIVER_CAPABILITIES (#681)
Aaron Pham
2023-11-17 10:40:45 -05:00 -
bd513e51a8
infra: bump to homebrew tap release to 0.4.11 [generated] [skip ci]
Aaron Pham
2023-11-17 15:04:54 +00:00 -
122c95dc31
infra: bump to dev version of 0.4.12.dev0 [generated] [skip ci]
Aaron Pham
2023-11-17 15:03:29 +00:00 -
5752c3f0d8
infra: prepare for release 0.4.11 [generated] [skip ci]
v0.4.11
Aaron Pham
2023-11-17 14:53:12 +00:00 -
bce273ad47
fix(env): correct format environment on docker (#680)
Aaron Pham
2023-11-17 09:51:17 -05:00 -
c1e0e3eae7
fix(build): correctly parse default env for container (#679)
Aaron Pham
2023-11-17 09:35:26 -05:00