XunchaoZ 440e3d646f fix: Max new tokens (#550) ...

Bug fix for retrieving user input max_new_tokens

2023-11-03 13:44:25 -04:00

..

bundle

fix: do not reply on env var for built bento/docker (#477)

2023-10-10 12:29:20 -04:00

cli

fix(build): check for parity (#508)

2023-10-16 17:33:47 -04:00

models

fix(breaking): remove embeddings and update client implementation (#500)

2023-10-14 16:04:35 -04:00

playground

chore: ignore new lines split [skip ci]

2023-09-01 17:00:49 +00:00

protocol

Fix chat template and message list bug (#549)

2023-10-30 14:28:42 -07:00

serialisation

fix(serialisation): vLLM safetensors support (#324)

2023-09-12 17:44:01 -04:00

utils

fix(serialisation): vLLM safetensors support (#324)

2023-09-12 17:44:01 -04:00

__init__.py

fix(build): check for parity (#508)

2023-10-16 17:33:47 -04:00

__main__.py

fix: persistent styling between ruff and yapf (#279)

2023-08-30 11:37:41 -04:00

_assign.py

feat: continuous batching with vLLM (#349)

2023-09-14 03:09:36 -04:00

_conversation.py

Fix chat template and message list bug (#549)

2023-10-30 14:28:42 -07:00

_generation.py

chore: ignore new lines split [skip ci]

2023-09-01 17:00:49 +00:00

_llm.py

fix: Max new tokens (#550)

2023-11-03 13:44:25 -04:00

_quantisation.py

fix(gptq): use upstream integration (#297)

2023-09-04 14:05:50 -04:00

_service_vars_pkg.py

fix: do not reply on env var for built bento/docker (#477)

2023-10-10 12:29:20 -04:00

_service_vars.py

fix: do not reply on env var for built bento/docker (#477)

2023-10-10 12:29:20 -04:00

_service.py

fix(openai): Chat templates (#519)

2023-10-30 03:20:43 -04:00

client.py

fix(breaking): remove embeddings and update client implementation (#500)

2023-10-14 16:04:35 -04:00

exceptions.py

fix: persistent styling between ruff and yapf (#279)

2023-08-30 11:37:41 -04:00

prompts.py

feat: PromptTemplate and system prompt support (#407)

2023-10-03 09:53:37 -04:00

py.typed

refactor: monorepo (#203)

2023-08-15 02:11:14 -04:00

testing.py

fix(gptq): use upstream integration (#297)

2023-09-04 14:05:50 -04:00