fakezeta 8e36fe9b6f Transformers Backend: max_tokens adherence to OpenAI API (#2108) ...

max token adherence to OpenAI API

improve adherence to OpenAI API when max tokens is omitted or equal to 0 in the request

2024-04-23 18:42:17 +02:00

..

cpp

feat(grpc): return consumed token count and update response accordingly (#2035)

2024-04-15 19:47:11 +02:00

go

Revert #1963 (#2056)

2024-04-17 23:33:49 +02:00

python

Transformers Backend: max_tokens adherence to OpenAI API (#2108)

2024-04-23 18:42:17 +02:00

backend.proto

Add tensor_parallel_size setting to vllm setting items (#2085)

2024-04-20 14:37:02 +00:00