fakezeta c9451cb604 Bump oneapi-basekit, optimum and openvino (#2139) ...

* Bump oneapi-basekit, optimum and openvino

* Changed PERFORMANCE HINT to CUMULATIVE_THROUGHPUT

Minor latency change for first token but about 10-15% speedup on token generation.

2024-04-26 16:20:43 +02:00

..

cpp

feat(grpc): return consumed token count and update response accordingly (#2035)

2024-04-15 19:47:11 +02:00

go

fix: security scanner dislikes runCommand function arguments (#2140)

2024-04-26 10:33:12 +02:00

python

Bump oneapi-basekit, optimum and openvino (#2139)

2024-04-26 16:20:43 +02:00

backend.proto

feat(rerankers): Add new backend, support jina rerankers API (#2121)

2024-04-25 00:19:02 +02:00