fix(hermes-2-pro-mistral): add stopword for toolcall (#1939)

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto authored and GitHub committed 2024-04-01 11:48:35 +02:00
1 parent 66f90f8dc1
commit ebb1fcedea
4 files changed
+4

No files matched your search

@@ -41,6 +41,7 @@ f16: true
stopwords:
- <|im_end|>
- <dummy32000>
- "\n</tool_call>"
usage: |
curl http://localhost:8080/v1/chat/completions -H "Content-Type: application/json" -d '{
"model": "hermes-2-pro-mistral",