mirror of
https://github.com/ollama/ollama.git
synced 2026-08-07 05:23:57 -04:00
ollamarunner: Temporarily disable worst case graph preallocation
When we later have a large batch running purely on a CPU, this results the error: GGML_ASSERT(talloc->buffer_id >= 0) Disabling this means that we will incrementally reallocate memory as the graph grows. Fixes #10410
This commit is contained in:
500 Internal Server Error
Gitea Version: 1.28.0+dev-477-g8b6ad49a5f