Ettore Di Giacinto 8862e3ce60 feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186) ...

* always enable parallel requests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore: move tests to ginkgo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(smart router): order by available vram

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-03-31 08:28:56 +02:00

..

gen_inference_defaults

feat: inferencing default, automatic tool parsing fallback and wire min_p (#9092)

2026-03-22 00:57:15 +01:00

application_config_test.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

application_config.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00

config_suite_test.go

dependencies(grpcio): bump to fix CI issues (#2362)

2024-05-21 14:33:47 +02:00

distributed_config.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

gallery.go

refactor: gallery inconsistencies (#2647)

2024-06-24 17:32:12 +02:00

gguf.go

feat: inferencing default, automatic tool parsing fallback and wire min_p (#9092)

2026-03-22 00:57:15 +01:00

guesser.go

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00

inference_defaults_test.go

feat: inferencing default, automatic tool parsing fallback and wire min_p (#9092)

2026-03-22 00:57:15 +01:00

inference_defaults.go

feat: inferencing default, automatic tool parsing fallback and wire min_p (#9092)

2026-03-22 00:57:15 +01:00

inference_defaults.json

feat: inferencing default, automatic tool parsing fallback and wire min_p (#9092)

2026-03-22 00:57:15 +01:00

model_config_filter.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

model_config_loader.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

model_config_test.go

fix(realtime): Use user provided voice and allow pipeline models to have no backend (#8415)

2026-02-11 14:18:05 +01:00

model_config.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

model_test.go

fix(realtime): Use user provided voice and allow pipeline models to have no backend (#8415)

2026-02-11 14:18:05 +01:00

runtime_settings.go

feat: add node reconciler, allow to schedule to group of nodes, min/max autoscaler (#9186)

2026-03-31 08:28:56 +02:00