Ettore Di Giacinto 092bb0bd6b fix(base-grpc): close channel in base grpc server (#3734) ...

If the LLM does not implement any logic for PredictStream, we close the
channel immediately to not leave the process hanging.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2024-10-05 15:14:27 +02:00

..

base.go

fix(base-grpc): close channel in base grpc server (#3734)

2024-10-05 15:14:27 +02:00

singlethread.go

chore: fix go.mod module (#2635)

2024-06-23 08:24:36 +00:00