Increase logicFunctionQueue worker concurrency to 10 (#21364)

## Summary
- Increase BullMQ worker concurrency for `logicFunctionQueue` from 1
(default) to 10
- Logic function executions are I/O-bound Lambda calls — the worker just
holds an HTTP connection open, so higher concurrency doesn't add
CPU/memory pressure
- With 13 worker pods, this goes from 13 to ~130 concurrent slots, which
should resolve the ~3h average queue latency observed in Grafana

## Test plan
- [ ] Monitor `avg_latency_ms` for `logic-function-queue` in the Grafana
job queue dashboard after deploy
- [ ] Verify worker pod CPU/memory remains stable
This commit is contained in:
Thomas Trompette
2026-06-09 14:47:53 +02:00
committed by GitHub
parent ed7ff4a84b
commit e9086b49f6

View File

@@ -4,4 +4,5 @@ export const QUEUE_WORKER_OPTIONS: Partial<
Record<MessageQueue, { concurrency: number }>
> = {
[MessageQueue.aiStreamQueue]: { concurrency: 20 },
[MessageQueue.logicFunctionQueue]: { concurrency: 10 },
};