Commit Graph

41 Commits

Author SHA1 Message Date
Andre Duffeck
90b29ea3e1 Merge pull request #1319 from aduffeck/remove-in-progress-metric
Drop the "InProgress" metric
2025-09-22 10:00:30 +02:00
Juan Pablo Villafáñez
7727c3ff1b fix: linter issue 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez
9e1b80a1be feat: use runners to startup the services 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez
c0b4a5daa0 chore: change constant name to camelcase 2025-09-08 17:32:36 +02:00
Juan Pablo Villafáñez
ca2dc823ef feat: use names for connections to the nats event bus 2025-09-08 17:32:35 +02:00
André Duffeck
cc6681be3b Drop the "InProgress" metric
It didn't really make sense in multi-node setups because items could be
started and finished on different nodes.
2025-08-07 20:33:05 +02:00
André Duffeck
b4cc781832 Do not try to log metrics when we failed to get the consumer info
Fixes #1285
2025-07-29 14:19:00 +02:00
André Duffeck
386e322050 Fix metric 2025-07-18 08:27:06 +02:00
André Duffeck
4704cedd3b Add metrics for the postprocessing duration 2025-07-17 15:23:57 +02:00
André Duffeck
273c0ed270 Expose nats metris for the postprocessing service 2025-07-17 15:23:57 +02:00
André Duffeck
de7b659e3d Expose the MaxAckPending and AckWait settings for postprocessing 2025-07-17 09:16:14 +02:00
André Duffeck
ad8ac8ee25 Only ack postprocessing events after persisting 2025-07-17 09:16:14 +02:00
André Duffeck
e8d35e1280 Use the opencloud reva from now on 2025-01-21 11:16:38 +01:00
Jörn Friedrich Dreyer
b07b5a1149 use plain pkg module
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-01-13 16:42:19 +01:00
Jörn Friedrich Dreyer
8e028f17e9 change module name
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-01-13 09:58:18 +01:00
Jörn Friedrich Dreyer
139a8a5bd4 fix postprocessing events
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-10-22 16:26:37 +02:00
Jörn Friedrich Dreyer
91dc7699d8 postprocessing event workers
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-10-22 11:26:50 +02:00
Jörn Friedrich Dreyer
d6958f3a3e introduce event processing workers
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-10-22 10:13:16 +02:00
Jörn Friedrich Dreyer
72e3e54fe0 make delay only affect the step
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-10-22 10:04:56 +02:00
jkoberg
5fed7166b4 feat(alog/pp): introduce impersonating users
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-09-24 18:21:45 +02:00
jkoberg
f43397f1ee fix(postprocessing): fix multi-restart
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-25 11:32:01 +02:00
jkoberg
3b994e6510 feat(postprocessing): dont retry finished uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-04-26 09:17:45 +02:00
jkoberg
7d990390c3 fix(postprocessing): repair restart logic
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-04-08 11:20:01 +02:00
jkoberg
73a2ee5f87 initiatorid for uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-03-22 15:15:55 +01:00
jkoberg
a9ce2e003c allow bulkrestarting postprocessing
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-26 15:22:48 +01:00
André Duffeck
c43b9d9bc6 Allow for retrying postprocessing steps with an exponential backoff 2023-12-12 14:08:21 +01:00
Daniël Franke
97034f4aaa Add tracing to postprocessing service (#7094)
This adds tracing to the postprocessing service.
2023-08-23 15:52:26 +02:00
Daniël Franke
8b5687e811 Add tracing to antivirus.
This PR adds tracing to the Antivirus service.
2023-08-21 12:04:54 +02:00
Daniël Franke
97dd855a63 Add reusable context. 2023-08-11 12:01:23 +02:00
Daniël Franke
952ebe7d7d Pass context to event publishing.
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
2023-08-11 12:01:19 +02:00
jkoberg
edc53a80d4 restart complete pp when pp cannot be found
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-07-11 17:35:55 +02:00
jkoberg
f23f35e227 improve readme
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-13 10:50:07 +02:00
jkoberg
76141a492f add functionality for resending pp events
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-13 10:50:07 +02:00
jkoberg
a324ad48a0 add a store to postprocessing
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-12 11:04:41 +02:00
jkoberg
f4ba4e0f64 backport antivirus from experimental
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-03-21 10:04:11 +01:00
Florian Schade
f38a9f4385 Introduce Policies-Service (#5716)
* add policies service
add policies proxy middleware
add policies event service
add policies grpc service
prepare ci and git environments (ci, make, readme, doc)

* add webfinger to the drone conf

* fix docs
remove not used virus scan postprocessing step

* relocate example rego file
implicitly enable and disable proxy and postprocessing policy checking by setting the query.
update configuration descriptions

* move policies
update readme

* use converter func to convert pp environment to actual environment
expose and test custom rego functions
add engine unit tests
add opa unit tests
update policies readme

Co-authored-by: Martin <github@diemattels.at>

* relocate sample policies to the deployments folder
change and document policies service port

* update index.md and small fix

* add health command
add version command
add debug server

---------

Co-authored-by: Martin <github@diemattels.at>
2023-03-14 16:08:22 +01:00
Jörn Friedrich Dreyer
9b00f02383 bump reva to ec27f5f8feb3
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-02-15 15:26:07 +00:00
jkoberg
ab4d8c3958 move config validation to parser package
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-01-26 14:44:37 +01:00
jkoberg
d468a23315 deprecate POSTPROCESSING_VIRUSSCAN
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-01-26 11:50:16 +01:00
jkoberg
22f20b2b2e better configuration for pp service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-01-25 12:32:09 +01:00
jkoberg
a004095a6c add postprocessing service
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2022-12-08 11:00:42 +01:00