mirror/opencloud
1
0 Fork 0
mirror of https://github.com/opencloud-eu/opencloud.git synced 2026-09-13 06:09:21 -04:00
Code Issues Packages Projects Releases Wiki Activity
23,817 Commits 104 Branches 73 Tags
main
Commit Graph
45 Commits
Author SHA1 Message Date
junkerderprovinz 654f0e8e20 fix(postprocessing): retry publishing events instead of killing the server 
A single transient nats: timeout on event publish was fatal to the whole
single-binary server, with no retry despite the service already having
backoff machinery for step failures. Now retries with the same exponential
backoff, capped at half the ack wait so the source event isn't redelivered
to another worker mid-retry. Also stops acking the source event when
publish ultimately fails, so the upload resumes after restart instead of
staying orphaned, and no longer exits during graceful shutdown.
 2026-08-19 11:23:46 +02:00
Jörn Friedrich Dreyer 2d1cc3fb3a stop metrics tickers on context cancel 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2026-04-28 16:18:45 +02:00
Florian Schade 288e67cc39 chore: replace interface with any 2026-04-23 09:31:11 +02:00
Florian Schade 86d79430a3 chore: use wg.Go instead of add 2026-04-22 14:50:57 +02:00
Andre Duffeck 90b29ea3e1 Merge pull request #1319 from aduffeck/remove-in-progress-metric 
Drop the "InProgress" metric
 2025-09-22 10:00:30 +02:00
Juan Pablo Villafáñez 7727c3ff1b fix: linter issue 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez 9e1b80a1be feat: use runners to startup the services 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez c0b4a5daa0 chore: change constant name to camelcase 2025-09-08 17:32:36 +02:00
Juan Pablo Villafáñez ca2dc823ef feat: use names for connections to the nats event bus 2025-09-08 17:32:35 +02:00
André Duffeck cc6681be3b Drop the "InProgress" metric 
It didn't really make sense in multi-node setups because items could be
started and finished on different nodes.
 2025-08-07 20:33:05 +02:00
André Duffeck b4cc781832 Do not try to log metrics when we failed to get the consumer info 
Fixes #1285
 2025-07-29 14:19:00 +02:00
André Duffeck 386e322050 Fix metric 2025-07-18 08:27:06 +02:00
André Duffeck 4704cedd3b Add metrics for the postprocessing duration 2025-07-17 15:23:57 +02:00
André Duffeck 273c0ed270 Expose nats metris for the postprocessing service 2025-07-17 15:23:57 +02:00
André Duffeck de7b659e3d Expose the MaxAckPending and AckWait settings for postprocessing 2025-07-17 09:16:14 +02:00
André Duffeck ad8ac8ee25 Only ack postprocessing events after persisting 2025-07-17 09:16:14 +02:00
André Duffeck e8d35e1280 Use the opencloud reva from now on 2025-01-21 11:16:38 +01:00
Jörn Friedrich Dreyer b07b5a1149 use plain pkg module 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-13 16:42:19 +01:00
Jörn Friedrich Dreyer 8e028f17e9 change module name 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-13 09:58:18 +01:00
Jörn Friedrich Dreyer 139a8a5bd4 fix postprocessing events 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2024-10-22 16:26:37 +02:00
Jörn Friedrich Dreyer 91dc7699d8 postprocessing event workers 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2024-10-22 11:26:50 +02:00
Jörn Friedrich Dreyer d6958f3a3e introduce event processing workers 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2024-10-22 10:13:16 +02:00
Jörn Friedrich Dreyer 72e3e54fe0 make delay only affect the step 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2024-10-22 10:04:56 +02:00
jkoberg 5fed7166b4 feat(alog/pp): introduce impersonating users 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-09-24 18:21:45 +02:00
jkoberg f43397f1ee fix(postprocessing): fix multi-restart 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-06-25 11:32:01 +02:00
jkoberg 3b994e6510 feat(postprocessing): dont retry finished uploads 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-04-26 09:17:45 +02:00
jkoberg 7d990390c3 fix(postprocessing): repair restart logic 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-04-08 11:20:01 +02:00
jkoberg 73a2ee5f87 initiatorid for uploads 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-03-22 15:15:55 +01:00
jkoberg a9ce2e003c allow bulkrestarting postprocessing 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2024-01-26 15:22:48 +01:00
André Duffeck c43b9d9bc6 Allow for retrying postprocessing steps with an exponential backoff 2023-12-12 14:08:21 +01:00
Daniël Franke 97034f4aaa Add tracing to postprocessing service (#7094) 
This adds tracing to the postprocessing service.
 2023-08-23 15:52:26 +02:00
Daniël Franke 8b5687e811 Add tracing to antivirus. 
This PR adds tracing to the Antivirus service.
 2023-08-21 12:04:54 +02:00
Daniël Franke 97dd855a63 Add reusable context. 2023-08-11 12:01:23 +02:00
Daniël Franke 952ebe7d7d Pass context to event publishing. 
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
 2023-08-11 12:01:19 +02:00
jkoberg edc53a80d4 restart complete pp when pp cannot be found 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-07-11 17:35:55 +02:00
jkoberg f23f35e227 improve readme 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-06-13 10:50:07 +02:00
jkoberg 76141a492f add functionality for resending pp events 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-06-13 10:50:07 +02:00
jkoberg a324ad48a0 add a store to postprocessing 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-05-12 11:04:41 +02:00
jkoberg f4ba4e0f64 backport antivirus from experimental 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-03-21 10:04:11 +01:00
Florian SchadeandMartin f38a9f4385 Introduce Policies-Service (#5716) 
* add policies service
add policies proxy middleware
add policies event service
add policies grpc service
prepare ci and git environments (ci, make, readme, doc)

* add webfinger to the drone conf

* fix docs
remove not used virus scan postprocessing step

* relocate example rego file
implicitly enable and disable proxy and postprocessing policy checking by setting the query.
update configuration descriptions

* move policies
update readme

* use converter func to convert pp environment to actual environment
expose and test custom rego functions
add engine unit tests
add opa unit tests
update policies readme

Co-authored-by: Martin <github@diemattels.at>

* relocate sample policies to the deployments folder
change and document policies service port

* update index.md and small fix

* add health command
add version command
add debug server

---------

Co-authored-by: Martin <github@diemattels.at>
 2023-03-14 16:08:22 +01:00
Jörn Friedrich Dreyer 9b00f02383 bump reva to ec27f5f8feb3 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2023-02-15 15:26:07 +00:00
jkoberg ab4d8c3958 move config validation to parser package 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-01-26 14:44:37 +01:00
jkoberg d468a23315 deprecate POSTPROCESSING_VIRUSSCAN 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-01-26 11:50:16 +01:00
jkoberg 22f20b2b2e better configuration for pp service 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2023-01-25 12:32:09 +01:00
jkoberg a004095a6c add postprocessing service 
Signed-off-by: jkoberg <jkoberg@owncloud.com>
 2022-12-08 11:00:42 +01:00