Commit Graph

69 Commits

Author SHA1 Message Date
Juan Pablo Villafáñez
c0b4a5daa0 chore: change constant name to camelcase 2025-09-08 17:32:36 +02:00
Juan Pablo Villafáñez
925444a0b3 feat: change the names of the connections to the registry 2025-09-08 17:32:35 +02:00
Ralf Haferkamp
88dd36b636 Drop the unsupported and unused S3 driver
It was dropped from reva in https://github.com/opencloud-eu/reva/pull/309
because of unmaintained dependencies. Remember: We have the decomposeds3
driver.
2025-08-21 11:15:35 +02:00
André Duffeck
8c9e05d1f0 Expose more config vars for the posix fs watchers 2025-04-16 11:08:03 +02:00
André Duffeck
91fd396c86 Add env var to make the inotify stats frequency configurable 2025-04-15 09:24:55 +02:00
André Duffeck
054c87b3fd Enable scan/watch in the storageprovider only 2025-04-01 14:46:20 +02:00
André Duffeck
255f45034a Add more missing options to posix fs 2025-03-19 12:23:28 +01:00
André Duffeck
57836949d8 Add missing config bits to the posix driver 2025-03-19 12:23:28 +01:00
André Duffeck
38c521e54a Support OC_SPACES_MAX_QUOTA with the posix driver 2025-03-19 12:21:58 +01:00
Jörn Friedrich Dreyer
74b6078158 bump reva, change decomposeds3 drivername
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-02-20 11:07:31 +01:00
André Duffeck
d42034202d Add option to disable the posix fs watcher 2025-02-13 13:11:49 +01:00
André Duffeck
5b85029813 Add EnableFSRevisions config option 2025-02-13 10:07:17 +01:00
André Duffeck
57fa8eb43c Switch from ocis/s3ng to decomposed/decomposed_s3 storage drivers
ocis/s3ng are still supported for backwards compatibility reasons, but
they need to be configured using the decomposed/decomposed_s3 options.
2025-01-24 11:04:23 +01:00
André Duffeck
2b9e193584 Rebrand storage-users 2025-01-17 11:44:18 +01:00
Jörn Friedrich Dreyer
318ca21645 metrics, log and supervisor
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-01-14 16:09:54 +01:00
Jörn Friedrich Dreyer
8e028f17e9 change module name
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-01-13 09:58:18 +01:00
jkoberg
c80254c4f1 feat(ocis): remove ocm store
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-10-15 17:24:51 +02:00
jkoberg
4a911ac047 feat(storage-users): remove metadata backend envvar
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-09-19 12:29:41 +02:00
André Duffeck
d199e79c71 Set a default debounce delay 2024-09-17 10:33:32 +02:00
Jörn Friedrich Dreyer
99c6b6648e no need to introduce dedicated roles
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-08-13 16:10:19 +02:00
André Duffeck
f5de0a09cf Enable caching for the xattrs backend 2024-07-12 08:39:30 +02:00
Andre Duffeck
b8e7160880 Merge pull request #9460 from aduffeck/posixfs-events
Fix posixfs events
2024-07-08 08:35:05 +02:00
jkoberg
dcac0cf201 feat(storage-provider): add option to disable versioning
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-27 15:48:03 +02:00
André Duffeck
0028013794 Enable async uploads for posixfs 2024-06-25 08:40:50 +02:00
André Duffeck
b51cae14ba Onle enable fs-watching for the storageprovider, not the dataprovider
We need to make sure that the storageprovider tree is used for watching
the fs and not the dataprovider, because the dataprovider doesn't have a
mount_id set which is needed to emit proper events.
2024-06-25 08:40:50 +02:00
André Duffeck
5781723432 Add missing events config 2024-06-25 08:40:50 +02:00
André Duffeck
126b083eaf Add config var for using the space groups 2024-05-29 12:14:54 +02:00
André Duffeck
8cd39754c7 Add config vars for space path templates 2024-05-29 12:14:54 +02:00
André Duffeck
4517c5ee19 Make the list of gpfs watchfolder kafka brokers configurable 2024-05-29 12:14:54 +02:00
André Duffeck
2cf823157f Expose the idcache configuration 2024-05-29 12:14:54 +02:00
André Duffeck
69c84e0ee6 Expose the fs watcher configuration 2024-05-29 12:14:53 +02:00
André Duffeck
96645322e7 Configure project spaces layout 2024-05-29 12:14:53 +02:00
André Duffeck
b231457231 Enable treetime and treesize accounting 2024-05-29 12:14:53 +02:00
André Duffeck
aab219a38f Initial support for the posixfs 2024-05-29 12:14:53 +02:00
Jörn Friedrich Dreyer
5ed57cc09a Bump reva deps (#8412)
* bump dependencies

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* bump reva and add config options

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2024-02-21 10:20:36 +01:00
jkoberg
cec6ea50eb remove unused stat cache
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-24 10:39:32 +01:00
jkoberg
13bb2785d4 fix cache authentication
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-24 10:39:30 +01:00
jkoberg
10628f399d fix events authentication
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-01-24 10:39:09 +01:00
jkoberg
0d1669b3bd allowing disabling persistence of caches
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-12-15 13:25:10 +01:00
jkoberg
49cdcad129 unify eventstream creation
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-16 10:14:12 +02:00
André Duffeck
fade832a3e Make the async propagation delay configurable 2023-07-31 10:26:19 +02:00
André Duffeck
5aa9e618f1 Make the storage-users propagator configurable 2023-07-31 10:26:19 +02:00
Daniël Franke
063b05140f Convert storage-users to use service tracing.
This converts the storage users service to use the service tracing provider.
2023-07-28 11:25:43 +02:00
Ralf Haferkamp
e32aef17cd storage-users: Add config option for graceful shutdown timeout
Add STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT setting to allow a graceful
shutdown of the storage-users service. This currently only applicable
when running storage-user as a sepearate service.

Setting STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT to a non-zero value
gives the storage-users service a chance to cleanly shutdown and finish
any in progess tasks (e.g. metadata propagation) before exiting.

Partial-Fix: #6602
2023-07-18 16:47:26 +02:00
Jörn Friedrich Dreyer
b8bdd4573a introduce otlp tracing (#5132)
* introduce otel tracing

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use new trace provider initialization

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* work

* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* remove commented code

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add vendor changes

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-05-26 22:21:03 +02:00
jkoberg
2a5caf74e8 idcache configuration
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-22 09:51:37 +02:00
Andre Duffeck
129489203b Cleanup and improve the caching config (#6148)
* Cleanup and improve the caching config

* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* disable stat cache

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Bump reva

* Linter fixes

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-04-27 12:35:30 +02:00
Andre Duffeck
77bb3d8bcd [full-ci] Refactor stores (#6019)
* Streamline the store implementation with and into reva

* Adapt to the cache/store refactoring in reva

* Streamline config options and their env vars

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* Use the same database for all stores

* Bump reva

* Configure stat and filemetadata cache separately

* Fix default config

---------

Co-authored-by: Martin <github@diemattels.at>
2023-04-24 15:13:35 +02:00
Andre Duffeck
0bc471007e Make the number of concurrent goroutines in decomposedfs configurable (#5887)
* Make the number of concurrent goroutines in decomposedfs configurable

* Update services/storage-users/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

* Update services/storage-users/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Martin <github@diemattels.at>
2023-03-24 10:49:51 +01:00
Andre Duffeck
8b68830201 [full-ci] Improve ini backend, support redis sentinel caches (#5737)
* Configure the file metadata cache for storage-users

* Also configure the cache for the system storage

* Update services/storage-system/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

* Improve documentation

* Bump reva to pull in the latest ini backend changes

* Fix missing comment

* Update services/storage-users/README.md

Co-authored-by: Martin <github@diemattels.at>

* Update services/storage-system/README.md

Co-authored-by: Martin <github@diemattels.at>

* Tweak docs

* Apply suggestions from code review

Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Martin <github@diemattels.at>
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-03-06 15:04:19 +01:00