Commit Graph

99 Commits

Author SHA1 Message Date
jkoberg
bd716156fc let ocis init set the serviceaccounts
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg
e09ddc93ea use service accounts for storage-user commands
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:43 +02:00
Daniel Swärd
49fc22d532 Add missing tracing references to multiple services. (#7110) 2023-08-23 15:17:17 +02:00
Christian Richter
d7139d4127 remove deprecated variables
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-08-22 17:25:24 +02:00
jkoberg
49cdcad129 unify eventstream creation
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-16 10:14:12 +02:00
Daniël Franke
952ebe7d7d Pass context to event publishing.
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
2023-08-11 12:01:19 +02:00
André Duffeck
be21178c64 Improve docs 2023-07-31 10:26:19 +02:00
André Duffeck
fade832a3e Make the async propagation delay configurable 2023-07-31 10:26:19 +02:00
André Duffeck
e8a7872d29 Add default propagator config 2023-07-31 10:26:19 +02:00
Andre Duffeck
38c04b5517 Update services/storage-users/pkg/config/config.go
Co-authored-by: Martin <github@diemattels.at>
2023-07-31 10:26:19 +02:00
Andre Duffeck
f17e56febc Update services/storage-users/pkg/config/config.go
Co-authored-by: Martin <github@diemattels.at>
2023-07-31 10:26:19 +02:00
André Duffeck
5aa9e618f1 Make the storage-users propagator configurable 2023-07-31 10:26:19 +02:00
Daniël Franke
063b05140f Convert storage-users to use service tracing.
This converts the storage users service to use the service tracing provider.
2023-07-28 11:25:43 +02:00
mmattel
5f72c61089 envvar text fix and readme addon 2023-07-19 11:06:29 +02:00
Ralf Haferkamp
e32aef17cd storage-users: Add config option for graceful shutdown timeout
Add STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT setting to allow a graceful
shutdown of the storage-users service. This currently only applicable
when running storage-user as a sepearate service.

Setting STORAGE_USERS_GRACEFUL_SHUTDOWN_TIMEOUT to a non-zero value
gives the storage-users service a chance to cleanly shutdown and finish
any in progess tasks (e.g. metadata propagation) before exiting.

Partial-Fix: #6602
2023-07-18 16:47:26 +02:00
mmattel
6ad53971ef [docs-only] Increase readability for log level values in the description 2023-07-07 10:33:42 +02:00
mmattel
d7b447b791 [docs-only] Increase readability for tracing values in the description 2023-07-07 09:50:39 +02:00
mmattel
758192bd6d [docs-only] Fix some envvar descriptions 2023-06-09 13:03:17 +02:00
Florian Schade
4f26424db6 [full-ci] enhancement: use reva client pool selectors (#6452)
* enhancement: use reva client pool selectors

register mock service to registry and pass tests

* enhancement: bump reva

* Fix a couple of linter issues

---------

Co-authored-by: Ralf Haferkamp <rhaferkamp@owncloud.com>
2023-06-08 12:41:04 +02:00
jkoberg
d347448ec0 remove duplicated sutureservice code
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-02 12:02:27 +02:00
Jörn Friedrich Dreyer
b8bdd4573a introduce otlp tracing (#5132)
* introduce otel tracing

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use new trace provider initialization

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* work

* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* remove commented code

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add vendor changes

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-05-26 22:21:03 +02:00
jkoberg
70391a0bf2 unify CACERT envvars
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-25 13:32:37 +02:00
jkoberg
2a5caf74e8 idcache configuration
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-22 09:51:37 +02:00
mmattel
e5746d8176 [docs-only] Fix wrong default metadata backend 2023-05-12 13:34:13 +02:00
Martin
edbecf0aa5 Merge pull request #6244 from owncloud/upload_expiration_warning
[docs-only] Add note that uploads could be canceled when setting is too low
2023-05-05 14:26:53 +02:00
mmattel
ab50b9efd1 [docs-only] Add note that uploads could be canceled when setting is too low 2023-05-05 12:57:46 +02:00
mmattel
14e577d452 [docs-only] An envvar in the storage-users service needs separation by semicolon 2023-05-05 12:38:39 +02:00
mmattel
037422ba1f [docs-only] Set messagepack as default metadata backend 2023-05-03 12:22:09 +02:00
mmattel
f8ede78461 [docs-only] Fix that envvars use messagepack instead of ini as supported values. 2023-04-27 14:38:50 +02:00
Andre Duffeck
129489203b Cleanup and improve the caching config (#6148)
* Cleanup and improve the caching config

* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* disable stat cache

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Bump reva

* Linter fixes

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-04-27 12:35:30 +02:00
Andre Duffeck
77bb3d8bcd [full-ci] Refactor stores (#6019)
* Streamline the store implementation with and into reva

* Adapt to the cache/store refactoring in reva

* Streamline config options and their env vars

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

* Use the same database for all stores

* Bump reva

* Configure stat and filemetadata cache separately

* Fix default config

---------

Co-authored-by: Martin <github@diemattels.at>
2023-04-24 15:13:35 +02:00
mmattel
8ed34926ef [docs-only] Correct the removal version according semver to 4.0.0 2023-04-19 10:16:06 +02:00
Daniel Swärd
46e50b3a70 Reapply name change, without adding files by mistake. 2023-04-05 13:26:29 +02:00
Daniel Swärd
a693a18b99 Revert "Change new name to address PR comment."
This reverts commit 8911ca2e98.
2023-04-05 13:25:04 +02:00
Daniel Swärd
8911ca2e98 Change new name to address PR comment. 2023-04-05 12:26:56 +02:00
Daniel Swärd
afbfd2d6b2 Deprecating and renaming many environment variables
Fixes #5767
Fixes #5905
Fixes #5532
2023-04-05 11:05:48 +02:00
Roman Perekhod
fcfb2ab9fa Introduced global OCIS_EVENTS_ENDPOINT and OCIS_EVENTS_CLUSTER #5901 2023-04-04 15:43:03 +02:00
Dennis Sieben
e28603e633 - fixed typos 2023-03-27 08:54:51 +02:00
Andre Duffeck
0bc471007e Make the number of concurrent goroutines in decomposedfs configurable (#5887)
* Make the number of concurrent goroutines in decomposedfs configurable

* Update services/storage-users/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

* Update services/storage-users/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Martin <github@diemattels.at>
2023-03-24 10:49:51 +01:00
Jörn Friedrich Dreyer
6bec87f582 Proxy accesstoken cache store (#5829)
* refactor middleware options

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use ocmemstore micro store implementaiton for token cache

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* refactor ocis store options, support redis sentinel

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* align cache configuration

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* database and tabe are used to build prefixes for inmemory stores

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add global persistent store options to userlog config

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* log cache errors but continue

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* drup unnecessary type conversion

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Better description for the default userinfo ttl

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use global cache options for even more caches

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* don't log userinfo cache misses

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* default to stock memory store

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use correct mem store typo string

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* split cache options, doc cleanup

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* mint and write userinfo to cache async

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* use hashed token as key

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* go mod tidy

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update docs

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update cache store naming

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* bring back depreceted ocis-pkg/store package for backwards compatability

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update changelog

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Apply suggestions from code review

Co-authored-by: kobergj <jkoberg@owncloud.com>

* revert ocis-pkg/cache to store rename

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* add waiting for each step 50 milliseconds

* starlack check

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: kobergj <jkoberg@owncloud.com>
Co-authored-by: Viktor Scharf <scharf.vi@gmail.com>
2023-03-22 15:21:57 +01:00
David Christofas
924c2ca346 add missing comments 2023-03-06 19:01:16 +01:00
David Christofas
63fa35fa50 reduce duplication in configuration code 2023-03-06 16:52:44 +01:00
Andre Duffeck
8b68830201 [full-ci] Improve ini backend, support redis sentinel caches (#5737)
* Configure the file metadata cache for storage-users

* Also configure the cache for the system storage

* Update services/storage-system/pkg/config/config.go

Co-authored-by: Martin <github@diemattels.at>

* Improve documentation

* Bump reva to pull in the latest ini backend changes

* Fix missing comment

* Update services/storage-users/README.md

Co-authored-by: Martin <github@diemattels.at>

* Update services/storage-system/README.md

Co-authored-by: Martin <github@diemattels.at>

* Tweak docs

* Apply suggestions from code review

Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Martin <github@diemattels.at>
Co-authored-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-03-06 15:04:19 +01:00
mmattel
f526326d67 Add a global variable for the metadata backend 2023-02-28 11:09:52 +01:00
Martin
53cb40ff5e Merge pull request #5634 from owncloud/update_quota_text
[docs-only] Update quota related texts and descriptions
2023-02-23 12:43:43 +01:00
jkoberg
733c9c25e5 add comments to exported structs
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-02-23 11:44:23 +01:00
Jörn Friedrich Dreyer
a5fb068650 [full-ci] Bump reva to include ini metadata backend (#5613)
* bump reva

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* default to ini backend

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* bump reva, add metadata backend config

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* update changelog

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* fix tag

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Update services/storage-system/pkg/config/config.go

Co-authored-by: kobergj <jkoberg@owncloud.com>

* fix storage user metadata config desc and env var

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: kobergj <jkoberg@owncloud.com>
2023-02-23 10:54:50 +01:00
mmattel
7f706f38cc update quota text 2023-02-23 10:19:07 +01:00
David Christofas
3fbb6ca2fe Merge pull request #5617 from owncloud/role-quota
add config option to set default quota per role
2023-02-22 17:08:16 +01:00
David Christofas
17b5706cc9 add config options for the max_quota and add the capability value 2023-02-22 16:22:51 +01:00