mirror/opencloud
1
0
Fork 0
mirror of https://github.com/opencloud-eu/opencloud.git synced 2026-01-07 05:30:41 -05:00
Code Issues Packages Projects Releases Wiki Activity
22,128 Commits 49 Branches 39 Tags
fix-dev-docker
Commit Graph

292 Commits

Author SHA1 Message Date
Roman Perekhod
d76afadd4d clean up 2025-09-12 12:18:47 +02:00
Roman Perekhod
9a3fc08dd4 to separate controll ower the http and grpc driven services 2025-09-12 12:18:47 +02:00
Roman Perekhod
65d05bbd5c feat: fix the graceful shutdown using the new ocis and reva runners 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez
c0b4a5daa0 chore: change constant name to camelcase 2025-09-08 17:32:36 +02:00
Juan Pablo Villafáñez
925444a0b3 feat: change the names of the connections to the registry 2025-09-08 17:32:35 +02:00
Juan Pablo Villafáñez
ca2dc823ef feat: use names for connections to the nats event bus 2025-09-08 17:32:35 +02:00
Ralf Haferkamp
88dd36b636 Drop the unsupported and unused S3 driver 
It was dropped from reva in https://github.com/opencloud-eu/reva/pull/309
because of unmaintained dependencies. Remember: We have the decomposeds3
driver.
 2025-08-21 11:15:35 +02:00
Jörn Friedrich Dreyer
2751cfee2c directly connect to frontend 
The STORAGE_USERS_DATA_GATEWAY_URL env var is used in the `tokens` `datagateway_endpoint` reva configuration. That `DataGatewayEndpoint` is used by the decomposedfs driver to create urls:
```go
// URL returns a url to download an upload
func (session *DecomposedFsSession) URL(_ context.Context) (string, error) {
       // [ ... ]
	return joinurl(session.store.tknopts.DataGatewayEndpoint, tkn), nil
}
```
As the comment points out this URL is internally used when emitting events. Either in:
```go
func (session *DecomposedFsSession) FinishUploadDecomposed(ctx context.Context) error {
                // [ ... ]
		s, err := session.URL(ctx)
		if err != nil {
			return err
		}

		var iu *userpb.User
		if utils.ExistsInOpaque(u.Opaque, "impersonating-user") {
			iu = &userpb.User{}
			if err := utils.ReadJSONFromOpaque(u.Opaque, "impersonating-user", iu); err != nil {
				return err
			}
		}

		if err := events.Publish(ctx, session.store.pub, events.BytesReceived{
			UploadID:          session.ID(),
			URL:               s,
```

or in
```go

// Postprocessing starts the postprocessing result collector
func (fs *Decomposedfs) Postprocessing(ch <-chan events.Event) {
                        // [ ... ]
			s, err := session.URL(ctx)
			if err != nil {
				sublog.Error().Err(err).Msg("could not create url")
				continue
			}

			metrics.UploadSessionsRestarted.Inc()

			// restart postprocessing
			if err := events.Publish(ctx, fs.stream, events.BytesReceived{
				UploadID:      session.ID(),
				URL:           s,
```

So, we do not need to go throught the proxy here.
 2025-08-19 14:58:30 +02:00
Michael Stingl
9659e97056 Fix posix driver documentation in STORAGE_USERS_DRIVER description (#1305) 
- Add 'posix' to the list of supported values
- Correct the default value from 'decomposed' to 'posix'
- Add brief description of the posix driver

Fixes: #1304
 2025-08-06 17:46:44 +02:00
Michael Barz
2d24c27329 change: adjust default values for the S3 Uploads (#1224) 2025-07-14 16:43:43 +02:00
Michael Barz
db5ac0a4e2 change: set better decomposedS3 defaults for multipart upload (#1200) 2025-07-10 09:20:39 +02:00
Ralf Haferkamp
96684df32d Adjust to new tablewriter release 2025-05-19 19:26:38 +02:00
Ralf Haferkamp
24da3687d9 Makefile: remove unneeded recursion.mk 
The MAKE_DEPTH variable is not used anywhere anymore.
 2025-04-22 16:57:17 +02:00
Florian Schade
900d596b65 fix(decomposeds3): enable async-uploads by default (#686) 2025-04-17 09:17:53 +02:00
André Duffeck
f8c89b1c3d Add deprecation notice for STORAGE_USERS_POSIX_WATCH_FOLDER_KAFKA_BROKERS 2025-04-16 11:09:30 +02:00
André Duffeck
8c9e05d1f0 Expose more config vars for the posix fs watchers 2025-04-16 11:08:03 +02:00
André Duffeck
91fd396c86 Add env var to make the inotify stats frequency configurable 2025-04-15 09:24:55 +02:00
André Duffeck
09818a9d7e Adapt command to changed signature 2025-04-01 15:04:53 +02:00
André Duffeck
054c87b3fd Enable scan/watch in the storageprovider only 2025-04-01 14:46:20 +02:00
Andre Duffeck
8bc17593cb Merge pull request #459 from rhafer/issue/447 
fix cli driver initialization for "posix"
 2025-03-24 22:32:28 +01:00
Klaas Freitag
f94eedaee3 Clean invalid documentation links 2025-03-24 17:23:20 +01:00
Ralf Haferkamp
44dea094d7 fix cli driver initialization for "posix" 
Fixes: #447
 2025-03-24 12:16:32 +01:00
Ralf Haferkamp
544b354a42 fix(storage-users): 'uploads sessions' command crash 
When started with the '--resume' command line switch the
'storage-users uploads sessions' was crashing because it did not
initialize the event queue correctly.

Fixes: #390
 2025-03-20 16:02:56 +01:00
André Duffeck
255f45034a Add more missing options to posix fs 2025-03-19 12:23:28 +01:00
André Duffeck
57836949d8 Add missing config bits to the posix driver 2025-03-19 12:23:28 +01:00
André Duffeck
38c521e54a Support OC_SPACES_MAX_QUOTA with the posix driver 2025-03-19 12:21:58 +01:00
Jörn Friedrich Dreyer
15cb8680ef change storage users default to posixfs 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-03-19 12:21:58 +01:00
Ralf Haferkamp
90328a7ed1 posixfs: Use userid as the foldername for personal space 
This avoids loosing the user's personal space after renaming the user.

Closes: #192
 2025-03-17 10:54:52 +01:00
André Duffeck
916c79e856 Make space aliases configure for the posix driver 2025-03-13 15:35:45 +01:00
Artur Neumann
b075b177d6 tests: add pipeline config (#341) 
Co-authored-by: Michael Barz <michael.barz@zeitgestalten.eu>
 2025-03-12 12:22:13 +05:45
Ralf Haferkamp
48edc9a5d1 Reintroduce check for go before including bingo Makefile 
This re-adds the check for go being installed before including the
bingo variables make file to avoid repeating errors about missing a
missing go binary when running 'make node-generate' in the ci (the node
container doesn't have go installed)
 2025-03-11 11:19:20 +01:00
Florian Schade
dbafbaa333 fix: remove deprecations and use go-generate instead of go-generate-STAGE 2025-03-06 11:56:09 +01:00
Florian Schade
da1963cfa4 enhancement: split make ci-node-generate and ci-go-generate into prod and dev stages 2025-03-05 17:32:37 +01:00
Ralf Haferkamp
8e1f68f315 Reset 'introductionVersion" struct tag to 1.0.0 2025-02-24 11:40:33 +01:00
Jörn Friedrich Dreyer
74b6078158 bump reva, change decomposeds3 drivername 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-02-20 11:07:31 +01:00
Jörn Friedrich Dreyer
37404fda7e drop unused STORAGE_USERS_STAT_CACHE_STORE env var from readme 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-02-17 10:31:31 +01:00
André Duffeck
d42034202d Add option to disable the posix fs watcher 2025-02-13 13:11:49 +01:00
André Duffeck
5b85029813 Add EnableFSRevisions config option 2025-02-13 10:07:17 +01:00
André Duffeck
57fa8eb43c Switch from ocis/s3ng to decomposed/decomposed_s3 storage drivers 
ocis/s3ng are still supported for backwards compatibility reasons, but
they need to be configured using the decomposed/decomposed_s3 options.
 2025-01-24 11:04:23 +01:00
André Duffeck
e8d35e1280 Use the opencloud reva from now on 2025-01-21 11:16:38 +01:00
André Duffeck
2b9e193584 Rebrand storage-users 2025-01-17 11:44:18 +01:00
Jörn Friedrich Dreyer
243ffe81c7 nats cluster name 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-16 16:14:22 +01:00
Jörn Friedrich Dreyer
db39b8ed3b use opencloudurl 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-16 11:13:08 +01:00
Ralf Haferkamp
213e9663a9 Rename go-micro services 2025-01-16 09:45:46 +01:00
Jörn Friedrich Dreyer
318ca21645 metrics, log and supervisor 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-14 16:09:54 +01:00
Jörn Friedrich Dreyer
56f57149ad the OpenCloud services 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-14 12:50:23 +01:00
Jörn Friedrich Dreyer
97250d5b06 error init cli hints 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-14 12:48:01 +01:00
Jörn Friedrich Dreyer
5aa5ab843a ociscfg -> occfg 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-14 12:44:00 +01:00
Jörn Friedrich Dreyer
b07b5a1149 use plain pkg module 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-13 16:42:19 +01:00
Jörn Friedrich Dreyer
a46fd132bd use OC_ env prefix 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-01-13 16:11:11 +01:00