Commit Graph

4447 Commits

Author SHA1 Message Date
Pascal Bleser
aaf94d32be refactor(groupware): logging and metrics improvements
* some minor code refactorings to improve logging and metrics

 * more code documentation
2026-04-13 16:39:51 +02:00
Pascal Bleser
baebc91b8d groupware: improve metrics
* implement more metrics, in a more streamlined fashion

 * use concurrent-map to store SSE streams instead of a regular map with
   one big lock that will not scale when it grows, causing too much
   contention on that one lock

 * while testing error metrics, noticed a few bugs with error handling
   when Stalwart is down: fixed
2026-04-13 16:39:51 +02:00
Pascal Bleser
934178ae6a groupware: implement metrics
* implement a framework for metrics, with a few exemplary ones
2026-04-13 16:39:51 +02:00
Pascal Bleser
f85a527591 groupware: Etag handling
* implement correct Etag and If-None-Match handling, responding with
   304 Not Modified if they match

 * introduce SessionState and State string type aliases to ensure we are
   using the correct fields for those, respectively

 * extract the SessionState from the JMAP response bodies in the
   groupware framework instead of having to do that in every single
   groupware API

 * use uint instead of int in some places to clarify that the values are
   >= 0

 * trace-log how long a Session was held in cache before being evicted

 * add Trace-Id header handling: add to response when specified in
   request, and implement a custom request logger to include it as a
   field

 * implement a more compact trace-logging of all the methods and URIs
   that are served, to put them into a single log entry instead of
   creating one log entry for every URI
2026-04-13 16:39:51 +02:00
Pascal Bleser
b06596ebd4 groupware: initial related emails implementation with SSE 2026-04-13 16:39:51 +02:00
Pascal Bleser
c8660a635e groupware: add /bootstrap
* add a GET /accounts/{a}/boostrap URI that delivers the same as GET /
   but also mailboxes for a given account, in case the UI remembers the
   last used account identifier, to avoid an additional roundtrip

 * streamline the use of simpleError()

 * add logging of errors at the calling site

 * add logging of evictions of Sessions from the cache

 * change default Session cache TTL to 5min instead of 30sec
2026-04-13 16:39:51 +02:00
Pascal Bleser
4abf0b4364 groupware: swagger API documentation improvements
* add more documentation for properties

 * fixes after a bit of trial-and-error with go-swagger

 * fix email filter marshalling when there are no search criteria

 * introduce an apidoc.yml that contains Swagger data and is merged when
   generating the swagger.yml from sources
2026-04-13 16:39:51 +02:00
Pascal Bleser
5f3d4ce610 Groupware improvements
* ensure that all the jmap responses contain the SessionState

 * implement missing errors that were marked as TODO

 * moved common functions from pkg/jmap and pkg/services/groupware to
   pkg/log and pkg/structs to commonalize them across both source trees

 * implement error handling for SetError occurences

 * Email: replace anonymous map[string]bool for mailbox rights with a
   MailboxRights struct, as the keys are well-defined, which allows for
   properly documenting them

 * introduce ObjectType as an "enum"

 * fix JSON marshalling and unmarshalling of EmailBodyStructure

 * move the swagger documentation structs from groupware_api.go to
   groupware_docs.go

 * fix: change verb for /groupware/accounts/*/vacation from POST to PUT
2026-04-13 16:39:51 +02:00
Pascal Bleser
cdfd76c148 groupware: minor email searching response improvements + started implementing vacation response setting API 2026-04-13 16:39:51 +02:00
Pascal Bleser
a3bc0c0066 groupware: add identities of all accounts to the index resource 2026-04-13 16:39:51 +02:00
Pascal Bleser
8b6fbb6a3b groupware: fix email search, add variant that includes the full emails 2026-04-13 16:39:51 +02:00
Pascal Bleser
f2106ec809 groupware: fix email search, add variant that includes the full emails 2026-04-13 16:39:51 +02:00
Pascal Bleser
dd3c6a1f7f Groupware: refactor jmap package, implement Email/set, EmailSubmission
* refactor the jmap package to split it into several files as the
   jmap.api.go file was becoming too unwieldy

 * refactor the Groupware handler function response to be a Response
   object, to be more future-proof and avoid adding more and more
   return parameters while handling "no content" response as well

 * more godoc for the JMAP model

 * add Email creation, updating, deleting (Email/set,
   EmailSubmission/set)

 * add endpoints
   - POST /accounts/{accountid}/messages
   - PATCH|PUT /accounts/{accountid}/messages/{messageid}
   - DELETE /accounts/{accountid}/messages/{messageid}
2026-04-13 16:39:51 +02:00
Pascal Bleser
36537b88e4 groupware: implement message search with snippets 2026-04-13 16:39:51 +02:00
Pascal Bleser
e3e58e28c1 groupware: blob streaming (upload and download) 2026-04-13 16:39:51 +02:00
Pascal Bleser
3fd0661eb7 groupware: more JMAP operations implementation 2026-04-13 16:39:51 +02:00
Pascal Bleser
bb99be8732 groupware: further implementation and improvements 2026-04-13 16:39:51 +02:00
Pascal Bleser
ff579adc3b refactored the Session object, refactored the services/groupware directory, and started Swagger documentation implementation 2026-04-13 16:39:51 +02:00
Pascal Bleser
975ce31d56 groupware: refactoring the API mechanisms 2026-04-13 16:39:51 +02:00
Pascal Bleser
c093527c3d groupware: implement JSON:API's error response format, with a revamped error handling in jmap and services/groupware 2026-04-13 16:39:51 +02:00
Pascal Bleser
2c1ccbb22e Refactor groupware service after ADR decision on the Groupware API
* after having decided that the Groupware API should be a standalone
   independent custom REST API that is using JMAP data models as much as
   possible,
 * removed Groupware APIs from the Graph service
 * moved Groupware implementation to the Groupware service, and
   refactored a few things accordingly
2026-04-13 16:39:51 +02:00
Pascal Bleser
cff4f55633 Groupware and jmap: cleanup and API documentation 2026-04-13 16:39:51 +02:00
Pascal Bleser
241fd4aa70 groupware: remove unneeded messages.go that was a remainder from an earlier implementation attempt, which also fixes compilation issues due to changes in main 2026-04-13 16:39:51 +02:00
Pascal Bleser
2f582858b5 Groupware improvements: refactoring, k6 tests
* refactored the models to be strongly typed with structs and mapstruct
   to decompose the dynamic parts of the JMAP payloads

 * externalized large JSON strings for tests into .json files under
   testdata/

 * added a couple of fantasy Graph groupware APIs to explore further
   options

 * added k6 scripts to test those graph/me/messages APIs, with a setup
   program to set up users in LDAP, fill their IMAP inbox, activate them
   in Stalwart, cleaning things up, etc...
2026-04-13 16:39:51 +02:00
Pascal Bleser
1c0f38f291 groupware: removed debugging logs 2026-04-13 16:39:51 +02:00
Pascal Bleser
1f2764c83c auth-api: fix: was missing newly introduced metrics 2026-04-13 16:39:51 +02:00
Pascal Bleser
3998c7fffd groupware and jmap improvements and refactoring 2026-04-13 16:39:51 +02:00
Pascal Bleser
75f814fda2 Introduce a the auth-api service
* primitive implementation to demonstrate how it could work, still to
   be considered WIP at best

 * add new dependency: MicahParks/jwkset and MicahParks/keyfunc to
   retrieve the JWK set from KeyCloak to verify the signature of the
   JWTs sent as part of Bearer authentication in the /auth API

 * (minor) opencloud/.../service.go: clean up a logging statement that
   was introduced earlier to hunt down why the auth-api service was not
   being started
2026-04-13 16:39:50 +02:00
Pascal Bleser
1e2e2b46df add an auth-api service to make an exemplary implementation of an external authentication API for third party services such as Stalwart 2026-04-13 16:39:50 +02:00
Pascal Bleser
dc73c8d7b1 move services/groupware/pkg/jmap to pkg/jmap 2026-04-13 16:39:50 +02:00
Pascal Bleser
1f4f0ff601 WIP: restructure the Jmap client, and implement the /me/messages Graph API endpoint with it 2026-04-13 16:39:50 +02:00
Pascal Bleser
bc88bc7217 add missing routing for /groupware (currently unprotected for testing) 2026-04-13 16:39:50 +02:00
Pascal Bleser
1aedde8de6 WIP: initial implementation of the groupware service 2026-04-13 16:39:50 +02:00
dependabot[bot]
113de08e28 build(deps-dev): bump dotenv from 16.4.7 to 17.4.2 in /services/idp
Bumps [dotenv](https://github.com/motdotla/dotenv) from 16.4.7 to 17.4.2.
- [Changelog](https://github.com/motdotla/dotenv/blob/master/CHANGELOG.md)
- [Commits](https://github.com/motdotla/dotenv/compare/v16.4.7...v17.4.2)

---
updated-dependencies:
- dependency-name: dotenv
  dependency-version: 17.4.2
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-04-13 15:27:26 +02:00
Ralf Haferkamp
233ff383e7 chore: bump IDP javascript dependencies 2026-04-13 12:01:52 +02:00
opencloudeu
b9ed197a23 [tx] updated from transifex 2026-04-12 00:05:15 +00:00
Ralf Haferkamp
d9f39773e7 proxy: add memory cache for tenant id mapping
This is to reduce the number of "proxy->gateway->users->ldap" roundtrips
for the tenant id mapping.

The cache currently has a non-configurable ttl of 10 min.

Related: #2310
2026-04-09 17:46:50 +02:00
Ralf Haferkamp
a931e53c26 proxy: Allow mapping from an external tenant id to the internal id
When the tenant id coming in via the OIDC claims doesn't match the
tenant id on the provisioned user, a mapping can be configured and
resolved via the reva TenantAPI service (now started as part of the
"users" service).

Closes: #2310
2026-04-09 17:46:50 +02:00
Jannik Stehle
c9a41a4bfd Merge pull request #2555 from pedropintosilva/feat/enable-insert-remote-file
feat: enable EnableInsertRemoteFile WOPI flag for Collabora
2026-04-08 10:00:46 +02:00
dependabot[bot]
369d03d532 build(deps-dev): bump css-minimizer-webpack-plugin in /services/idp
Bumps [css-minimizer-webpack-plugin](https://github.com/webpack/css-minimizer-webpack-plugin) from 7.0.4 to 8.0.0.
- [Release notes](https://github.com/webpack/css-minimizer-webpack-plugin/releases)
- [Changelog](https://github.com/webpack/css-minimizer-webpack-plugin/blob/main/CHANGELOG.md)
- [Commits](https://github.com/webpack/css-minimizer-webpack-plugin/compare/v7.0.4...v8.0.0)

---
updated-dependencies:
- dependency-name: css-minimizer-webpack-plugin
  dependency-version: 8.0.0
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-04-07 14:10:08 +02:00
opencloudeu
c7d920c212 [tx] updated from transifex 2026-04-07 00:05:34 +00:00
opencloudeu
9a6a99cd8c [tx] updated from transifex 2026-04-05 00:05:39 +00:00
Ralf Haferkamp
33f45fa965 feat(multi-tenancy): verify tenant via OIDC claim
When multi-tenancy is enable we now allow to specify an OIDC claim
against which the tenantid of the user resolved via CS3 apis is matched.

Partial: #2310
2026-04-02 16:10:53 +02:00
opencloudeu
9e615837c6 [tx] updated from transifex 2026-04-02 00:05:58 +00:00
opencloudeu
f7215df83f [tx] updated from transifex 2026-04-01 00:06:08 +00:00
Pedro Pinto Silva
a4809da471 feat: enable EnableInsertRemoteFile WOPI flag for Collabora
Set EnableInsertRemoteFile: true in CheckFileInfo response so Collabora
shows "Insert Multimedia" and "Compare Document" menu entries. This
triggers UI_InsertFile postMessages to the WOPI host, following the same
pattern as the existing EnableInsertRemoteImage flag.

Signed-off-by: Pedro Pinto Silva <pedro.silva@collabora.com>
2026-03-31 15:25:55 +02:00
Viktor Scharf
0c8829c15d set version placeholder (#2547) 2026-03-30 14:51:00 +02:00
Viktor Scharf
656c7c37d5 chore: bump web to v6.1.0 (#2541) 2026-03-30 11:39:22 +02:00
Michael Barz
f0836c54fb feat: add userid to spans (#2536) 2026-03-30 10:32:24 +02:00
opencloudeu
3e6a1e69fc [tx] updated from transifex 2026-03-30 00:18:52 +00:00