Commit Graph

4567 Commits

Author SHA1 Message Date
Pascal Bleser
fcf62c4e73 groupware: fix debug server, was missing a lot of configuration options and was binding to :80 2026-06-03 18:39:08 +02:00
Pascal Bleser
ef4d437551 refactor(groupware): logging and metrics improvements
* some minor code refactorings to improve logging and metrics

 * more code documentation
2026-06-03 18:39:08 +02:00
Pascal Bleser
7fdb565def groupware: improve metrics
* implement more metrics, in a more streamlined fashion

 * use concurrent-map to store SSE streams instead of a regular map with
   one big lock that will not scale when it grows, causing too much
   contention on that one lock

 * while testing error metrics, noticed a few bugs with error handling
   when Stalwart is down: fixed
2026-06-03 18:39:08 +02:00
Pascal Bleser
dc518c7d51 groupware: implement metrics
* implement a framework for metrics, with a few exemplary ones
2026-06-03 18:39:08 +02:00
Pascal Bleser
b6fc9d6e22 groupware: Etag handling
* implement correct Etag and If-None-Match handling, responding with
   304 Not Modified if they match

 * introduce SessionState and State string type aliases to ensure we are
   using the correct fields for those, respectively

 * extract the SessionState from the JMAP response bodies in the
   groupware framework instead of having to do that in every single
   groupware API

 * use uint instead of int in some places to clarify that the values are
   >= 0

 * trace-log how long a Session was held in cache before being evicted

 * add Trace-Id header handling: add to response when specified in
   request, and implement a custom request logger to include it as a
   field

 * implement a more compact trace-logging of all the methods and URIs
   that are served, to put them into a single log entry instead of
   creating one log entry for every URI
2026-06-03 18:39:08 +02:00
Pascal Bleser
c8f2493fcf groupware: initial related emails implementation with SSE 2026-06-03 18:39:08 +02:00
Pascal Bleser
8399a3ee5e groupware: add /bootstrap
* add a GET /accounts/{a}/boostrap URI that delivers the same as GET /
   but also mailboxes for a given account, in case the UI remembers the
   last used account identifier, to avoid an additional roundtrip

 * streamline the use of simpleError()

 * add logging of errors at the calling site

 * add logging of evictions of Sessions from the cache

 * change default Session cache TTL to 5min instead of 30sec
2026-06-03 18:39:08 +02:00
Pascal Bleser
a76d40e493 groupware: swagger API documentation improvements
* add more documentation for properties

 * fixes after a bit of trial-and-error with go-swagger

 * fix email filter marshalling when there are no search criteria

 * introduce an apidoc.yml that contains Swagger data and is merged when
   generating the swagger.yml from sources
2026-06-03 18:39:08 +02:00
Pascal Bleser
37094d9db5 Groupware improvements
* ensure that all the jmap responses contain the SessionState

 * implement missing errors that were marked as TODO

 * moved common functions from pkg/jmap and pkg/services/groupware to
   pkg/log and pkg/structs to commonalize them across both source trees

 * implement error handling for SetError occurences

 * Email: replace anonymous map[string]bool for mailbox rights with a
   MailboxRights struct, as the keys are well-defined, which allows for
   properly documenting them

 * introduce ObjectType as an "enum"

 * fix JSON marshalling and unmarshalling of EmailBodyStructure

 * move the swagger documentation structs from groupware_api.go to
   groupware_docs.go

 * fix: change verb for /groupware/accounts/*/vacation from POST to PUT
2026-06-03 18:39:08 +02:00
Pascal Bleser
e81a325b56 groupware: minor email searching response improvements + started implementing vacation response setting API 2026-06-03 18:39:07 +02:00
Pascal Bleser
32992098b7 groupware: add identities of all accounts to the index resource 2026-06-03 18:39:07 +02:00
Pascal Bleser
40d5af9561 groupware: fix email search, add variant that includes the full emails 2026-06-03 18:39:07 +02:00
Pascal Bleser
051d975c55 groupware: fix email search, add variant that includes the full emails 2026-06-03 18:39:07 +02:00
Pascal Bleser
70c92c7866 Groupware: refactor jmap package, implement Email/set, EmailSubmission
* refactor the jmap package to split it into several files as the
   jmap.api.go file was becoming too unwieldy

 * refactor the Groupware handler function response to be a Response
   object, to be more future-proof and avoid adding more and more
   return parameters while handling "no content" response as well

 * more godoc for the JMAP model

 * add Email creation, updating, deleting (Email/set,
   EmailSubmission/set)

 * add endpoints
   - POST /accounts/{accountid}/messages
   - PATCH|PUT /accounts/{accountid}/messages/{messageid}
   - DELETE /accounts/{accountid}/messages/{messageid}
2026-06-03 18:39:07 +02:00
Pascal Bleser
4b3b7ca412 groupware: implement message search with snippets 2026-06-03 18:39:07 +02:00
Pascal Bleser
0bcf25516f groupware: blob streaming (upload and download) 2026-06-03 18:39:07 +02:00
Pascal Bleser
22dca9fe89 groupware: more JMAP operations implementation 2026-06-03 18:39:07 +02:00
Pascal Bleser
0dc59f3786 groupware: further implementation and improvements 2026-06-03 18:39:07 +02:00
Pascal Bleser
6e23f5fe8f refactored the Session object, refactored the services/groupware directory, and started Swagger documentation implementation 2026-06-03 18:39:07 +02:00
Pascal Bleser
b3e678db47 groupware: refactoring the API mechanisms 2026-06-03 18:39:07 +02:00
Pascal Bleser
b414b8b233 groupware: implement JSON:API's error response format, with a revamped error handling in jmap and services/groupware 2026-06-03 18:39:07 +02:00
Pascal Bleser
0c4540bb4d Refactor groupware service after ADR decision on the Groupware API
* after having decided that the Groupware API should be a standalone
   independent custom REST API that is using JMAP data models as much as
   possible,
 * removed Groupware APIs from the Graph service
 * moved Groupware implementation to the Groupware service, and
   refactored a few things accordingly
2026-06-03 18:39:07 +02:00
Pascal Bleser
90a36d6797 Groupware and jmap: cleanup and API documentation 2026-06-03 18:39:07 +02:00
Pascal Bleser
7bbf9a4053 groupware: remove unneeded messages.go that was a remainder from an earlier implementation attempt, which also fixes compilation issues due to changes in main 2026-06-03 18:39:07 +02:00
Pascal Bleser
4379fa27e4 Groupware improvements: refactoring, k6 tests
* refactored the models to be strongly typed with structs and mapstruct
   to decompose the dynamic parts of the JMAP payloads

 * externalized large JSON strings for tests into .json files under
   testdata/

 * added a couple of fantasy Graph groupware APIs to explore further
   options

 * added k6 scripts to test those graph/me/messages APIs, with a setup
   program to set up users in LDAP, fill their IMAP inbox, activate them
   in Stalwart, cleaning things up, etc...
2026-06-03 18:39:07 +02:00
Pascal Bleser
7e7a78f76b groupware: removed debugging logs 2026-06-03 18:39:07 +02:00
Pascal Bleser
1b1f4d6735 auth-api: fix: was missing newly introduced metrics 2026-06-03 18:39:07 +02:00
Pascal Bleser
e1bd777ed0 groupware and jmap improvements and refactoring 2026-06-03 18:39:07 +02:00
Pascal Bleser
7dd2755b6b Introduce a the auth-api service
* primitive implementation to demonstrate how it could work, still to
   be considered WIP at best

 * add new dependency: MicahParks/jwkset and MicahParks/keyfunc to
   retrieve the JWK set from KeyCloak to verify the signature of the
   JWTs sent as part of Bearer authentication in the /auth API

 * (minor) opencloud/.../service.go: clean up a logging statement that
   was introduced earlier to hunt down why the auth-api service was not
   being started
2026-06-03 18:39:07 +02:00
Pascal Bleser
f422448f68 add an auth-api service to make an exemplary implementation of an external authentication API for third party services such as Stalwart 2026-06-03 18:39:07 +02:00
Pascal Bleser
fda5c95b85 move services/groupware/pkg/jmap to pkg/jmap 2026-06-03 18:39:07 +02:00
Pascal Bleser
3d1c0ccc85 WIP: restructure the Jmap client, and implement the /me/messages Graph API endpoint with it 2026-06-03 18:39:07 +02:00
Pascal Bleser
9c13cd762a add missing routing for /groupware (currently unprotected for testing) 2026-06-03 18:39:07 +02:00
Pascal Bleser
4ca6a0d74c WIP: initial implementation of the groupware service 2026-06-03 18:39:07 +02:00
Christian Richter
8593a1409a incorporate requested changes
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2026-06-03 16:28:44 +02:00
Christian Richter
6d9d2baa80 force ldap to listen only on localhost
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2026-06-03 16:28:44 +02:00
Christian Richter
d6c6340705 use ldap instead of ldaps internally
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
2026-06-03 16:28:44 +02:00
Benedikt Kulmann
aa2f5d9667 chore: bump web to v7.1.0 2026-06-01 14:18:16 +02:00
Ralf Haferkamp
f75a27e79c Merge pull request #2854 from opencloud-eu/dependabot/npm_and_yarn/services/idp/license-checker-rseidelsohn-5.0.1
build(deps-dev): bump license-checker-rseidelsohn from 4.4.2 to 5.0.1 in /services/idp
2026-06-01 09:31:36 +02:00
dependabot[bot]
fbc08a5ccf build(deps-dev): bump license-checker-rseidelsohn in /services/idp
Bumps [license-checker-rseidelsohn](https://github.com/RSeidelsohn/license-checker-rseidelsohn) from 4.4.2 to 5.0.1.
- [Release notes](https://github.com/RSeidelsohn/license-checker-rseidelsohn/releases)
- [Changelog](https://github.com/RSeidelsohn/license-checker-rseidelsohn/blob/master/CHANGELOG.md)
- [Commits](https://github.com/RSeidelsohn/license-checker-rseidelsohn/compare/v4.4.2...v5.0.1)

---
updated-dependencies:
- dependency-name: license-checker-rseidelsohn
  dependency-version: 5.0.1
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-28 16:54:21 +00:00
dependabot[bot]
c3dc7b370f build(deps-dev): bump cldr from 7.9.0 to 8.0.0 in /services/idp
Bumps [cldr](https://github.com/papandreou/node-cldr) from 7.9.0 to 8.0.0.
- [Changelog](https://github.com/papandreou/node-cldr/blob/master/CHANGELOG.md)
- [Commits](https://github.com/papandreou/node-cldr/compare/v7.9.0...v8.0.0)

---
updated-dependencies:
- dependency-name: cldr
  dependency-version: 8.0.0
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-28 16:54:04 +00:00
Ralf Haferkamp
31340e30fb Merge pull request #2851 from rhafer/issue/2844
fix: Send SSE events for SpaceCreated/-Disabled/-Deleted
2026-05-28 17:02:03 +02:00
Ralf Haferkamp
11b6d7793d Merge pull request #2849 from opencloud-eu/dependabot/npm_and_yarn/services/idp/i18next-26.3.0
build(deps): bump i18next from 26.1.0 to 26.3.0 in /services/idp
2026-05-28 15:31:32 +02:00
Ralf Haferkamp
69b9031b2d fix: Send SSE events for SpaceCreated/-Disabled/-Deleted
Closes: #2844
2026-05-28 14:34:17 +02:00
dependabot[bot]
552e5dd289 build(deps-dev): bump sass-loader from 16.0.8 to 17.0.0 in /services/idp
Bumps [sass-loader](https://github.com/webpack/sass-loader) from 16.0.8 to 17.0.0.
- [Release notes](https://github.com/webpack/sass-loader/releases)
- [Changelog](https://github.com/webpack/sass-loader/blob/main/CHANGELOG.md)
- [Commits](https://github.com/webpack/sass-loader/compare/v16.0.8...v17.0.0)

---
updated-dependencies:
- dependency-name: sass-loader
  dependency-version: 17.0.0
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-28 08:47:57 +00:00
dependabot[bot]
5ad4ea4413 build(deps): bump i18next from 26.1.0 to 26.3.0 in /services/idp
Bumps [i18next](https://github.com/i18next/i18next) from 26.1.0 to 26.3.0.
- [Release notes](https://github.com/i18next/i18next/releases)
- [Changelog](https://github.com/i18next/i18next/blob/master/CHANGELOG.md)
- [Commits](https://github.com/i18next/i18next/compare/v26.1.0...v26.3.0)

---
updated-dependencies:
- dependency-name: i18next
  dependency-version: 26.3.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-28 08:47:53 +00:00
dependabot[bot]
44cef0ae65 build(deps-dev): bump typescript from 5.9.3 to 6.0.3 in /services/idp
Bumps [typescript](https://github.com/microsoft/TypeScript) from 5.9.3 to 6.0.3.
- [Release notes](https://github.com/microsoft/TypeScript/releases)
- [Commits](https://github.com/microsoft/TypeScript/compare/v5.9.3...v6.0.3)

---
updated-dependencies:
- dependency-name: typescript
  dependency-version: 6.0.3
  dependency-type: direct:development
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-05-28 07:36:14 +00:00
Ralf Haferkamp
49726b8af8 Merge pull request #2834 from aduffeck/fix-space-search
Only try to limit search to spaces if there's a space id to limit to
2026-05-27 16:07:55 +02:00
Ralf Haferkamp
70c0f4388b chore: bump js dependencies in idp 2026-05-27 11:46:34 +02:00
André Duffeck
5b9ec396c4 Dynamically adapt the URL prefix depending on the request 2026-05-27 10:04:01 +02:00