Commit Graph

4364 Commits

Author SHA1 Message Date
Pascal Bleser
a2917dea90 groupware: improve metrics
* implement more metrics, in a more streamlined fashion

 * use concurrent-map to store SSE streams instead of a regular map with
   one big lock that will not scale when it grows, causing too much
   contention on that one lock

 * while testing error metrics, noticed a few bugs with error handling
   when Stalwart is down: fixed
2026-02-23 09:34:45 +01:00
Pascal Bleser
8b5d8aedfd groupware: implement metrics
* implement a framework for metrics, with a few exemplary ones
2026-02-23 09:34:45 +01:00
Pascal Bleser
d86de66a15 groupware: Etag handling
* implement correct Etag and If-None-Match handling, responding with
   304 Not Modified if they match

 * introduce SessionState and State string type aliases to ensure we are
   using the correct fields for those, respectively

 * extract the SessionState from the JMAP response bodies in the
   groupware framework instead of having to do that in every single
   groupware API

 * use uint instead of int in some places to clarify that the values are
   >= 0

 * trace-log how long a Session was held in cache before being evicted

 * add Trace-Id header handling: add to response when specified in
   request, and implement a custom request logger to include it as a
   field

 * implement a more compact trace-logging of all the methods and URIs
   that are served, to put them into a single log entry instead of
   creating one log entry for every URI
2026-02-23 09:34:45 +01:00
Pascal Bleser
f2b1d11ace groupware: initial related emails implementation with SSE 2026-02-23 09:34:45 +01:00
Pascal Bleser
00d189cb04 groupware: add /bootstrap
* add a GET /accounts/{a}/boostrap URI that delivers the same as GET /
   but also mailboxes for a given account, in case the UI remembers the
   last used account identifier, to avoid an additional roundtrip

 * streamline the use of simpleError()

 * add logging of errors at the calling site

 * add logging of evictions of Sessions from the cache

 * change default Session cache TTL to 5min instead of 30sec
2026-02-23 09:34:45 +01:00
Pascal Bleser
ab0a24c46d groupware: swagger API documentation improvements
* add more documentation for properties

 * fixes after a bit of trial-and-error with go-swagger

 * fix email filter marshalling when there are no search criteria

 * introduce an apidoc.yml that contains Swagger data and is merged when
   generating the swagger.yml from sources
2026-02-23 09:34:45 +01:00
Pascal Bleser
9dbb1082d3 Groupware improvements
* ensure that all the jmap responses contain the SessionState

 * implement missing errors that were marked as TODO

 * moved common functions from pkg/jmap and pkg/services/groupware to
   pkg/log and pkg/structs to commonalize them across both source trees

 * implement error handling for SetError occurences

 * Email: replace anonymous map[string]bool for mailbox rights with a
   MailboxRights struct, as the keys are well-defined, which allows for
   properly documenting them

 * introduce ObjectType as an "enum"

 * fix JSON marshalling and unmarshalling of EmailBodyStructure

 * move the swagger documentation structs from groupware_api.go to
   groupware_docs.go

 * fix: change verb for /groupware/accounts/*/vacation from POST to PUT
2026-02-23 09:34:45 +01:00
Pascal Bleser
8659dfa571 groupware: minor email searching response improvements + started implementing vacation response setting API 2026-02-23 09:34:45 +01:00
Pascal Bleser
7e5c0945fe groupware: add identities of all accounts to the index resource 2026-02-23 09:34:45 +01:00
Pascal Bleser
756f2ac388 groupware: fix email search, add variant that includes the full emails 2026-02-23 09:34:45 +01:00
Pascal Bleser
ad4ca849de groupware: fix email search, add variant that includes the full emails 2026-02-23 09:34:45 +01:00
Pascal Bleser
aa6eb09630 Groupware: refactor jmap package, implement Email/set, EmailSubmission
* refactor the jmap package to split it into several files as the
   jmap.api.go file was becoming too unwieldy

 * refactor the Groupware handler function response to be a Response
   object, to be more future-proof and avoid adding more and more
   return parameters while handling "no content" response as well

 * more godoc for the JMAP model

 * add Email creation, updating, deleting (Email/set,
   EmailSubmission/set)

 * add endpoints
   - POST /accounts/{accountid}/messages
   - PATCH|PUT /accounts/{accountid}/messages/{messageid}
   - DELETE /accounts/{accountid}/messages/{messageid}
2026-02-23 09:34:45 +01:00
Pascal Bleser
b7a7c9526b groupware: implement message search with snippets 2026-02-23 09:34:45 +01:00
Pascal Bleser
9342db5efb groupware: blob streaming (upload and download) 2026-02-23 09:34:45 +01:00
Pascal Bleser
bf459ba2b2 groupware: more JMAP operations implementation 2026-02-23 09:34:45 +01:00
Pascal Bleser
ee72727410 groupware: further implementation and improvements 2026-02-23 09:34:45 +01:00
Pascal Bleser
d392718d5f refactored the Session object, refactored the services/groupware directory, and started Swagger documentation implementation 2026-02-23 09:34:45 +01:00
Pascal Bleser
967ad602a9 groupware: refactoring the API mechanisms 2026-02-23 09:34:45 +01:00
Pascal Bleser
892fe602d5 groupware: implement JSON:API's error response format, with a revamped error handling in jmap and services/groupware 2026-02-23 09:34:45 +01:00
Pascal Bleser
bc333500cd Refactor groupware service after ADR decision on the Groupware API
* after having decided that the Groupware API should be a standalone
   independent custom REST API that is using JMAP data models as much as
   possible,
 * removed Groupware APIs from the Graph service
 * moved Groupware implementation to the Groupware service, and
   refactored a few things accordingly
2026-02-23 09:34:45 +01:00
Pascal Bleser
eba724249c Groupware and jmap: cleanup and API documentation 2026-02-23 09:34:45 +01:00
Pascal Bleser
5ad99311f7 groupware: remove unneeded messages.go that was a remainder from an earlier implementation attempt, which also fixes compilation issues due to changes in main 2026-02-23 09:34:45 +01:00
Pascal Bleser
a29108f37e Groupware improvements: refactoring, k6 tests
* refactored the models to be strongly typed with structs and mapstruct
   to decompose the dynamic parts of the JMAP payloads

 * externalized large JSON strings for tests into .json files under
   testdata/

 * added a couple of fantasy Graph groupware APIs to explore further
   options

 * added k6 scripts to test those graph/me/messages APIs, with a setup
   program to set up users in LDAP, fill their IMAP inbox, activate them
   in Stalwart, cleaning things up, etc...
2026-02-23 09:34:45 +01:00
Pascal Bleser
7b2a227d91 groupware: removed debugging logs 2026-02-23 09:34:45 +01:00
Pascal Bleser
fa836f5a98 auth-api: fix: was missing newly introduced metrics 2026-02-23 09:34:45 +01:00
Pascal Bleser
5f951d7622 groupware and jmap improvements and refactoring 2026-02-23 09:34:45 +01:00
Pascal Bleser
8742f0a38c Introduce a the auth-api service
* primitive implementation to demonstrate how it could work, still to
   be considered WIP at best

 * add new dependency: MicahParks/jwkset and MicahParks/keyfunc to
   retrieve the JWK set from KeyCloak to verify the signature of the
   JWTs sent as part of Bearer authentication in the /auth API

 * (minor) opencloud/.../service.go: clean up a logging statement that
   was introduced earlier to hunt down why the auth-api service was not
   being started
2026-02-23 09:34:44 +01:00
Pascal Bleser
a541c8f60a add an auth-api service to make an exemplary implementation of an external authentication API for third party services such as Stalwart 2026-02-23 09:34:44 +01:00
Pascal Bleser
a75fdaa484 move services/groupware/pkg/jmap to pkg/jmap 2026-02-23 09:34:44 +01:00
Pascal Bleser
1d8650999e WIP: restructure the Jmap client, and implement the /me/messages Graph API endpoint with it 2026-02-23 09:34:44 +01:00
Pascal Bleser
a30626ec19 add missing routing for /groupware (currently unprotected for testing) 2026-02-23 09:34:44 +01:00
Pascal Bleser
7f7f25c11c WIP: initial implementation of the groupware service 2026-02-23 09:34:44 +01:00
Jannik Stehle
2a2e882a59 Merge pull request #2377 from opencloud-eu/feat/web-adjust-surface-colors
feat(web): change surface colors to more modern ones
2026-02-23 07:34:59 +01:00
opencloudeu
42e9c27174 [tx] updated from transifex 2026-02-22 00:13:15 +00:00
Jannik Stehle
02d73157c1 feat(web): change surface colors to more modern ones 2026-02-20 16:13:32 +01:00
Ralf Haferkamp
6dde2839df fix(oidc_auth): Fix userinfo cache expiration logic
When the userinfo claims store in the usercache is found to be expired,
do not return an error but ignore the cached entry and force a
re-verification of the access token (either via parsing the JWT again or
via a UserInfo lookup).
This is required for setups with non-JWT access tokes where the expiry
date set in the cached claims does not reflect the actual token expiry,
but just the CacheTTL.

Fixes: #1493
2026-02-19 13:17:17 +01:00
Ralf Haferkamp
212846f2f4 fix(idp): Remove kpop dependency
The built package (https://download.kopano.io/community/kapp:/kpop-2.7.2.tgz)
seems to be no longer available and upstream lico already switched away
from it quite a while ago.

Fixes: #2364
2026-02-19 12:16:30 +01:00
opencloudeu
4447893aeb [tx] updated from transifex 2026-02-18 00:15:57 +00:00
Alex
cdb942a093 feat: app-registry adjust default mime-types (#2354) 2026-02-17 16:39:55 +01:00
Ralf Haferkamp
78703806e4 feat(webfinger): add fallbacks for CLIENT_ID and SCOPE setting
This adds the variables 'OC_OIDC_CLIENT_ID' and
'OC_OIDC_CLIENT_SCOPES' as fallbacks for the platform specific settings.

For backwards compatibility with the "old" settings for the 'web'
service we also allow 'WEB_OIDC_CLIENT_ID' and 'WEB_OIDC_SCOPE' for the
"web" platform.
2026-02-17 10:41:35 +01:00
Ralf Haferkamp
4f1aca6d90 feat(webfinger): use webfinger properties instead new relations
This works the previous commits so that clients can add an addtional
'platform' query parameter to the webfinger request that  can be used
to query the oidc client id and list of scopes that the clients need
to use when connecting to the IDP.

This also removes the non-standard issuer relatation introduced in a
previous commit as we can just introduce new relations in the
http://openid.net name space.

For IDP like Authentik that create a separate issuer url per Client
(Application in Authentik's terms) it is suggested to just configure
as single Client and use that id for all platforms (i.e. setting
'WEBFINGER_ANDROID_OIDC_CLIENT_ID', 'WEBFINGER_DESKTOP_OIDC_CLIENT_ID',
'WEBFINGER_IOS_OIDC_CLIENT_ID' and 'WEBFINGER_WEB_OIDC_CLIENT_ID' to
same value.

Related: #2088
Related: https://github.com/opencloud-eu/desktop/issues/246
2026-02-17 10:41:35 +01:00
Ralf Haferkamp
24aaeb46ba chore(webfinger): Simplify weird Query parameter extraction loop 2026-02-17 10:41:35 +01:00
pat-s
daeae1f443 feat(webfinger): support desktop and mobile specific OIDC client_id 2026-02-17 10:41:35 +01:00
pat-s
84da592c88 feat(webfinger): add desktop-specific OIDC issuer support 2026-02-17 10:41:35 +01:00
opencloudeu
4e9eb596f0 [tx] updated from transifex 2026-02-17 00:17:42 +00:00
Benedikt Kulmann
5be98670f4 chore: bump web to v5.1.0 2026-02-16 11:01:47 +01:00
opencloudeu
e698a35aef [tx] updated from transifex 2026-02-16 00:16:53 +00:00
opencloudeu
d867665dc1 [tx] updated from transifex 2026-02-15 00:16:35 +00:00
opencloudeu
e0b465342f [tx] updated from transifex 2026-02-14 00:16:38 +00:00
Thomas Schweiger
8f3714f08f Merge pull request #2333 from opencloud-eu/fix/fix-typo-in-var-description
fix: fix typo in variable description
2026-02-12 18:13:02 +01:00