Commit Graph

23326 Commits

Author SHA1 Message Date
Pascal Bleser
601be19976 groupware: jmap: don't collpase threads when searching for emails, and add dumping of JMAP request payloads when trace logging is enabled 2026-06-16 16:49:44 +02:00
Pascal Bleser
ffab61aa30 groupware: try an alternative way to configure Stalwart dynamically in the devtools Docker Compose setup, by using separate files and ${STALWART_AUTH_DIRECTORY} to name to file to mount 2026-06-16 16:49:44 +02:00
Pascal Bleser
8f64806c98 jmap: add GetInboxNameForMultipleAccounts 2026-06-16 16:49:44 +02:00
Pascal Bleser
a8fbb38a19 groupware: add Mermaid diagrams to describe the two setup options 2026-06-16 16:49:44 +02:00
Pascal Bleser
54a421449a groupware: implement email updating and email keyword updating endpoints 2026-06-16 16:49:44 +02:00
Pascal Bleser
a4949fc021 docs(groupware): upgrade @redocly/cli 2.3.1 -> 2.4.0 2026-06-16 16:49:44 +02:00
Pascal Bleser
ff393b7878 jmap: fix Email/set 2026-06-16 16:49:44 +02:00
Pascal Bleser
3e3cdbce0f groupware: further updates to make everything work with the builtin LDAP and OIDC 2026-06-16 16:49:44 +02:00
Pascal Bleser
51219c69bf groupware: for /accounts/all/emails/latest/summary, rename the ?unread query parameter into ?seen as that is more intuitive 2026-06-16 16:49:43 +02:00
Pascal Bleser
e9a131a4d7 groupware: make everything also work with the built-in LDAP and IDP 2026-06-16 16:49:43 +02:00
Pascal Bleser
919e7d23b1 groupware: devtools: Stalwart: add internal LDAP configuration 2026-06-16 16:49:43 +02:00
Pascal Bleser
14ab0b861b groupware: update @redocly/cli from 2.3.0 to 2.3.1 2026-06-16 16:49:43 +02:00
Pascal Bleser
e982755cfa docs(groupware): fix basepath in OpenAPI, /groupware instead of /groupware/groupware 2026-06-16 16:49:43 +02:00
Viktor Scharf
067ec169ad fixed connection reset issue. adapted make file to generate swagger docs on mac 2026-06-16 16:49:43 +02:00
Pascal Bleser
a0b88c0ad1 groupware: improve jmap integration tests
* use gofakeit instead of loremipsum, as it can also fake images for
   attachments

 * random emails for testing: generate threads, add attachments
2026-06-16 16:49:43 +02:00
Pascal Bleser
1f7f690b33 groupware: rewrite JMAP integration test to be more reusable, and upgrade Stalwart container to 0.13.4 2026-06-16 16:49:43 +02:00
Pascal Bleser
a6fcfa7aa6 groupware: upgrade Stalwart in devtools from 0.13.2 to 0.13.4
* changes from 0.13.4:
   - JMAP: Protocol layer rewrite for zero-copy deserialization and
     architectural improvements.
   - IMAP: Unbounded memory allocation in request parser
     (CVE-2025-61600)
   - IMAP: Wrong permission checked for GETACL.
   - JMAP: References to previous method fail when there are no results
     (stalwartlabs#1507).
   - JMAP: Enforce quota checks on Blob/copy.
   - JMAP: Mailbox/get fails without accountId argument (stalwartlabs#1936).
   - JMAP: Do not return invalidProperties when email update doesn't
     contain changes (stalwartlabs#1139)
   - iTIP: Include date properties in REPLY (stalwartlabs#2102).
   - OIDC: Do not set username field if it is the same as the email field.
   - Telemetry: Fix calculateMetrics housekeeper task (stalwartlabs#2155).
   - Directory: Always use rsplit to extract the domain part from email
     addresses.

  * changes from 0.13.3:
   - CLI: Health checks
   - WebDAV: Assisted discovery v2
   - iTIP: Do not send a REPLY when deleting an event that was not
     accepted.
   - iTIP: Include event details in REPLY messages (stalwart#2102).
   - iTIP: Add organizer to iMIP replies if missing to deal with MS
     Exchange 2010 bug.
   - OIDC: Do not overwrite locally defined aliases (stalwart#2065).
   - HTTP: Scan ban should only be triggered by HTTP parse errors.
   - HTTP: Skip scanner fail2ban checks when the proxy client IP can't
     be parsed (stalwart#2121).
   - JMAP: Do not allow roles to be removed from system mailboxes
     (stalwart#1977).
   - JMAP WS: Fix panic when using invalid server url.
   - SMTP: Do no send EHLO twice when STARTTLS is unavailable
     (stalwart#2050).
   - IMAP: Allow ENABLE UTF8 in IMAPrev1.
   - IMAP: Include administer permission in ACL responses.
   - IMAP: Add owner rights to ACL get responses.
   - IMAP: Do not auto-train Bayes when moving messages from Junk to
     Trash.
   - IMAP/ManageSieve: Increase maximum quoted argument size
     (stalwart#2039).
   - CalDAV: Limit recurrence expansions in calendar reports
     (CVE-2025-59045).
   - WebDAV: Do not fix percent encoding on WebDAV FS (stalwart#2036).
2026-06-16 16:49:43 +02:00
Pascal Bleser
908bf9fc07 groupware: add bootstrapping on / with quotas for all accounts 2026-06-16 16:49:43 +02:00
Pascal Bleser
8a42e20c74 groupware: add /quota for all accounts 2026-06-16 16:49:43 +02:00
Pascal Bleser
08c3f71b12 groupware: improve instructions in DEVELOPER.md 2026-06-16 16:49:43 +02:00
Pascal Bleser
f4aa170af6 groupware: update @redocly/cli: 2.2.2 -> 2.3.0 2026-06-16 16:49:43 +02:00
Pascal Bleser
08f7ec6700 groupware: add quota API + add support for Accept-Language and Content-Language 2026-06-16 16:49:43 +02:00
Pascal Bleser
f582f09121 groupware: minor improvements to the DEVELOPER.md 2026-06-16 16:49:43 +02:00
Pascal Bleser
f64e0799b2 groupware: add flag to currently ignore session capability checks for calendars, contacts and tasks, as those are not implemented in Stalwart yet; will need to remove it in the future 2026-06-16 16:49:43 +02:00
Pascal Bleser
f47d31e4b0 groupware: add JMAP capability checking (in part: for contacts, calendars, tasks) 2026-06-16 16:49:43 +02:00
Pascal Bleser
9e318e898b /auth: add SkipXAccessToken:true 2026-06-16 16:49:43 +02:00
Pascal Bleser
aad36825c8 groupware: add mock endpoints for tasklists and tasks 2026-06-16 16:49:43 +02:00
Pascal Bleser
2a37612230 groupware: implement JMAP Task specification 2026-06-16 16:49:43 +02:00
Pascal Bleser
052de5293f groupware: more mock data, added missing JMAP types 2026-06-16 16:49:43 +02:00
Pascal Bleser
e6cf66aac8 groupware: add mock endpoints for addressbooks and contacts 2026-06-16 16:49:43 +02:00
Pascal Bleser
c85104c5d4 opencloud_full: also keep the 'Trace-Id' HTTP header 2026-06-16 16:49:43 +02:00
Pascal Bleser
06da420e45 implement JSCalendar (RFC 8984) 2026-06-16 16:49:43 +02:00
Pascal Bleser
30742044ad services/groupware/DEVELOPER.md: adapt to new path for the opencloud_full deployment 2026-06-16 16:49:43 +02:00
Pascal Bleser
3e4f9a8eaf JSContact: refactored after full test coverage, stronger typing for enumerations 2026-06-16 16:49:43 +02:00
Pascal Bleser
d893b01662 Implement JSContact (RFC9553) Model
* add pkg/jscontact with the implementation of the RFC9553 data model

 * add JMAP Calendar session capabilities support in pkg/jmap
2026-06-16 16:49:43 +02:00
Pascal Bleser
1ab16c996a Docker Compose Groupware improvements
* made a few changes in order to further simplify the setup for
   developers of the Groupware backend

 * add STALWART_DOMAIN to deployments/examples/opencloud_full/.env

 * adapt the Stalwart configuration file to not set server.hostname and,
   instead, pick it up from /etc/hostname, which is set by Docker
   Compose as we can use default values for STALWART_DOMAIN there, in an
   analogous fashion to the other containers in that project

 * add config/keycloak/clients/groupware.json to avoid requiring manual
   configuration of Keycloak via the admin web UI

 * Stalwart container:
   - listen for SMTPS on :1465
   - remove the stalwart-logs volume, not needed (logs are going to
     stdout)

 * updated services/groupware/DEVELOPER.md:
   - refer to a variable OCDIR to make instructions more copy-pasteable
   - remove manual Keycloak configuration section as it is now obsolete,
     replaced by provisioning a configuration file instead
2026-06-16 16:49:43 +02:00
Pascal Bleser
335b46e502 start websocket implementation, add endpoint for email summaries
* feat(groupware): start implementing JMAP websocket support for push
   notifications (unfinished)

 * groupware: add GetLatestEmailsSummaryForAllAccounts

 * add new vendored dependency: github.com/gorilla/websocket

 * jmap: add QueryEmailSummaries

 * openapi: start adding examples

 * openapi: add new tooling for api-examples.yaml injection

 * apidoc-process.ts: make it more typescript-y

 * bump @redocly/cli from 2.0.8 to latest 2.2.0
2026-06-16 16:49:43 +02:00
Pascal Bleser
4386587272 feat(groupware): add WebsocketEndpoint to the JMAP Session 2026-06-16 16:49:43 +02:00
Pascal Bleser
44ac15ec16 refactor(groupware): just use a function for the attachment picker
Minor: be more Go idiomatic: just use a function to pick the attachment
from an Email's attachment list instead of using an interface with
multiple iplementation structs.
2026-06-16 16:49:43 +02:00
Pascal Bleser
95c8245c64 groupware: improved attachment APIs
* feat(groupware): add /accounts/{}/emails/{}/attachments

 * feat(groupware): add
   /accounts/{}/emails/{}/attachments?partId=&name=&blobId=
2026-06-16 16:49:43 +02:00
Pascal Bleser
d9303c3fa9 jmap: modify GetBlob -> GetBlobMetadata
* fix(jmap): fix bug where CommandBlobUpload was used instead of
   CommandBlobGet in GetBlob (now GetBlobMetadata)

 * we currently don't need a variant of BlobGetCommand that also
   retrieves the content of the blob, instead we only use it for
   retrieving metadata about it
2026-06-16 16:49:43 +02:00
Pascal Bleser
e4602bcc14 fix(groupware): update DEVELOPER.md imap-filler usage since it was updated to use flags instead of environment variables 2026-06-16 16:49:43 +02:00
Pascal Bleser
183549cf09 docs(groupware): more developer instructions 2026-06-16 16:49:43 +02:00
Pascal Bleser
d93b5e963b more updates to the Groupware DEVELOPER.md 2026-06-16 16:49:43 +02:00
Pascal Bleser
379cabe124 docs(groupware): add configuration instructions to DEVELOPER.md 2026-06-16 16:49:43 +02:00
Pascal Bleser
4d66106d43 fix(groupware): fix JMAP error handling
* the JMAP error handling was not working properly, fixed it and added
   error definitions accordingly

 * add operations to retrieve mailbox roles and mailboxes by role for
   all accounts
2026-06-16 16:49:43 +02:00
Pascal Bleser
47125a356d refactor(groupware): rename "Messages" to "Email" everywhere
There was really no reason to go with "Messages" as far as the
vocabulary of the Groupware API goes, since the objects those APIs serve
are "Emails", to stick with the wording of the JMAP specification.
2026-06-16 16:49:43 +02:00
Pascal Bleser
30e091c7c1 refactor(groupware): use a function for multi-account method call IDs
* introduce a function 'mcid' to assemble method call IDs per account
   instead of doing that inline in each function, in case the rules for
   doing so change in the future
2026-06-16 16:49:43 +02:00
Pascal Bleser
2f3037f6d6 docs(groupware): add services/groupware/DEVELOPER.md 2026-06-16 16:49:43 +02:00
Pascal Bleser
9708429271 refactor(groupware): add max requests check
* move jmap.request() to jmap.Client.request() and pass the Session
   and a Logger to introduce checking the number of methodCalls within a
   request not exceeding the limit of the Session, as well as error
   handling and logging there instead of in each caller

 * a few bugfixes:
   - add a few missing Send() calls in logs
   - correct the response tag matching for
     GetMailboxChangesForMultipleAccounts
   - fix typo in Identity.ReplyTo json serialization rune
   - fix response tag in pkg/jmap/testdata/mailboxes1.json after
     changing them to be prefixed by the accountId
2026-06-16 16:49:43 +02:00