Commit Graph

295 Commits

Author SHA1 Message Date
Pascal Bleser
2797020ea4 groupware: fix deserialization of Event Alert Trigger types using mapstructure 2026-06-16 16:50:11 +02:00
Pascal Bleser
d559000f95 groupware: some fixes accordingly to the latest JMAP and jscalendarbis RFCs 2026-06-16 16:50:11 +02:00
Pascal Bleser
2e048092d1 groupware: add real calendars and events 2026-06-16 16:50:11 +02:00
Pascal Bleser
96f1f961e3 groupware: implement/fix email submission 2026-06-16 16:50:11 +02:00
Pascal Bleser
41845f299d groupware: implement Mailbox modification endpoints + refactor ETag/state in the framework
* add endpoints for Mailboxes:
   - PATCH mailboxes/{id}
   - DELETE mailboxes/{id}
   - POST mailboxes

 * refactor the pkg/jmap and groupware framework to systematically
   return a jmap.State out-of-band of the per-method payloads, since
   they are almost always present in JMAP responses, which lead to the
   artificial creation of a lot of composed struct types just to also
   return the State; on the downside, it adds yet another return
   parameter
2026-06-16 16:50:11 +02:00
Pascal Bleser
e317c37fdf groupware: add ical blob parsing endpoint 2026-06-16 16:50:11 +02:00
Pascal Bleser
1e0de30c07 groupware: add Mailbox sorting 2026-06-16 16:50:11 +02:00
Pascal Bleser
d1c2f42975 groupware: jmap: fix id -> blobId attribute when uploading a blob 2026-06-16 16:50:11 +02:00
Pascal Bleser
a54858e447 groupware: fix creating contacts 2026-06-16 16:50:10 +02:00
Pascal Bleser
29deb39a3c groupware: actually add total and limit to the email summary endpoint 2026-06-16 16:50:10 +02:00
Pascal Bleser
85ca7d64f9 groupware: fix compilation in tests after recent changes 2026-06-16 16:50:10 +02:00
Pascal Bleser
73293929f1 groupware: add missing total,limit,offset attributes in the QueryEmailsSummaries response 2026-06-16 16:50:10 +02:00
Pascal Bleser
5b52cf5567 groupware: add threadCount to /groupware/accounts/{accountId}/mailboxes/{mailboxId}/emails 2026-06-16 16:50:10 +02:00
Pascal Bleser
ae0e2392f2 groupware: add ContactCard operations 2026-06-16 16:50:10 +02:00
Pascal Bleser
08cbfec5a9 groupware: add threadSize in email-by-id response 2026-06-16 16:50:10 +02:00
Pascal Bleser
e066dd8a6a groupware: introduce constants for Email property names, see EmailSummaryProperties 2026-06-16 16:50:10 +02:00
Pascal Bleser
c4d1a1540f groupware: fix keyword patching syntax for markAsSeen=true 2026-06-16 16:50:10 +02:00
Pascal Bleser
112c49e162 groupware: add threadSize property in the email summary endpoint 2026-06-16 16:50:10 +02:00
Pascal Bleser
79d0c1e1d7 groupware: add markAsSeen=true to mark an email as $seen before it is
retrieved
2026-06-16 16:50:10 +02:00
Pascal Bleser
dea3496275 groupware: add searching emails by their Message-Id + retrieving an email by its ID as message/rfc822 2026-06-16 16:50:10 +02:00
Pascal Bleser
82923c88dd groupware: add identity deletion 2026-06-16 16:49:44 +02:00
Pascal Bleser
92dff35a21 groupware:
* made several email related operations multi-account:
   QueryEmailSnippets, QueryEmails, QueryEmailsWithSnippets

 * add GetIdentitiesForAllAccounts

 * add GetEmailsForAllAccounts

 * jmap: add CreateIdentity, UpdateIdentity; groupware: add
   GetIdentityById, AddIdentity, ModifyIdentity

 * add temporary workaround until Calendars, Tasks, Contacts are
   implemented in Stalwart when determining the default account for
   those: use the mail one in the mean time
2026-06-16 16:49:44 +02:00
Pascal Bleser
601be19976 groupware: jmap: don't collpase threads when searching for emails, and add dumping of JMAP request payloads when trace logging is enabled 2026-06-16 16:49:44 +02:00
Pascal Bleser
8f64806c98 jmap: add GetInboxNameForMultipleAccounts 2026-06-16 16:49:44 +02:00
Pascal Bleser
ff393b7878 jmap: fix Email/set 2026-06-16 16:49:44 +02:00
Pascal Bleser
a0b88c0ad1 groupware: improve jmap integration tests
* use gofakeit instead of loremipsum, as it can also fake images for
   attachments

 * random emails for testing: generate threads, add attachments
2026-06-16 16:49:43 +02:00
Pascal Bleser
1f7f690b33 groupware: rewrite JMAP integration test to be more reusable, and upgrade Stalwart container to 0.13.4 2026-06-16 16:49:43 +02:00
Pascal Bleser
908bf9fc07 groupware: add bootstrapping on / with quotas for all accounts 2026-06-16 16:49:43 +02:00
Pascal Bleser
8a42e20c74 groupware: add /quota for all accounts 2026-06-16 16:49:43 +02:00
Pascal Bleser
08f7ec6700 groupware: add quota API + add support for Accept-Language and Content-Language 2026-06-16 16:49:43 +02:00
Pascal Bleser
f47d31e4b0 groupware: add JMAP capability checking (in part: for contacts, calendars, tasks) 2026-06-16 16:49:43 +02:00
Pascal Bleser
aad36825c8 groupware: add mock endpoints for tasklists and tasks 2026-06-16 16:49:43 +02:00
Pascal Bleser
2a37612230 groupware: implement JMAP Task specification 2026-06-16 16:49:43 +02:00
Pascal Bleser
052de5293f groupware: more mock data, added missing JMAP types 2026-06-16 16:49:43 +02:00
Pascal Bleser
e6cf66aac8 groupware: add mock endpoints for addressbooks and contacts 2026-06-16 16:49:43 +02:00
Pascal Bleser
06da420e45 implement JSCalendar (RFC 8984) 2026-06-16 16:49:43 +02:00
Pascal Bleser
3e4f9a8eaf JSContact: refactored after full test coverage, stronger typing for enumerations 2026-06-16 16:49:43 +02:00
Pascal Bleser
d893b01662 Implement JSContact (RFC9553) Model
* add pkg/jscontact with the implementation of the RFC9553 data model

 * add JMAP Calendar session capabilities support in pkg/jmap
2026-06-16 16:49:43 +02:00
Pascal Bleser
335b46e502 start websocket implementation, add endpoint for email summaries
* feat(groupware): start implementing JMAP websocket support for push
   notifications (unfinished)

 * groupware: add GetLatestEmailsSummaryForAllAccounts

 * add new vendored dependency: github.com/gorilla/websocket

 * jmap: add QueryEmailSummaries

 * openapi: start adding examples

 * openapi: add new tooling for api-examples.yaml injection

 * apidoc-process.ts: make it more typescript-y

 * bump @redocly/cli from 2.0.8 to latest 2.2.0
2026-06-16 16:49:43 +02:00
Pascal Bleser
4386587272 feat(groupware): add WebsocketEndpoint to the JMAP Session 2026-06-16 16:49:43 +02:00
Pascal Bleser
d9303c3fa9 jmap: modify GetBlob -> GetBlobMetadata
* fix(jmap): fix bug where CommandBlobUpload was used instead of
   CommandBlobGet in GetBlob (now GetBlobMetadata)

 * we currently don't need a variant of BlobGetCommand that also
   retrieves the content of the blob, instead we only use it for
   retrieving metadata about it
2026-06-16 16:49:43 +02:00
Pascal Bleser
4d66106d43 fix(groupware): fix JMAP error handling
* the JMAP error handling was not working properly, fixed it and added
   error definitions accordingly

 * add operations to retrieve mailbox roles and mailboxes by role for
   all accounts
2026-06-16 16:49:43 +02:00
Pascal Bleser
30e091c7c1 refactor(groupware): use a function for multi-account method call IDs
* introduce a function 'mcid' to assemble method call IDs per account
   instead of doing that inline in each function, in case the rules for
   doing so change in the future
2026-06-16 16:49:43 +02:00
Pascal Bleser
9708429271 refactor(groupware): add max requests check
* move jmap.request() to jmap.Client.request() and pass the Session
   and a Logger to introduce checking the number of methodCalls within a
   request not exceeding the limit of the Session, as well as error
   handling and logging there instead of in each caller

 * a few bugfixes:
   - add a few missing Send() calls in logs
   - correct the response tag matching for
     GetMailboxChangesForMultipleAccounts
   - fix typo in Identity.ReplyTo json serialization rune
   - fix response tag in pkg/jmap/testdata/mailboxes1.json after
     changing them to be prefixed by the accountId
2026-06-16 16:49:43 +02:00
Pascal Bleser
fabfc60f36 groupware: minor typo fixes 2026-06-16 16:49:43 +02:00
Pascal Bleser
4dd7d89d14 feat(groupware): add fetching all mailboxes for all accounts
* add URL to retrieve all the mailboxes for all the accounts of a user,
   as a first use-case for an all-accounts operation, as
   /accounts/all/mailboxes

 * add URL to retrieve mailbox changes for all the mailboxes of all the
   accounts of a user, as a first use-case for an all-accounts
   operation, as /accounts/all/mailboxes/changes

 * change the defaultAccountId from '*' to '_', as '*' rather indicates
   "all" than "default", and we might want to use that for "all
   accounts" operations in the future

 * refactor(groupware): remove the accountId parameter from the logger()
   function, as it is not used anyways, but also confusing for
   operations that support multiple account ids
2026-06-16 16:49:43 +02:00
Pascal Bleser
e377dfc2b9 docs(groupware): OpenAPI improvements
* refactor some pkg/jmap and groupware methods to make more sense from
   an API point-of-view

 * add path parameter documentation, but automate it by injecting their
   definition into the OpenAPI YAML tree that is extracted from the
   source code using go-swagger as it is too cumbersome, repetitive and
   error-prine to document them in the source code; wrote a TypeScript
   file apidoc-process.ts to do so

 * add generating an offline HTML file for the OpenAPI documentation
   using redocly, and injecting a favicon into the resulting HTML; wrote
   a TypeScript file apidoc-postprocess-html.ts to do so
2026-06-16 16:49:43 +02:00
Pascal Bleser
5a08460ec6 test(groupware): add testcontainers based jmap test
* adds pkg/jmap/jmap_integration_test.go

 * uses ghcr.io/stalwartlabs/stalwart:v0.13.2-alpine

 * can be disabled by setting one of the following environment
   variables, in the same fashion as ca0493b28
   - CI=woodpecker
   - CI_SYSTEM_NAME=woodpecker
   - USE_TESTCONTAINERS=false

 * dependencies:
   - bump github.com/go-test/deep from 1.1.0 to 1.1.1
   - add github.com/cention-sany/utf7
   - add github.com/dustinkirkland/golang-petname
   - add github.com/emersion/go-imap/v2
   - add github.com/emersion/go-message
   - add github.com/emersion/go-sasl
   - add github.com/go-crypt/crypt
   - add github.com/go-crypt/x
   - add github.com/gogs/chardet
   - add github.com/inbucket/html2text
   - add github.com/jhilleryerd/enmime/v2
   - add github.com/ssor/bom
   - add gopkg.in/loremipsum.v1
2026-06-16 16:49:42 +02:00
Pascal Bleser
552589c256 refactor(groupware): session cache and DNS autodiscovery
* move the logging of the username and session state away from pkg/jmap
   and into services/groupware

 * introduce more decoupling for the session cache, as well as moving
   the implementation into groupware_session.go
2026-06-16 16:48:31 +02:00
Pascal Bleser
b5b9287b86 groupware: session handling improvements
* remove the baseurl from the JMAP client configuration, and pass it to
   the session retrieval functions instead, as that is really the only
   place where it is relevant, and we gain flexibility to discover that
   session URL differently in the future without having to touch the
   JMAP client

 * move the default account identifier handling from the JMAP package to
   the Groupware one, as it really has nothing to do with JMAP itself,
   and is an opinionated feature of the Groupware REST API instead

 * add an event listener interface for JMAP events to be more flexible
   and universal, typically for metrics that are defined on the API
   level that uses the JMAP client

 * add errors for when default accounts cannot be determined

 * split groupware_framework.go into groupware_framework.go,
   groupware_request.go and groupware_response.go

 * move the accountId logging into the Groupware level instead of JMAP
   since it can also be relevant to other operations that might be
   worthy of logging before the JMAP client is even invoked
2026-06-16 16:48:31 +02:00