mirror/opencloud
1
0
Fork 0
mirror of https://github.com/opencloud-eu/opencloud.git synced 2026-05-02 21:23:20 -04:00
Code Issues Packages Projects Releases Wiki Activity
23,160 Commits 57 Branches 55 Tags
3eb400a204bd742bc6eb3d3df763e9bae1739359
Commit Graph

311 Commits

Author SHA1 Message Date
Jörn Friedrich Dreyer
2d1cc3fb3a stop metrics tickers on context cancel 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2026-04-28 16:18:45 +02:00
André Duffeck
e9e195789d Adapt to changes in reva/cs3apis 2026-04-24 14:49:11 +02:00
Florian Schade
d0e3f14539 chore: remove loop var references 2026-04-23 17:11:55 +02:00
Florian Schade
288e67cc39 chore: replace interface with any 2026-04-23 09:31:11 +02:00
Dominik Schmidt
15d779cb23 refactor(search): rename forceReindexFlag to forceRescanFlag 
Address review feedback: now that the flag is read under its
registered name `force-rescan`, line the local variable up with the
operator-facing vocabulary. The proto field `ForceReindex` is left
untouched so the wire format stays the same.
 2026-04-21 15:29:04 +02:00
Dominik Schmidt
e7806445dc fix(search): read --force-rescan flag with its registered name 
The `opencloud search index` command registers the flag as
`--force-rescan` (see pflag registration below) but reads it via
`GetBool("force-reindex")`, so the value is always false — passing
`--force-rescan` had no effect and no force rescan was ever triggered.

Read the flag under its registered name.
 2026-04-21 15:29:04 +02:00
Dominik Schmidt
2fc33d6e60 refactor(search): round xmpDM:duration to the nearest millisecond 
Address review feedback: a straight int64 cast truncates toward zero,
so Tika values that produce results like 1234.999... millisecond would
land at 1234 ms instead of 1235 ms. Round before casting so durations
are as accurate as float64 allows.
 2026-04-21 15:16:57 +02:00
Dominik Schmidt
3c59935012 fix(search): parse tika xmpDM:duration as a float 
Tika emits xmpDM:duration as seconds in floating-point form (for
example "154.57379150390625"), so strconv.ParseInt rejected every
value and the field was silently dropped — every indexed audio item
ended up without a duration.

Parse the value with strconv.ParseFloat and convert to milliseconds
ourselves. Adjust the existing extractor test to cover the fractional
case.
 2026-04-21 15:16:57 +02:00
André Duffeck
bcdfbda08d Fix test 2026-04-14 08:20:28 +02:00
André Duffeck
60bcc6b0f2 Add a flag to the reindex command to force a full reindex 
That can be helpful when the search service configuration has changed,
e.g. by enabling TIKA. Previously files that had already been indexed
were not indexed again and thus were no part of the fulltext index.

Fixes #2285
Fixes #2578
 2026-04-14 08:20:28 +02:00
André Duffeck
71c0a469b9 Reduce default batch size to prevent memory issues with large documents 2026-03-25 14:27:37 +01:00
André Duffeck
428f69416f Commit batches when the limit is reached while iterating over children 2026-03-25 14:27:37 +01:00
André Duffeck
dea306247b Do not remove stopwords by default 
Keeping the stop words leads to slightly bigger indexes but fixes
chopped up highlights of search results and phrase accuracy during
search.
 2026-03-25 09:41:23 +01:00
André Duffeck
8a83eea742 Limit the highlighter to two fragments 2026-03-25 08:41:48 +01:00
André Duffeck
4fa5198501 Improve highlight support in osu 
Co-authored-by: Florian Schade <f.schade@icloud.com>
 2026-03-25 08:41:48 +01:00
André Duffeck
a6dd9b9e18 Use the fast vector highlighter for highlighting search results 2026-03-25 08:41:48 +01:00
André Duffeck
9e93f29ffe Introduce opensearch index v2 
The new index allows for faster highlighing uses the fvh highlighter and
searching for favorites.
 2026-03-25 08:41:48 +01:00
André Duffeck
10bc14130e Do not send back the full content in the search response 2026-03-23 13:52:09 +01:00
André Duffeck
cd0831aa10 We no longer manage favorites via arbitrary metadata 2026-03-13 09:38:28 +01:00
André Duffeck
d214a7535c Make the search index pick up changes to favorites 2026-03-13 09:38:28 +01:00
André Duffeck
ce5ec1b3dc Add support for favorites to the search service 2026-03-13 09:38:28 +01:00
Christian Richter
f7caf637ce consolidate log config in search 
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
 2026-01-08 13:18:45 +01:00
Jörn Friedrich Dreyer
d0e51010bf replace more .Value.String() occurences 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-12-15 16:40:27 +01:00
Jörn Friedrich Dreyer
6e75e41023 fix search index flags 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-12-15 16:40:27 +01:00
Christian Richter
7be33b0607 refactor interims DefaultAppCobra to DefaultApp 
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
 2025-12-15 16:40:26 +01:00
Christian Richter
e7a5788634 migrate search from urfave/cli to spf13/cobra 
Signed-off-by: Christian Richter <c.richter@opencloud.eu>
 2025-12-15 16:40:26 +01:00
Jörn Friedrich Dreyer
56817b7de7 introduce OC_EVENTS_TLS_INSECURE 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-11-28 11:17:39 +01:00
Jörn Friedrich Dreyer
10913ca00a Merge pull request #1918 from opencloud-eu/otlp-tracing 
update otlp tracing
 2025-11-27 12:57:26 +01:00
Jörn Friedrich Dreyer
a3ef7f6d79 update otlp tracing 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-11-27 12:28:15 +01:00
fschade
60501659c5 chore: bump %%NEXT%% 2025-11-27 10:53:59 +01:00
Jörn Friedrich Dreyer
538e8141b2 fix opensearch client certificate 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-11-21 12:23:07 +01:00
Jörn Friedrich Dreyer
b49cde429d log error 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-09-15 14:49:13 +02:00
Jörn Friedrich Dreyer
be402a3977 allow configuring insecure search client 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-09-15 14:48:50 +02:00
Jörn Friedrich Dreyer
f54582ddc4 fix event consumers 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-09-15 13:49:41 +02:00
Jörn Friedrich Dreyer
99dee5ae77 allow disabling search grpc/event servers 
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
 2025-09-15 12:42:56 +02:00
Roman Perekhod
c597dfb917 set default timeouts and clean up 2025-09-12 12:18:47 +02:00
Roman Perekhod
9a3fc08dd4 to separate controll ower the http and grpc driven services 2025-09-12 12:18:47 +02:00
Juan Pablo Villafáñez
9e1b80a1be feat: use runners to startup the services 2025-09-12 12:18:47 +02:00
Jörn Friedrich Dreyer
1a8fc4d336 Merge pull request #1416 from opencloud-eu/nats-connection-names 
Nats connection names
 2025-09-11 10:33:43 +02:00
Ralf Haferkamp
bcc96f1371 fix: re-generate mocks for search service 2025-09-09 17:04:21 +02:00
Juan Pablo Villafáñez
c0b4a5daa0 chore: change constant name to camelcase 2025-09-08 17:32:36 +02:00
Juan Pablo Villafáñez
ca2dc823ef feat: use names for connections to the nats event bus 2025-09-08 17:32:35 +02:00
fschade
d8192c8dae fix: adopt search upstream changes 2025-09-03 16:28:31 +02:00
André Duffeck
f9e43497ae Remove items from the index when they are purged from the trashbin 
Also purge all deleted items when the whole trashbin is purged.
 2025-09-03 11:18:37 +02:00
André Duffeck
71bde21a65 Improve logging 2025-09-03 11:18:21 +02:00
André Duffeck
398534761a Implement purging items from the index 2025-09-03 11:18:21 +02:00
André Duffeck
acd39b5ce8 Purge items from the index recursively 2025-09-03 11:18:19 +02:00
fschade
f615ccc896 enhancement(search): implement batch api 2025-09-02 13:06:08 +02:00
fschade
82e75e19c1 enhancement(search): move bleve engine into its own package and clean up the search batch processing implementation 2025-08-28 15:53:29 +02:00
André Duffeck
1003734b45 Use batches when restoring or moving items 2025-08-28 15:50:44 +02:00