Commit Graph
29 Commits
Author SHA1 Message Date
Dominik Schmidt 77bb974f9b test(search): run acceptance and CI against the released tika 4.0.0
Both tika pins (local compose and the CI service) point at apache/tika:4.0.0-full; the search README links tika version-less.
2026-09-01 09:09:55 +02:00
Dominik Schmidt 1bf813068e docs(search): version-free index example in the README too 2026-08-31 14:17:29 +02:00
Dominik Schmidt 9503884472 docs(search): migration notes for schema v4
Also make the reindex copy safe to run after the service already indexed (op_type create, conflicts proceed).
2026-08-31 13:40:43 +02:00
Dominik Schmidt 7d55849900 feat(search): version the search index by schema version
Both backends carry a shared search.SchemaVersion in the index name
(OpenSearch <base>-vN) and data path (bleve-vN). A breaking schema change
bumps the version so the service builds a fresh index instead of colliding
with the incompatible previous one; the old index is left in place.
2026-08-31 13:40:42 +02:00
Florian Schade bd4287762e fix(search): answer the same on both engines
both engines now agree on names, titles, tags, paths, types, sizes, dates,
hidden flags, facet values and wildcards. quotes only delimit phrases and
the equals operator matches the whole field value, following the kql spec.
the index name carries a generation so a changed mapping starts on a fresh
index, MIGRATION.md says how to fill it.
2026-08-31 10:44:03 +02:00
Dominik Schmidt 426d768d59 docs(search): fix force-rescan flag name in README
Closes #2721
2026-05-12 17:08:18 +02:00
André Duffeck 60bcc6b0f2 Add a flag to the reindex command to force a full reindex
That can be helpful when the search service configuration has changed,
e.g. by enabling TIKA. Previously files that had already been indexed
were not indexed again and thus were no part of the fulltext index.

Fixes #2285
Fixes #2578
2026-04-14 08:20:28 +02:00
fschade e3e778b866 fix(search): readme typos and mention the lack of scalability 2025-09-18 09:42:21 +02:00
fschade b0d484be86 enhancement(search): document SEARCH_ENGINE_BLEVE_DATA_PATH and SEARCH_ENGINE_OPEN_SEARCH_RESOURCE_INDEX_NAME 2025-09-17 16:57:09 +02:00
Florian SchadeandAndre Duffeck 7af3a15fc8 Apply suggestions from code review
Co-authored-by: Andre Duffeck <aduffeck@users.noreply.github.com>
2025-09-17 16:04:19 +02:00
fschade a1a9d67497 enhancement(search): simplify search docs and document opensearch backend 2025-09-16 16:28:32 +02:00
Anja Barz f36cf7832b remove opencloud_full from the read.me and add opencloud-compose instead (#1474)
* remove opencloud_full from the read.me and add opencloud-compose instead

* remove wrong changes

* add eicar file which accendially was removed

* replace eicar.zip
2025-09-09 13:07:32 +02:00
André Duffeck 3bd7a61e46 Document the metrics exposed in search and postprocessing 2025-07-18 08:50:03 +02:00
Jörn Friedrich Dreyer 8ac250952f url fixes, more decisions
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2025-01-29 16:49:39 +01:00
André Duffeck 6bab922c7c Rebrand search 2025-01-17 09:25:36 +01:00
Viktor Scharf eb5a9ceade Merge pull request #9442 from owncloud/full-deployment
 [docs-only] feat: create ocis_full compose deployment
2024-06-28 12:50:56 +02:00
Michael Barz fd3178c4b3 docs: cleanup docs 2024-06-27 14:34:34 +02:00
jkoberg 01cdc153a5 docu(search): update index spaces command docu
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2024-06-27 14:22:01 +02:00
Martin 4b86bd0921 [docs-only] Update search README.md (#7655)
References: #7553 (enhancement: improve content extraction stop word cleaning)

Making the term `stop word` and the use of the envvar more clear.
2023-11-03 14:46:02 +01:00
Florian SchadeandMartin cdd2100b4b enhancement: improve content extraction stop word cleaning (#7553)
* enhancement: improve content extraction stop word cleaning

* fix: cleanup documentation

Co-authored-by: Martin <github@diemattels.at>

* fix: failing tika stop word unit tests

---------

Co-authored-by: Martin <github@diemattels.at>
2023-10-23 13:40:37 +02:00
Florian Schade 844783b6f9 [full-ci] - use KQL as default search query language (#7212)
* enhancement: use kql as default search query language

* enhancement: add support for unicode search queries

* fix: escape bleve field query whitespace

* fix: search related acceptance tests

* enhancement: remove legacy search query language

* enhancement: add support for kql dateTime restriction node types

* chore: bump web to v8.0.0-alpha.2

* fix: failing search api test

* enhancement: search bleve query compiler use DateRangeQuery as DateTimeNode counterpart

* enhancement: support for colon operators in dateTime kql queries
2023-09-07 11:13:33 +02:00
Andre DuffeckandMartin c0665975b3 Do not try to fulltext-index large files. (#6395)
* Do not try to extract the content of large files.

Both tika and ocis do not handle large files/archives very well.

* Apply suggestions from code review

Co-authored-by: Martin <github@diemattels.at>

---------

Co-authored-by: Martin <github@diemattels.at>
2023-05-27 19:03:58 +02:00
kobergjandMartin 382a2800f8 Update services/search/README.md
Co-authored-by: Martin <github@diemattels.at>
2023-05-24 13:58:40 +02:00
jkoberg 50ef698fda add fulltextsearch capability
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-05-24 13:58:37 +02:00
Martin da49a5cd71 Update services/search/README.md 2023-05-15 14:20:16 +02:00
Martin d3cd43861c [docs-only ]Update search README.md
Add a note that tika containers are only available for the amd64 platform.
2023-05-15 14:20:16 +02:00
mmattel 456387c69f [docs-only] Add Tika container link to search for dev purposes 2023-05-12 09:31:21 +02:00
mmattel b2504035e0 fix readme service names 2023-04-12 18:40:41 +02:00
mmattel 8dda0c6728 create readme.md for seach 2023-02-07 09:51:37 +01:00