Commit Graph

142 Commits

Author SHA1 Message Date
kobergj
9057d231a8 fix search service startup (#7795)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-11-24 08:35:10 +01:00
Christian Richter
1cdd839fc7 add form mime type
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-11-22 11:37:53 +01:00
Roman Perekhod
7175316292 fix the tgz mime type, bump reva 2023-11-21 17:33:52 +01:00
Roman Perekhod
8a6464798f fix last month search 2023-11-17 10:04:55 +01:00
Roman Perekhod
7ab553e23b add file type filter chip (#7602)
* add file type filter chip

* changed the keyword

* use reva issue-7432-replace

* changed the filter name. fix types

* rework mapBinary

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-11-13 18:04:17 +01:00
Florian Schade
643158b67b enhancement: add sharedWithMe graph beta endpoint (#7633) 2023-11-08 20:02:58 +01:00
Dominik Schmidt
db32fb46f9 Audio Metadata (#7490)
* Add audio facet to search protobuf message

* Add audio metadata to search index

* Return audio facet from search if available

* Store audio metadata in arbitrary metadata

* Add audio facet to driveItems listings

* Make tests coding style more consistent

* Fix tests

* Add changelog

* Make valueToString code more defensive

* Log status code as well
2023-11-06 08:56:46 +01:00
Florian Schade
cdd2100b4b enhancement: improve content extraction stop word cleaning (#7553)
* enhancement: improve content extraction stop word cleaning

* fix: cleanup documentation

Co-authored-by: Martin <github@diemattels.at>

* fix: failing tika stop word unit tests

---------

Co-authored-by: Martin <github@diemattels.at>
2023-10-23 13:40:37 +02:00
Roman Perekhod
acfae80b53 add last modified filter chip (#7455)
* add last modified filter chip

* Update add-last-modified-filter-chip.md

---------

Co-authored-by: Roman Perekhod <rperekhod@owncloud.com>
2023-10-19 18:25:01 +02:00
Christian Richter
e56b23541a remove obsolete cli flags
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-10-11 16:31:10 +02:00
jkoberg
f189b11ba9 default async uploads
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-10-05 15:33:42 +02:00
Jörn Friedrich Dreyer
3efe843742 prevent panic when user is nil
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-09-21 17:19:18 +02:00
Roman Perekhod
911ea1c0f6 fix kql-bleve search. wildcards are excluded 2023-09-15 17:14:59 +02:00
Florian Schade
0f2b2b9a94 [full-ci] enhancement: add support for natural language kql date ranges (#7263)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec

* enhancement: add support for natural language kql date queries

* enhancement: structure kql parser tests into logical clusters

* fix: time-range error naming
2023-09-15 11:31:41 +02:00
Florian Schade
c0553c7273 [full-ci] enhancement: add more kql spec tests and simplify ast normalization (#7254)
* enhancement: add more kql spec tests and simplify ast normalization

* enhancement: kql parser error if query starts with AND

* enhancement: add kql docs and support for date and time only dateTimeRestriction queries

* enhancement: add the ability to decide how kql nodes get connected

connecting nodes (with edges) seem straight forward when not using group, the default connection for nodes with the same node is always OR. THis only applies for first level nodes, for grouped nodes it is defined differently. The KQL docs are saying, nodes inside a grouped node, with the same key are connected by a AND edge.

* enhancement: explicit error handling for falsy group nodes and queries with leading binary operator

* enhancement: use optimized grammar for kql parser and toolify pigeon

* enhancement: simplify error handling

* fix: kql implicit 'AND' and 'OR' follows the ms html spec instead of the pdf spec
2023-09-11 13:49:53 +02:00
Roman Perekhod
158f91b398 fix unary in the beginning 2023-09-07 14:38:26 +02:00
Florian Schade
844783b6f9 [full-ci] - use KQL as default search query language (#7212)
* enhancement: use kql as default search query language

* enhancement: add support for unicode search queries

* fix: escape bleve field query whitespace

* fix: search related acceptance tests

* enhancement: remove legacy search query language

* enhancement: add support for kql dateTime restriction node types

* chore: bump web to v8.0.0-alpha.2

* fix: failing search api test

* enhancement: search bleve query compiler use DateRangeQuery as DateTimeNode counterpart

* enhancement: support for colon operators in dateTime kql queries
2023-09-07 11:13:33 +02:00
Florian Schade
0ec78ee7bb fix: failing tests and filter out specific matches 2023-09-01 12:07:56 +02:00
Florian Schade
a0f2adedb5 fix: acceptance tests to include path resource 2023-09-01 12:07:47 +02:00
Florian Schade
af9556f8f1 fix: search mount point inclusion 2023-09-01 12:07:38 +02:00
Florian Schade
b7f42004bc fix: search share expost 2023-09-01 12:07:31 +02:00
jkoberg
bd716156fc let ocis init set the serviceaccounts
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:44 +02:00
jkoberg
d8c2957c84 use service accounts for search
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-31 12:11:43 +02:00
Florian Schade
ed0dbce978 enhancement: Keyword Query Language (KQL) search syntax support (#7043)
* feat(search): introduce search query package

With the increasing complexity of how we organize our resources, the search must also be able to find them using entity properties.

The query package provides the necessary functionality to do this.

This makes it possible to search for resources via KQL, the microsoft spec is largely covered and can be used for this.

In the current state, the legacy query language is still used, in a future update this will be deprecated and KQL will become the standard
2023-08-28 16:41:36 +02:00
Daniel Swärd
49fc22d532 Add missing tracing references to multiple services. (#7110) 2023-08-23 15:17:17 +02:00
Christian Richter
d7139d4127 remove deprecated variables
Signed-off-by: Christian Richter <crichter@owncloud.com>
2023-08-22 17:25:24 +02:00
jkoberg
49cdcad129 unify eventstream creation
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-08-16 10:14:12 +02:00
Daniël Franke
952ebe7d7d Pass context to event publishing.
To allow tracing propagation via events, we need to pass the context
to the `Publish` function of reva events. This adds the context
everywhere where events are published. If there was no context to pass,
we started a new one with `context.Background()`.
2023-08-11 12:01:19 +02:00
Roman Perekhod
b879254fcb Fix the search 2023-08-03 17:02:25 +02:00
Daniel Swärd
6a5e21eff4 Replacing implicit grpc client initialization with explicit package local variables. 2023-07-31 12:57:59 +02:00
Daniel Swärd
82034d34ce Separate out grpc client to package local for search service. 2023-07-28 09:42:37 +02:00
Daniël Franke
e2fa2be973 Convert search service to use service tracing.
This converts the search service to use the service tracer.
It also initialises the grpc service with a trace provider.
2023-07-25 11:22:51 +02:00
Jörn Friedrich Dreyer
6bb265fcf0 use correct config struct for jwt token (#6761)
Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
2023-07-14 13:22:46 +02:00
Roman Perekhod
99b8cdc7d6 fix the total count 2023-07-12 18:13:58 +02:00
André Duffeck
1aa114c336 Remove false condition 2023-07-12 18:01:06 +02:00
André Duffeck
4bb10ebdf3 Support scoping searches in shares 2023-07-12 18:01:06 +02:00
Roman Perekhod
3487749509 Provide Search filter for locations #OCIS-3705 2023-07-12 18:01:06 +02:00
Martin
721f4e8422 Merge pull request #6723 from owncloud/fix_loglevel_description
[docs-only] Increase readability for log level values in the description
2023-07-07 17:06:38 +02:00
André Duffeck
ec8a260119 Handle shares received from project spaces.
Unfortunately searching these kinds of shares can't be fully fixed until
the service accounts have been implemented.
2023-07-07 12:48:00 +02:00
André Duffeck
b2f1e849fd Use the owner auth to get the path of shared resources
This fixes searching received shares that were not shared from the space
root.
2023-07-07 10:46:53 +02:00
mmattel
6ad53971ef [docs-only] Increase readability for log level values in the description 2023-07-07 10:33:42 +02:00
mmattel
d7b447b791 [docs-only] Increase readability for tracing values in the description 2023-07-07 09:50:39 +02:00
Daniël Franke
e43001fb96 Pass context for reva bump.
Also refresh the generated code.
2023-07-03 11:08:45 +02:00
Florian Schade
a26aea758a [full-ci] enhancement: add search result content preview and term highlighting. (#6634)
* enhancement: add search result content preview and term highlighting.

* chore: fix changelog

* noop

* enhancement: provide search highlight tests
2023-06-27 15:56:17 +02:00
Jörn Friedrich Dreyer
2ea3b8c400 unmarshal token to filter spaces for current user (#6596)
* unmarshal token to filter spaces for current user

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>

* Fix tests

---------

Signed-off-by: Jörn Friedrich Dreyer <jfd@butonic.de>
Co-authored-by: André Duffeck <andre.duffeck@firondu.de>
2023-06-22 16:15:17 +02:00
Andre Duffeck
20252409ba Handle events asynchronously (#6584) 2023-06-22 09:23:49 +02:00
Andre Duffeck
c81f423357 Merge pull request #6512 from aduffeck/fix-case-insensitivity
Always make Name and Tags queries case-insensitive
2023-06-20 08:39:50 +02:00
kobergj
384488b8c7 return permissions also for project spaces (#6528)
Signed-off-by: jkoberg <jkoberg@owncloud.com>
2023-06-14 16:52:52 +02:00
André Duffeck
80c944b311 Fix: Always make Name and Tags queries case-insensitive 2023-06-13 14:16:38 +02:00
Florian Schade
4f26424db6 [full-ci] enhancement: use reva client pool selectors (#6452)
* enhancement: use reva client pool selectors

register mock service to registry and pass tests

* enhancement: bump reva

* Fix a couple of linter issues

---------

Co-authored-by: Ralf Haferkamp <rhaferkamp@owncloud.com>
2023-06-08 12:41:04 +02:00