Commit Graph

788 Commits

Author SHA1 Message Date
Vítor Vasconcellos
01d61631d7 Merge remote-tracking branch 'origin/main' into eng-1828-migration-to-new-cloud-api-system 2024-08-15 18:16:13 -03:00
Vítor Vasconcellos
6672c6cffc Remove unused code and update rust deps (#2662)
* Remove deps-generator app
 - It is broken for quite a while and not being used

* Remove unused code and unused deps

* auto format

* Restore incorrectly removed files
 - Remove aws deps and test code using it

* Replace winapi-util with windows-rs
 - Adjust some deps versions

* Autoformat

* Update rand, remove unused dep

* Fix image crate due to changes in pdf-renderer
 - Dont use default features in reqwest
 - Use native-tls tauri

* Remove incorrect notice about blake3
2024-08-15 17:09:03 +00:00
Ericson "Fogo" Soares
8527b42f84 Crypto revamp (#2660)
* Revamping crypto subcrate

* Merge with main

* More tweaks on crypto crate

* Remove some unsused crypto references

* Fix crypto erase example
2024-08-15 06:35:26 +00:00
Arnab Chakraborty
b14e4fce3a Deep linking wip
Pop up shows but doesn't pull focus on the app and actually doesn't receive events
2024-08-15 00:46:27 +03:00
Ericson Soares
5604e33bcc Fixing or commenting broken crap 2024-08-14 18:18:44 -03:00
Ericson Soares
45c90e4a29 Merge with main 2024-08-14 17:50:39 -03:00
Ericson Soares
1fd5c5f6bf Bad merge 2024-08-14 16:56:20 -03:00
Ericson Soares
1aa459ad23 Revamping crypto subcrate 2024-08-14 16:51:16 -03:00
Arnab Chakraborty
139ba6e1a4 [ENG-1854] Migrate to Tauri v2 Release Candidate (#2654)
* Migrate to Tauri v2 Release Canidate

* Formatting

* Update pnpm

* Update all tauri deps (js and rust) to Release Candidate 2
 - A lot of misc fixes due to changes in the new versions of tauri, rspc and specta

* Recreate pnpm-lock

* Fix pnpm-lock

* Formatting

* Use 10 chars SHA for git deps
 - Update a couple of rust dependencies
 - Add taplo for toml auto formatting
 - Adjust some formatting configurations
 - Updated prettier and its plugins

* Fix formatter settings

* Minor improvements to Cargo.toml format

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-08-14 18:22:46 +00:00
Arnab Chakraborty
019b157d9f Merge branch 'rocky/tauri-v2-rc' into eng-1828-migration-to-new-cloud-api-system 2024-08-13 13:51:52 +03:00
Vítor Vasconcellos
8b3574d7a6 Use 10 chars SHA for git deps
- Update a couple of rust dependencies
 - Add taplo for toml auto formatting
 - Adjust some formatting configurations
 - Updated prettier and its plugins
2024-08-12 17:49:31 -03:00
Arnab Chakraborty
1db15a5f50 Remove keyring crate
We found a different solution, as the keyring crate isn't supported on Android
2024-08-12 20:26:11 +03:00
Matthew Yung
16444fbfb4 [ENG-1836] Prevent "zombie" jobs from appearing in the job manager (#2653)
job manager doesn't display zombie jobs while not running
2024-08-12 16:42:54 +00:00
Vítor Vasconcellos
a9fc60095d Update all tauri deps (js and rust) to Release Candidate 2
- A lot of misc fixes due to changes in the new versions of tauri, rspc and specta
2024-08-10 00:11:52 -03:00
Arnab Chakraborty
381a9e4577 Mocked Device data for UI 2024-08-08 01:46:08 +03:00
Arnab Chakraborty
41e21a375a Forgot library delete D: 2024-08-07 23:14:56 +03:00
Arnab Chakraborty
01cc022f43 PubId, not Uuid 2024-08-07 20:00:15 +03:00
Arnab Chakraborty
fa7de373fe Forgot to import types D: 2024-08-07 18:20:20 +03:00
Arnab Chakraborty
f3bbee09e0 Add create library route to libraries.rs 2024-08-07 18:16:06 +03:00
Arnab Chakraborty
46a400880b Migrate all cloud routes to the new API system
All cloud routes are now migrated to the new system in the backend.

The old routes are still available, as the frontend has not been modified to use the new ones yet.
2024-08-07 17:55:22 +03:00
Ericson Soares
8739a7466a Some new abstractions and tweaks to develop cloud services calls 2024-08-07 03:21:01 -03:00
Arnab Chakraborty
04955c7003 Bring back old cloud.library.list
Old API stuff
2024-08-07 01:19:11 +03:00
Arnab Chakraborty
2a24022f93 Completed cloud.devices rspc route
Everything is done except "hello", "register", and "update", which are being handled by Ericson
2024-08-07 01:17:38 +03:00
Ericson Soares
60695b8dd4 Converting cloud services error to rspc 2024-08-06 18:51:50 -03:00
Arnab Chakraborty
25ee5ca362 Working example for new API system
A working example to fetch data from the new cloud services system.
2024-08-06 12:47:53 +03:00
Ericson Soares
713f3227c9 Setup client for Cloud Services in Node 2024-08-02 18:53:29 -03:00
Arnab Chakraborty
4130f792f6 wip: Getting User Data from backend 2024-07-30 11:00:59 +03:00
Vítor Vasconcellos
f56fcaf97e Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-07-28 16:30:25 -03:00
Arnab Chakraborty
cbf9c93e0a Working auth key storage in Keychain
Credentials like the auth access token are stored in the user's Keychain instead of in localStorage for security reasons.
2024-07-27 20:48:15 +03:00
Arnab Chakraborty
4bdb8ebb47 Update keys.rs 2024-07-27 17:20:47 +03:00
Lynx
dbc7cd6547 Bump version to 0.4.1 (#2639) 2024-07-26 21:28:21 +00:00
Arnab Chakraborty
a1e7df67a8 wip: Use Keychain instead of Localhost for Storage
We store auth creds in the actual keychain of the device and not in localstorage.

Currently works, but will fail if we move completely away from localStorage.
2024-07-26 23:58:44 +03:00
Arnab Chakraborty
e9d72b9b6b Merge branch 'main' into eng-1828-migration-to-new-cloud-api-system 2024-07-23 14:04:43 +03:00
Arnab Chakraborty
3db7ae7712 Change service subdomain url from app to api 2024-07-23 13:41:30 +03:00
Consoli
ffce39c916 Update log messages to prettier, easier-to-read format (#2627)
Better formatting for logs
2024-07-23 01:35:46 +00:00
Arnab Chakraborty
e2501e7705 Alpha 0.4.0 (#2618)
0.4.0
2024-07-19 22:27:55 +00:00
Arnab Chakraborty
936a0f65d2 New Config Structure 2024-07-19 16:43:38 +03:00
Ericson "Fogo" Soares
f69cba19c5 Fix a panic on old job system (#2615)
Also fixing errors on watcher, we must not generate thumbs and extract media data for duplicates
2024-07-18 23:22:41 +00:00
Ericson "Fogo" Soares
8147f78a55 [ENG-1793] Introduce error handling for sd-core-sync crate (#2556)
* Error handling for sd-core-sync crate
Also a bunch of tweaks and fixes

* Update core.ts

* Auto format

* Comment out background_processing_percentage on frontend too
 - Update rust version in contributing

* Trying to avoid data loss on actor stop

* Stronger linter on sync generator

* Stronger lint on sync subcrate

* Clean back tasks.json file

* TS typechecking

* Autoformat

* Add more verbose errors for Cloud REST API

* Removing some comments

Copilot is fun sometimes lol

* Properly stopping actors

* Fix ingest stop

* Racing on stop for actors

* Error conversion from merge with main

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Co-authored-by: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
2024-07-16 22:30:35 +00:00
Ericson "Fogo" Soares
a0092fcef3 [ENG-1824] Fix Library Statistics (#2601)
* Done

* Updating storage statistics on volume watcher

* Don't sum up directories sizes for statistics

* storage bar ui changes

* changed storage bar colour gradient

* implemented loading state for statistics

* Fix migration

* Solving crashing and removing sleep

* Properly using useState I guess, not a TS dev

* fixed some ui issues

* Fixing reactivity issue

---------

Co-authored-by: myung03 <matthewyungisworking@gmail.com>
2024-07-16 15:17:53 +00:00
Lynx
b4193b74ab Fix misspelled "vacuum" (#2595) 2024-07-09 19:28:06 +00:00
Ericson "Fogo" Soares
7bba5eea63 [ENG-1813] Introduce caching for Kind Statistics (#2585)
* Backend done

* Forgot new migration

* track subscription in file kind stats

* Real time updates on both graphs at overview

---------

Co-authored-by: myung03 <matthewyungisworking@gmail.com>
2024-07-07 05:58:00 +00:00
Ericson "Fogo" Soares
7d431526a7 [ENG-1814] Assign objects to directories on File Identifier Job (#2580)
* Done

* Bugged edge case when the root location only had directories
Also a bug on the get orphan queries, now a file_path is only unidentified if it doesn't has a object_id.

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-07-05 11:00:45 +00:00
Ericson "Fogo" Soares
ef048a866c [ENG-1809] Make core more resilient to crashes (#2574)
* Catching panics

* Re-enable unwind on release profile

* Reverting deps due to bad assertion

* Comment why the deps where reverted

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-06-30 03:59:01 +00:00
Arnab Chakraborty
aaf1f237cd [MOB-72] Tracing logs not working on Android (#2569)
* Logging to logcat instead of logfile

Hopefully works now?

* Lock dep for Android builds only

* Don't want only debug logs lol

* Update lib.rs
2024-06-26 20:20:16 +00:00
Matthew Yung
f7b0e3bd06 [ENG-1794] Overview Rework (#2555)
* StorageBar implementation

* filekindstats reworked into interactive node graph

* ui changes to graph

* light/dark mode changes + ui edits

* missing dependancy in package.json and minor visual improvements

* fixed collision physics

* d3 force package

* fixed nodes going off screen

* removed onNodeDragEnd

* fix central node and add particle effect

* fixed central node and typescript errors

* bar graph/storage bar ui improvements

* changed icons

* totals

* made ui changes

* ui changes

* minor requested ui changes

* fixed spacing for ui

* Remove extraneous newline in core/src/api/libraries.rs

* Fix minor suggestions from code review

* Fix typecheck

* Auto format

* refactor file kind stat card with css grid

* ensure unidentified files never negative

* FIxing some stats

* Counting directories

* fixed error with height of bars

* updated storage bar

* total files update

---------

Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Co-authored-by: James Pine <ijamespine@me.com>
Co-authored-by: Lynx <141365347+iLynxcat@users.noreply.github.com>
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Co-authored-by: Lynx <ephemeral.lynx@protonmail.com>
Co-authored-by: Ericson Soares <ericson.ds999@gmail.com>
2024-06-24 20:00:51 +00:00
ameer2468
47a4e9a1f7 0.3.2 (#2559) 2024-06-20 12:02:20 +00:00
Arnab Chakraborty
18235c6f09 [MOB-106] Cloud Sync for Mobile (#2549)
* wip + working backfill

* Finished BackfillWaiting page + initial auth setup

Also, setting up the cloud sync page.

* mobile auth

* Import Cloud Library

Currently, you can import a cloud library, however it seems that the data, such as locations, is not transferring correctly.

* Working Mobile Cloud Sync

Cloud Sync works for Mobile, and the mobile app can sync files from a cloud library, and other clients can access the data from the phone's cloud library.

* Cloud Sync Done

* Formatting

* Fix new library button

* New device type passing to auth

* Improve design of cloud settings and import modal

* ui adjustments and code cleanup

* Update styling if there's only 1 instance

* code cleanup, design tweaks

* empty state & simple indicator animation

* lint

* loading indicator and cleanup

* Fix to Sync Subscription

* Update Cargo.lock

* Async logout for debug

* tweaks

* Update SettingsStack.tsx

* cleanups and cloud desktop design improvements

* more cleanups and ui improvements

* ts

* i18n

* Cloud Sync Docs

* styling

* Delete library-sync.mdx

Moving docs to a separate branch

---------

Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
2024-06-18 08:46:29 +00:00
Ericson "Fogo" Soares
bdc242a852 [ENG-1775] Scan location using new jobs (#2476)
* First draft on task system usage, still missing job system

* Scan location roughly working, a ton of stuff to fix yet

* Updating some deps due to crashes and bugs

* Exposing non critical errors to frontend

* Getting active job reports from job system

* Using boxed opaque type to avoid a downcast issue with generics

* Task system issues discovered on race conditions

* Enable debug

* Fix job report in the job manager

* Fix race condition on steal tasks

* Fixed race condition on task suspend

* Some fixes on job progress reporting and save

* Fixed many race conditions and a hard deadlock
Also some progress report polishing

* Ignore .ts and .mts video files for now

* Some better logs

* bruh

* Internal deadlocks and excess of communication in the task system
- Also better logs

* Bunch of fixes and optimizations

* WIP at fixing file identifier

* Fixed file identifier job
- still need to work on its progress report frontend

* A bunch of polishing

* Fixed some bugs and did more polishing

* Cleanup

* Bridging old and new job systems

* A ton of fixes

* A bunch of bugs related to shutdown and resume

* Indexer and watcher bugs

* Log normalizing

* Fixing CI

* Change error! to warn! on non critical errors log

* Fix redirect to new location

* Type annotation

* Bogus merge resolution on cargo lock
2024-06-17 21:30:57 +00:00
Vítor Vasconcellos
405fb023d8 Clean up and update rust dependencies (#2544)
* Clean up and update rust dependencies

* Attempt to fix Windows Error
2024-06-10 19:44:00 +00:00