Commit Graph

358 Commits

Author SHA1 Message Date
Ericson Soares
16f37c9216 Update to new schema tweaking sync groups get route
Also removing some stale fields
2024-09-29 01:15:46 -03:00
Ericson Soares
b7493e8441 Refactor out access_token from all routes except bootstrap 2024-09-26 00:06:14 -03:00
Arnab Chakraborty
1a712493fb Fix cors issue & start auto bootstrapping cloud 2024-09-23 22:56:59 -04:00
Ericson Soares
5f9277f169 Trying to fix iroh discovery 2024-09-22 23:37:43 -03:00
Arnab Chakraborty
46a944ccc9 Work on getting request_join working
Currently have debug routes on how the flow of joining a sync group works, and there a few bugs internally still giving us issues.
2024-09-22 11:03:44 -04:00
Ericson Soares
d0e52a4342 Fix identifier bug 2024-09-19 22:02:32 -03:00
Arnab Chakraborty
6ac688b42b Lots of changes
- Constant for Auth server URL
- Modify config to save Pretty Name of device
- Properly list devices from Cloud Backend
2024-09-18 22:28:38 -04:00
Ericson Soares
3094a35a5a Initialize cloud sync 2024-09-13 19:27:34 -03:00
Ericson Soares
03e9de497b Fix key size mismatch between opaque and sd_crypto 2024-09-13 12:54:36 -03:00
Arnab Chakraborty
0251cbc4ea Device routes & registering of device (mostly)
Still wip though
2024-09-11 00:52:40 -04:00
Ericson Soares
2f270cca2a Ingester actor 2024-09-09 16:50:05 -03:00
Ericson Soares
9f8005c479 Relating tables to device 2024-09-06 23:53:35 -03:00
Ericson Soares
25f0f4fb1a Sender actor for cloud sync messages 2024-08-30 03:34:03 -03:00
Ericson Soares
d691e79ef3 First draft on cloud sync api with rspc 2024-08-28 02:03:19 -03:00
Ericson Soares
76cba5226d More tweaks on sync subcrate and other fixes 2024-08-27 23:45:05 -03:00
Ericson Soares
d0886b7d89 bruh 2024-08-27 17:05:37 -03:00
Ericson Soares
4bf8db02f7 Make core compile again 2024-08-27 17:01:42 -03:00
Ericson Soares
a068ca7c7b Some tweks to simplify sync subcrate
Initial work to port cloud sync system to new cloud services
2024-08-23 23:42:51 -03:00
Ericson Soares
04b60bf0e2 Integrate cloud p2p into node and rspc routes 2024-08-23 17:38:34 -03:00
Arnab Chakraborty
aeb102abfb First autoformat of the PR 2024-08-20 20:52:21 +03:00
Ericson Soares
e96fa6ead1 Device register route and integrate key manager on bootstrap 2024-08-19 20:38:07 -03:00
Arnab Chakraborty
bfbe064dd8 Modify MockDevice with data for overview 2024-08-17 00:36:51 +03:00
Vítor Vasconcellos
901aa4c665 Merge remote-tracking branch 'origin/main' into eng-1828-migration-to-new-cloud-api-system 2024-08-15 18:16:13 -03:00
Vítor Vasconcellos
df1f503867 Remove unused code and update rust deps (#2662)
* Remove deps-generator app
 - It is broken for quite a while and not being used

* Remove unused code and unused deps

* auto format

* Restore incorrectly removed files
 - Remove aws deps and test code using it

* Replace winapi-util with windows-rs
 - Adjust some deps versions

* Autoformat

* Update rand, remove unused dep

* Fix image crate due to changes in pdf-renderer
 - Dont use default features in reqwest
 - Use native-tls tauri

* Remove incorrect notice about blake3
2024-08-15 17:09:03 +00:00
Ericson Soares
c3e1ac2e65 Fixing or commenting broken crap 2024-08-14 18:18:44 -03:00
Ericson Soares
3b9acc9fe2 Merge with main 2024-08-14 17:50:39 -03:00
Ericson Soares
0cf6f278eb Revamping crypto subcrate 2024-08-14 16:51:16 -03:00
Arnab Chakraborty
8f6100e5bc Remove keyring crate
We found a different solution, as the keyring crate isn't supported on Android
2024-08-12 20:26:11 +03:00
Matthew Yung
9bcc4efb1e [ENG-1836] Prevent "zombie" jobs from appearing in the job manager (#2653)
job manager doesn't display zombie jobs while not running
2024-08-12 16:42:54 +00:00
Arnab Chakraborty
da44a4e5fc Mocked Device data for UI 2024-08-08 01:46:08 +03:00
Arnab Chakraborty
d0d5f74066 Forgot library delete D: 2024-08-07 23:14:56 +03:00
Arnab Chakraborty
ff35019f0a PubId, not Uuid 2024-08-07 20:00:15 +03:00
Arnab Chakraborty
cf08c8b08b Forgot to import types D: 2024-08-07 18:20:20 +03:00
Arnab Chakraborty
51141c6d4e Add create library route to libraries.rs 2024-08-07 18:16:06 +03:00
Arnab Chakraborty
e2d1862766 Migrate all cloud routes to the new API system
All cloud routes are now migrated to the new system in the backend.

The old routes are still available, as the frontend has not been modified to use the new ones yet.
2024-08-07 17:55:22 +03:00
Ericson Soares
8718de0928 Some new abstractions and tweaks to develop cloud services calls 2024-08-07 03:21:01 -03:00
Arnab Chakraborty
2094201a5f Bring back old cloud.library.list
Old API stuff
2024-08-07 01:19:11 +03:00
Arnab Chakraborty
0beee744b2 Completed cloud.devices rspc route
Everything is done except "hello", "register", and "update", which are being handled by Ericson
2024-08-07 01:17:38 +03:00
Arnab Chakraborty
386248f853 Working example for new API system
A working example to fetch data from the new cloud services system.
2024-08-06 12:47:53 +03:00
Arnab Chakraborty
70452ec841 wip: Getting User Data from backend 2024-07-30 11:00:59 +03:00
Arnab Chakraborty
a071419908 Working auth key storage in Keychain
Credentials like the auth access token are stored in the user's Keychain instead of in localStorage for security reasons.
2024-07-27 20:48:15 +03:00
Arnab Chakraborty
182cc4f960 Update keys.rs 2024-07-27 17:20:47 +03:00
Arnab Chakraborty
9bc00cd33c wip: Use Keychain instead of Localhost for Storage
We store auth creds in the actual keychain of the device and not in localstorage.

Currently works, but will fail if we move completely away from localStorage.
2024-07-26 23:58:44 +03:00
Ericson "Fogo" Soares
2d19fad2eb [ENG-1793] Introduce error handling for sd-core-sync crate (#2556)
* Error handling for sd-core-sync crate
Also a bunch of tweaks and fixes

* Update core.ts

* Auto format

* Comment out background_processing_percentage on frontend too
 - Update rust version in contributing

* Trying to avoid data loss on actor stop

* Stronger linter on sync generator

* Stronger lint on sync subcrate

* Clean back tasks.json file

* TS typechecking

* Autoformat

* Add more verbose errors for Cloud REST API

* Removing some comments

Copilot is fun sometimes lol

* Properly stopping actors

* Fix ingest stop

* Racing on stop for actors

* Error conversion from merge with main

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Co-authored-by: Arnab Chakraborty <11457760+Rocky43007@users.noreply.github.com>
2024-07-16 22:30:35 +00:00
Ericson "Fogo" Soares
345b2e1b63 [ENG-1824] Fix Library Statistics (#2601)
* Done

* Updating storage statistics on volume watcher

* Don't sum up directories sizes for statistics

* storage bar ui changes

* changed storage bar colour gradient

* implemented loading state for statistics

* Fix migration

* Solving crashing and removing sleep

* Properly using useState I guess, not a TS dev

* fixed some ui issues

* Fixing reactivity issue

---------

Co-authored-by: myung03 <matthewyungisworking@gmail.com>
2024-07-16 15:17:53 +00:00
Lynx
f45dff5d3c Fix misspelled "vacuum" (#2595) 2024-07-09 19:28:06 +00:00
Ericson "Fogo" Soares
71d6eabdb6 [ENG-1813] Introduce caching for Kind Statistics (#2585)
* Backend done

* Forgot new migration

* track subscription in file kind stats

* Real time updates on both graphs at overview

---------

Co-authored-by: myung03 <matthewyungisworking@gmail.com>
2024-07-07 05:58:00 +00:00
Ericson "Fogo" Soares
9406a29079 [ENG-1814] Assign objects to directories on File Identifier Job (#2580)
* Done

* Bugged edge case when the root location only had directories
Also a bug on the get orphan queries, now a file_path is only unidentified if it doesn't has a object_id.

---------

Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
2024-07-05 11:00:45 +00:00
Matthew Yung
5a2fec961a [ENG-1794] Overview Rework (#2555)
* StorageBar implementation

* filekindstats reworked into interactive node graph

* ui changes to graph

* light/dark mode changes + ui edits

* missing dependancy in package.json and minor visual improvements

* fixed collision physics

* d3 force package

* fixed nodes going off screen

* removed onNodeDragEnd

* fix central node and add particle effect

* fixed central node and typescript errors

* bar graph/storage bar ui improvements

* changed icons

* totals

* made ui changes

* ui changes

* minor requested ui changes

* fixed spacing for ui

* Remove extraneous newline in core/src/api/libraries.rs

* Fix minor suggestions from code review

* Fix typecheck

* Auto format

* refactor file kind stat card with css grid

* ensure unidentified files never negative

* FIxing some stats

* Counting directories

* fixed error with height of bars

* updated storage bar

* total files update

---------

Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
Co-authored-by: James Pine <ijamespine@me.com>
Co-authored-by: Lynx <141365347+iLynxcat@users.noreply.github.com>
Co-authored-by: Vítor Vasconcellos <vasconcellos.dev@gmail.com>
Co-authored-by: Lynx <ephemeral.lynx@protonmail.com>
Co-authored-by: Ericson Soares <ericson.ds999@gmail.com>
2024-06-24 20:00:51 +00:00
Arnab Chakraborty
7c739c6967 [MOB-106] Cloud Sync for Mobile (#2549)
* wip + working backfill

* Finished BackfillWaiting page + initial auth setup

Also, setting up the cloud sync page.

* mobile auth

* Import Cloud Library

Currently, you can import a cloud library, however it seems that the data, such as locations, is not transferring correctly.

* Working Mobile Cloud Sync

Cloud Sync works for Mobile, and the mobile app can sync files from a cloud library, and other clients can access the data from the phone's cloud library.

* Cloud Sync Done

* Formatting

* Fix new library button

* New device type passing to auth

* Improve design of cloud settings and import modal

* ui adjustments and code cleanup

* Update styling if there's only 1 instance

* code cleanup, design tweaks

* empty state & simple indicator animation

* lint

* loading indicator and cleanup

* Fix to Sync Subscription

* Update Cargo.lock

* Async logout for debug

* tweaks

* Update SettingsStack.tsx

* cleanups and cloud desktop design improvements

* more cleanups and ui improvements

* ts

* i18n

* Cloud Sync Docs

* styling

* Delete library-sync.mdx

Moving docs to a separate branch

---------

Co-authored-by: ameer2468 <33054370+ameer2468@users.noreply.github.com>
2024-06-18 08:46:29 +00:00