Commit Graph

3841 Commits

Author SHA1 Message Date
Matthew Leeds
012e47cb7d doc: Uncomment and tweak P2P docs
Now that P2P support is enabled unconditionally, uncomment the
P2P-related parts of the man pages.

Closes: #1803
Approved by: alexlarsson
2018-06-20 08:05:02 +00:00
Matthew Leeds
1a240ac686 transaction: Fix g-ir-scanner warnings
Closes: #1801
Approved by: alexlarsson
2018-06-20 07:52:55 +00:00
Matthew Leeds
85726180a1 tests: Run P2P tests unconditionally
Now that Flatpak always has P2P support enabled, the tests that are
dependent on it can always run.

Closes: #1804
Approved by: alexlarsson
2018-06-20 07:40:53 +00:00
Matthew Leeds
4e73b51a0b dir: Avoid unnecessary fetches of ostree-metadata
This commit removes fetches of ostree-metadata from
flatpak_dir_install() and flatpak_dir_update(), which both pull it into
the child repo when doing system-helper deployments. Both functions have
a FlatpakRemoteState object passed in and when that is initialized,
_flatpak_dir_fetch_remote_state_metadata_branch() pulls and deploys
ostree-metadata so it can be queried against for repo metadata and
served onto LAN and USB peers. So there's no need to pull it again here.

The issue of resolving a ref and its metadata atomically remains, but
that will be addressed by https://github.com/flatpak/flatpak/pull/1796.

Closes: #1806
Approved by: alexlarsson
2018-06-20 07:40:21 +00:00
Alexander Larsson
ac2d51b1c7 CI: Build ostree master (for p2p stuff)
Closes: #1800
Approved by: alexlarsson
2018-06-19 18:10:56 +00:00
Alexander Larsson
491d174879 Make p2p build non-optional
Closes: #1800
Approved by: alexlarsson
2018-06-19 18:10:56 +00:00
Alexander Larsson
0801f0cb13 configure: Require ostree 2018.6
This is the release with the stable p2p API

Closes: #1800
Approved by: alexlarsson
2018-06-19 18:10:56 +00:00
Alexander Larsson
065053775b run: Never inherit permissions from the runtime
We want inherit environment variables, but not actual permissions,
those need to be requested by the app only.

Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Alexander Larsson
80a33e6a1b CliTransaction: Print permissions in ready callback
This is a pretty lowlevel version of the permissions, and there
is no nice API for the library to produce these. However its got
the basics of permission tracking.

Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Alexander Larsson
23f1df8a5b Transaction: Add operation getters for metadata and old_metadata
Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Alexander Larsson
b1a7930cc7 TablePrinter: Add span cells
These can be used to print rows that are not cell-aligned.

Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Alexander Larsson
35615cbe54 Transaction: Track old metadata (for updates)
Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Alexander Larsson
db305f7287 Transaction: Keep metadata as GBytes
This makes it more easy to expose these without constantly
duplicating the memory.

Closes: #1799
Approved by: alexlarsson
2018-06-19 14:54:22 +00:00
Thibault Saunier
c0ef5aadcb scripts: Add a flatpak-coredumpctl to debug crashed application in gdb
Closes: #1784
Approved by: alexlarsson
2018-06-19 08:39:31 +00:00
Alexander Larsson
1e7e6376ff gtk-doc: Add all missing symbols to flatpak.sections
Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
0515e49140 transaction: Add APIs to set dependency sources
Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
5e8b5e5319 Transaction: Use flatpakTransactionOperation in signals
This changes the signals to use a FlatpakTransactionOperation
argument instead of a bunch of arguments in the signal, making
this easier to extend in the future.

This is an API break, but nobody is using this API yet, and it
was only available in one unstable release.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
462204462e Transaction: Add flatpak_transaction_operation_get_bundle_path
This is to match what you can get from the new_operation arguments.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
ffaf2d5386 Cli transaction: Print the full uninstall/install/update lists in ready
This lets you see what operations will happen and you can confirm
it before starting the heavy operations.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
f9ad4e3eee transaction: Add ready signal
This signal is emitted after all the added operations and their dependencies
are resolved and we have the full list of things that will be
done as part of the transaction. At this point you can call
flatpak_transaction_get_operations() and decide if you want to
continue with the operation.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
3367938432 update: Don't update appdata if transaction was aborted by user
Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
4c8f788ecd transaction: Make FlatpakTransactionOperation a (public) GObject
Only the type itself is exposed atm, not members, etc.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
16c097ce7a transaction: Rename FlatpakTransactionOp to FlatpakTransactionOperation
This is in preparation for exposing it a bit publically

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Alexander Larsson
79d43a3c1a transaction: Drop the internal FlatpakTransactionOpKind type
Instead use FlatpakTransactionOperationType internally too,
but extend it with a INSTALL_OR_UPDATE value which is not public.

Closes: #1797
Approved by: alexlarsson
2018-06-19 08:30:21 +00:00
Joonas Sarajärvi
59ecad0f29 Add ssh-auth socket support
SSH authentication sockets can be placed in a number of places, so it
is difficult for applications to just mount a fixed directory or
directories, hoping that SSH_AUTH_SOCK points somewhere inside the
mounted content.

Closes: #1764
Approved by: alexlarsson
2018-06-19 07:11:36 +00:00
Will Thompson
cd87b542ba doc/flatpak-info: update machine-readable output list
I generated this list mechanically from the big if () condition in
flatpak-builtins-info.c, which is why they're one per line, and I think
it's more maintainable in this layout. (Whitespace has no effect on the
HTML or manpage output.)

Closes: #1788
Approved by: alexlarsson
2018-06-19 07:02:15 +00:00
Will Thompson
4fdefefb06 doc/flatpak-info: add missing options
Compared to `flatpak info --help` (which is what actually counts), 6
options were not documented, and one (--version) was documented but
doesn't exist.

Closes: #1788
Approved by: alexlarsson
2018-06-19 07:02:15 +00:00
Alexander Larsson
b6d63eaa9a Remove unused variable
Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:29 +00:00
Alexander Larsson
66eee3c2c7 Transaction: Change how dependencies are resolved
Instead of resolving dependencies when adding refs to the list we make
adding refs trivial, and then add a dependency-resolving and ordering
phase to the start of flatpak_transaction_run().

Instead of resolving dependencies for each ref by itself this means
that we have a long list of refs we can work on. For the moment this
isn't really used, but it will later allow us to be much more
efficient in the p2p codepath because we can hand over a lot of refs
in a single p2p operation.

There are some complexities, for instance, we don't know initially
which the final refs will be, because the dependency resolving will
add new ones, yet we must still start with some operation.

The way this works is by repeated stages:

 * Resolve the operatations for all the initially specified
   refs. Resolve means doing i/o to determine the latest available
   commit id, and the corresponding metadata for that commit.

 * Add dependencies for all resolved ops, this typically means looking
   at the apps and finding which runtime they need, and then finding a
   runtime to install or update.

 * Resolve all new refs, meaning we now load the metadata for the
   runtime dependencies we added before.

 * Add related refs for all resolved ops, i.e. extensions for apps
   and runtimes. These are marked for install/update as needed.

 * Resolve the final refs.

Now we have a full list of things that we need to install or update,
and for each the commit id and the corresponding metadata. We can at
this point:

 * Verify that the metadata is valid for this version of flatpak
 * Verify that the metadata permissions are not greater than the
   previous version on updates (confirm if so).
 * Guarantee that the above verification will be correct becase
   we resolved each operation to a particular commit it that we
   will pull.
 * Quickly decide which update operations to skip because they
   are no-ops (same as installed version).

There are also some complexities wrt operation ordering. Previously
we decided the ordering when emitting the dependencies, but now
we can't do that since the dependencies are added in non-ordered chunks.
Instead we add some dependency information during the dependency
gathering and do a topological sort at the end.

This is the first step towards a better transaction handling, but here
are still some things left to do:

 * resolve_ops() calls flatpak_dir_find_latest_rev() for each
   operation, which is fine in the normal case as it just looks
   at the summary cached in the RemoteState. However in the p2p
   case it is very inefficient. Now that we have a chunk of
   refs we could resolve in parallel we should instead do a
   single find_remotes() + pull_remotes(COMMITS_ONLY) operation which
   will be much faster.
 * In the p2p case we're still using the metadata from the ostree-metadata
   branch, which may not be the same as the version we will actually be
   pulling. The above COMMITS_ONLY pull operation will allow us to instead
   read the metadata from the real commit objects (which we're guaranteed
   to actually get due to us locking down the commit id when pulling).
 * Even in the non-p2p case we get the wrong metadata when doing an
   explicit downgrade (update --commit=...) because we're using the
   metadata from the summary which only applies to the latest commit.
   This needs to be changed to also pull the commit object.
 * After resolve, but before pulling the full ref we are not currently
   doing metadata permission verification (vs last installed version)
   to see if new permissions need to be requested. This needs to be
   added. We could also let the user pass in pre-acked permissions so
   that a UI can show permissions ahead of time and then avoid
   confirming them again.

Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:29 +00:00
Alexander Larsson
bdbd4d15e2 dir: Split flatpak_dir_find_local/remote_related()
These are split into two, one that loads the metadata and one
that works on the pre-loaded GKeyFile.

This changes no behaviour, but we will later use the split out
functions from FlatpakTransaction when we already have the
metadata loaded.

Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:29 +00:00
Alexander Larsson
641e416280 dir: Export flatpak_dir_find_latest_rev
Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:29 +00:00
Alexander Larsson
0a6f676161 dir: Split flatpak_dir_check_for_update
This splits out the part that extracts the current commit id
from the code that sees if given a particular commit id we need
to update.

Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:29 +00:00
Alexander Larsson
6459a13b2a transaction: Extract commit when adding bundle
This way we know ahead of time what we're going to be installing.

Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:28 +00:00
Alexander Larsson
6a73c26003 flatpak_dir_read_latest_commit: Also return commit id
Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:28 +00:00
Alexander Larsson
d4a476711f transaction: Avoid some duplicated code
This doesn't change any behaviour, but it avoids duplicating
shared code.

Closes: #1787
Approved by: alexlarsson
2018-06-18 08:11:28 +00:00
Matthew Leeds
2df6916505 Fix a few mistakes in the docs 2018-06-15 12:31:40 -07:00
Alexander Larsson
854be2430e transaction: Use g_message, it g_warning for warnings
g_warning is fatal in the test-suite, breaking tests when p2p is
enabled.
2018-06-13 17:09:43 +02:00
Alexander Larsson
14560093b0 Update pofiles 0.11.8.3 2018-06-13 12:48:05 +02:00
Alexander Larsson
3f584376f1 Update to 0.11.8.3 2018-06-13 12:16:24 +02:00
Alexander Larsson
11d9b5b0b6 session-helper: Disable p11-kit for older broken versions
p11-kit server version < 0.23.10 doesn't properly daemonize which
causes g_spawn_sync() to hang forever waiting for the pipe to
close.

We work around this by passing --sh, which is only available in the
working version, and fill fail the old ones.

https://github.com/flatpak/flatpak/issues/1768

Closes: #1782
Approved by: alexlarsson
2018-06-13 10:08:56 +00:00
Alexander Larsson
ab87617ac1 session-helper: break out the p11-kit code to a separate function
This makes it easier to read. Also, we convert some nested ifs
to early returns.

Closes: #1782
Approved by: alexlarsson
2018-06-13 10:08:56 +00:00
Alexander Larsson
a59fa5c1af portals: By default, only allow portal calls, not broadcasts
No portal is currently using broadcasts, but we want to eventually use
them in dconf. But when doing that they can't be sent to all instances
but rather limited by the sender (dconfd). The exact way this will work
is still unclear, but to pave the way for this we start by defaulting
to not delivering any broadcasts.

Closes: #1689
Approved by: alexlarsson
2018-06-11 14:31:27 +00:00
Alexander Larsson
679248254a run: Add flatpak instance id directory
Each flatpak instance gets a (random uint32) identifier which is
unique during the runtime of the instance. Additionally there is a
directory created in $XDR_RUN_DIR/.flatpak/$id which is writable on
the host, but read-only bind-mounted into the sandbox. Services (like
dconf which this targets) can use this to pass file data to the
sandbox instance.

We use locks on a file in the instance directory to ensure that we
can clean up unused directories.

The container id is also put in the .flatpak-info file so that
portals can know where the instance directory is.

Closes: #1689
Approved by: alexlarsson
2018-06-11 14:31:27 +00:00
Alexander Larsson
9bfef97027 Update pofiles 0.11.8.2 2018-06-11 12:28:13 +02:00
Alexander Larsson
22eed59b3f Update to 0.11.8.2 2018-06-11 12:18:54 +02:00
Alexander Larsson
ae58744b10 appstream: Allow multiple components per app
Some apps (like libreoffice) has multiple sup-apps, so we allow them to have multiple
appstream components (as well as e.g. multiple desktop files).

Fixes #1749

Closes: #1778
Approved by: alexlarsson
2018-06-11 10:00:17 +00:00
Alexander Larsson
f37396b2de uninstall --unused: Fix handling of autoprune-unless
We were doing autoprune-if instead, which is the opposite
of what we want.

Fixes #1766

Closes: #1777
Approved by: alexlarsson
2018-06-11 09:50:25 +00:00
Alexander Larsson
a123c858a5 uninstall --unused: Don't prompt if no unused refs found
If there was no refs found to delete, we don't want to print the "ok?" prompt.
Instead we just say that nothing was found.

Closes: #1776
Approved by: alexlarsson
2018-06-11 09:22:55 +00:00
Alexander Larsson
27fe8dd6a3 build: Compute app_context before using it
This fixes a crash dereferencing a null app_context.

Fixes https://github.com/flatpak/flatpak/issues/1770

Closes: #1774
Approved by: alexlarsson
2018-06-11 08:24:08 +00:00
Rafael Fontenelle
ecc603cb4b Update Brazilian Portuguese translation
Closes: #1772
Approved by: alexlarsson
2018-06-11 07:47:32 +00:00