Files
pnpm/.github/workflows
Zoltan Kochan 930c9d7718 ci(pnpr): benchmark the install accelerator (new Bencher pnpr testbed) (#12154)
* ci(pnpr): add pnpr@<rev> target + Bencher testbed for the install accelerator

Measures the pnpr-accelerated install path end to end. A new `pnpr@<rev>`
target in the integrated-benchmark orchestrator builds both the `pacquet`
client and the `pnpr` server from the revision's monorepo clone, boots a
per-target pnpr server with an isolated `--storage`, and points the client
at it via `PNPR_SERVER`.

Reusing the existing multi-target hyperfine model gives both comparisons:

- `pnpr@HEAD pacquet@HEAD` -> pnpr-vs-direct ratio in one run (same client,
  with and without the accelerator).
- `pnpr@HEAD pnpr@main` -> regression delta tracked in a new Bencher `pnpr`
  testbed.

Two CI workflows mirror the fork-safe two-stage pacquet pattern, triggered
on pnpr/**, pacquet/crates/pnpr-client/**, and pacquet/crates/config/**
(the pnprServer plumbing), running the hot-cache/hot-store restore and
fresh-install scenarios that model a warm long-running server.

* ci(pnpr): fold the install-accelerator bench into the pacquet workflow

The pnpr server is built from the pacquet resolver/store/tarball crates,
so any pacquet change can move the pnpr-accelerated numbers as much as the
direct ones. That means the two benchmarks share a trigger surface and
should co-run — so rather than a separate pnpr workflow posting a second
comment on every pacquet PR, measure both in one run.

The pacquet integrated-benchmark workflow now also runs `pnpr@<rev>`
targets in the two hot-cache/hot-store scenarios (a warm long-running
server is pnpr's realistic shape), emits one combined report/comment, and
uploads to two Bencher testbeds: `pacquet` (direct, all scenarios) and
`pnpr` (accelerated, hot scenarios). The trigger gains `pnpr/**`.

Deletes the standalone pnpr-integrated-benchmark{,-comment}.yml added
earlier in this branch.

* ci(pnpr): also benchmark pnpr with a cold client store

Run the pnpr targets in the cold-cache/cold-store scenarios too, not just
the hot ones. Those scenarios already wipe the client store between
iterations while the per-target pnpr server store stays warm, so this
measures pnpr's cold-client-vs-warm-server shape — the realistic CI case
(empty local store hitting a warm shared server) — alongside the existing
hot-client numbers.

Both tools now run all four scenarios, so the report tables and both
Bencher testbeds (pacquet, pnpr) cover cold and hot. Collapses the two
target-list env vars into one and bumps the cold-step timeouts for the
extra commands. Table rendering is unchanged.

* ci(pnpr): address PR review feedback

- work_env: wrap the spawned pnpr child in its PnprServer guard before the
  readiness wait and .pnpr-env write, so an early panic kills the process
  on unwind instead of leaking an orphaned server (Copilot).
- cli_args: document pnpr@<rev> in the `targets` --help text (CodeRabbit).
- workflows: guard each bencher upload on its file existing, so a missing
  optional results file logs a notice instead of failing the step (Copilot).
2026-06-03 12:01:17 +02:00
..
2026-06-02 12:06:18 +02:00