Zoltan Kochan 69cfcb7417 perf(ci): cache benchmark binaries per commit instead of rebuilding (#12173)
The integrated-benchmark "Precompile benchmark revisions" step took ~14
minutes every run. Two causes:

1. The "Cache Rust builds" step cached the multi-GB
   `bench-work-env/*/pacquet/target` dirs under a 1-minute restore
   timeout. A restore that large never finished in 60s, so (with
   `continue-on-error`) the cache silently missed and every run built all
   four targets cold.
2. `pacquet@HEAD` and `pnpr@HEAD` resolve to the same commit but built in
   separate clones, compiling the `pacquet` binary twice (same for main).

Cache the compiled binaries per *resolved commit* instead:

- Orchestrator: a `--reuse-prebuilt-binaries` flag skips the clone +
  `cargo build` for a target whose output binary is already present (i.e.
  restored from cache). Targets are built pnpr-first; since a `pnpr@<rev>`
  build also produces the `pacquet` client binary, a same-revision
  `pacquet@<rev>` reuses it by copy rather than recompiling the commit.
- Workflow: resolve the HEAD/main SHAs, then cache the two `pnpr@<rev>`
  binaries keyed on the commit (they cover all four targets via the
  dedup-copy). `main` is a near-certain hit on PRs (stable SHA) and a
  same-HEAD re-run hits HEAD too, so only a fresh HEAD compiles. Drop the
  giant `bench-work-env/*/pacquet/target` cache (the small binary caches
  restore in seconds, with no eviction risk) and keep a cargo-deps +
  orchestrator-target cache with a realistic 3-minute timeout.

A fresh-HEAD run now compiles one workspace once (~half the old work);
re-runs and main reuse cached binaries and skip compilation entirely.
2026-06-03 17:26:49 +02:00
2026-04-10 18:30:33 +02:00
2026-05-27 15:15:01 +02:00
2026-06-02 08:07:46 +02:00
2026-05-29 17:26:13 +02:00
2026-05-29 17:26:13 +02:00
2026-04-30 23:03:46 +02:00
2026-06-02 08:07:46 +02:00
2026-06-02 08:07:46 +02:00
2026-06-02 08:07:46 +02:00
2026-05-27 15:15:01 +02:00
2026-05-27 15:15:01 +02:00
2026-06-02 08:07:46 +02:00
2026-05-27 15:15:01 +02:00
2026-05-24 02:23:07 +02:00
2026-06-02 08:07:46 +02:00
2026-06-02 08:07:46 +02:00
2026-04-30 23:19:31 +02:00
2026-05-29 17:26:13 +02:00
2026-05-29 17:26:13 +02:00
2026-04-30 23:03:46 +02:00
2026-06-02 08:07:46 +02:00
2026-01-16 16:31:31 +01:00
2024-03-21 01:09:22 +01:00

简体中文 | 日本語 | 한국어 | Italiano | Português Brasileiro

pnpm

Fast, disk space efficient package manager:

  • Fast. Up to 2x faster than the alternatives (see benchmark).
  • Efficient. Files inside node_modules are linked from a single content-addressable storage.
  • Great for monorepos.
  • Strict. A package can access only dependencies that are specified in its package.json.
  • Deterministic. Has a lockfile called pnpm-lock.yaml.
  • Works as a Node.js version manager. See pnpm runtime.
  • Works everywhere. Supports Windows, Linux, and macOS.
  • Battle-tested. Used in production by teams of all sizes since 2016.
  • See the full feature comparison with npm and Yarn.

To quote the Rush team:

Microsoft uses pnpm in Rush repos with hundreds of projects and hundreds of PRs per day, and weve found it to be very fast and reliable.

npm version OpenCollective OpenCollective X Follow Stand With Ukraine

Platinum Sponsors

Bit

Gold Sponsors

Sanity Discord Vite
SerpApi CodeRabbit Stackblitz
Workleap Nx

Silver Sponsors

Replit Cybozu devowl.io
u|screen Leniolabs_ Depot
Cerbos ⏱️ Time.now

Support this project by becoming a sponsor.

Background

pnpm uses a content-addressable filesystem to store all files from all module directories on a disk. When using npm, if you have 100 projects using lodash, you will have 100 copies of lodash on disk. With pnpm, lodash will be stored in a content-addressable storage, so:

  1. If you depend on different versions of lodash, only the files that differ are added to the store. If lodash has 100 files, and a new version has a change only in one of those files, pnpm update will only add 1 new file to the storage.
  2. All the files are saved in a single place on the disk. When packages are installed, their files are linked from that single place consuming no additional disk space. Linking is performed using either hard-links or reflinks (copy-on-write).

As a result, you save gigabytes of space on your disk and you have a lot faster installations! If you'd like more details about the unique node_modules structure that pnpm creates and why it works fine with the Node.js ecosystem, read this small article: Flat node_modules is not the only way.

💖 Like this project? Let people know with a tweet

Getting Started

Benchmark

pnpm is up to 2x faster than npm and Yarn classic. See all benchmarks here.

Benchmarks on an app with lots of dependencies:

License

MIT, except the pnpr/ directory, which is source-available under the PolyForm Shield License 1.0.0.

Description
No description provided
Readme MIT 346 MiB
Languages
Rust 55.9%
TypeScript 43.5%
JavaScript 0.5%