Commit Graph
9542 Commits
Author SHA1 Message Date
Karl Seguin 585ed9b93c agent regression explictly load workers and iframes 2026-08-27 18:32:36 +08:00
Adrià Arrufat ed99a5b79f agent: run the Terminal tests
Terminal.zig references md_term and prompt_assist from a test block, but
nothing referenced Terminal, so those 30-odd tests never ran. Adding it
to Agent.zig's discovery block surfaced one rotted test sink in
js_highlight.zig still using ArrayList.writer(), ported to
Io.Writer.Allocating.
2026-08-27 12:03:23 +02:00
Karl Seguin b137365394 http: fix possible double-free on submit error
Similar to https://github.com/lightpanda-io/browser/pull/3289.

This pattern:

```zig
errdefer freesomething()
try transfer.submit();
```

is dangerous.`sumbit()` guarantees that the errorCallback is called on any
error. So if the transfer's errorCallback also does `freesomething()` then we
end up with a double-free.

The code was generally cleaned up to be:

```zig
{
  errdefer freesomething();
  try transfer.addHeader(....);
}
transfer.submit() catch {};
```
2026-08-27 17:45:16 +08:00
Karl Seguin 04c8a4c3a6 webapi: searchParams keeps a linked URL in sync
Mutating a searchParam that was created from a url.searchParams now keeps the
URL in sync. This helps ensure the that url.search keeps its original form.
Improves a WPT url-searchparams.any.html and urlsearchparams-stringifier along
with a few other cases.
2026-08-27 17:28:01 +08:00
Karl Seguin 7a6774a278 enable worker/iframe in 2nd e2e test 2026-08-27 17:27:31 +08:00
Karl Seguin 861ffb164b enable --log-filter in release
Log on the first iframe/worker that refuses to load due to iframe/worker loading
being disabled.
2026-08-27 17:25:42 +08:00
Karl Seguin db258bfec4 breaking: disable worker and iframe loading by default
By default, iframes and workers no longer loaded. Use `--load-resources iframe`
and `--load-resources worker` to restore the previous behavior. The disabling
makes resource loading more consistent.

To further make things more consistent, Config seems the following changes:

1. remove  `--timeout` from `serve` which does nothing but has printed a
   deprecation warning for a long time

2. added .deprecated field to CLI config flags which now logs the specified
   deprecated warning when used

3. `--log-filter-scopes` is deprecated in favor of `--log-scopes`

4. `--disable_subframes` is deprecated. Iframe loading is disabled by default,
    use `--load-resources iframe` to enable iframe loading

5. `--disable_workers` is deprecated. Worker loading is disabled by default,
    use `--load-resources worker` to enable worker loading

6. `--enable_external_stylesheets`  is deprecated. Stylesheets remain disabled
    by default. Use `--load-resources stylesheet` to enable loading external
    stylesheets

CLI log parameters now alter the logger behavior on parse. This helps minimze
the window where default log settings are in-play. It also means things like
this work:

```
./lightpanda --log-level fatal --disable_subframes --log-level warn
```

More seriously, there's now an optional `beforeParse` fired once the mode is
known. This is used by mcp to set the default log level to logfmt. Previously
this was done much later and could easily result in a mix of pretty and logfmt
logs.
2026-08-27 17:25:42 +08:00
Karl Seguin 931da06026 Merge pull request #3300 from lightpanda-io/increase-ci-timeout
CI: bump timeout from 20 to 30 for e2e-test
2026-08-27 17:10:26 +08:00
Karl Seguin 60b2848908 Merge pull request #3303 from lightpanda-io/fix-wpt-build
fix the wpt build
2026-08-27 15:55:06 +08:00
Karl Seguin 1b59bc8d3b fix the wpt build 2026-08-27 15:23:45 +08:00
Adrià Arrufat 60c7bbc086 readme: list all agent providers and gateway examples
The agent section still listed the provider set from a few releases ago,
omitting Vercel AI Gateway, Mistral, llama.cpp and OPENAI_BASE_URL-based
OpenAI-compatible endpoints. Add them with examples, plus --list-models.

Prompted by #3290.
2026-08-27 09:18:54 +02:00
Karl Seguin 98ff4b9b4d CI: bump timeout from 20 to 30 for e2e-test
Mimic's https://github.com/lightpanda-io/browser/pull/3294

I looked into this a little bit, and the main issue is that we build the binary
in releasefast twice: once for the snapshot and once for the browser itself.
Each build takes ~10 minutes.

The snapshot cache almost always misses (since any change to webapi/*
invalidates it). I don't see a great solution.
2026-08-27 13:54:30 +08:00
Karl Seguin be16ef95c4 trim comment 2026-08-27 12:35:27 +08:00
Karl Seguin 5aec8ea943 delay meta refersh until document "load" 2026-08-27 12:33:50 +08:00
Karl Seguin 6931db8aca webapi: edit key support in input/textarea
A trusted backspace/delete or printable character now:
1 - fires beforeinput and textInput (which can cancel the edit)
2 - change the input's value

Input and TextArea share enough in common and this change has enough selection
logic that a new text_entry.zig helper is added to implement the shared logic.
2026-08-27 11:17:48 +08:00
Karl Seguin a7bda0ea57 Merge pull request #3284 from lightpanda-io/xhr-blob
XHR Blob Response Type
2026-08-27 10:44:05 +08:00
Karl Seguin abf5bdecb6 mem: Use new clearResponse() to eagerly free XHR JSON response
And, add blob tests
2026-08-27 09:42:02 +08:00
Muki Kiboigo 3d42ffa0f8 properly ref count blob in XHR response 2026-08-27 09:20:34 +08:00
Muki Kiboigo adb4551362 support Blob as XHR responseType 2026-08-27 09:20:34 +08:00
Karl Seguin 4f63f6f204 fix: --with-base now uses proper attribute
Improve dump's void element list
2026-08-27 08:32:53 +08:00
Karl Seguin b5656eed82 Merge pull request #3292 from lightpanda-io/fetch-markdown-opts
fetch: add --selector and --max-bytes, honor --strip-mode for markdown
2026-08-27 08:28:20 +08:00
muki 57b86112b3 Merge pull request #3240 from lightpanda-io/xhr-async-flag
XHR Sync Request
2026-08-26 17:11:48 -07:00
Karl Seguin 05627c5368 handle error in json+png error
improve log error message when 1 of multiple URLs fails to fetch
2026-08-27 08:11:15 +08:00
Karl Seguin 23d18ab3aa Merge pull request #3296 from lightpanda-io/silence-write-failed-test-http-error
chore: silence test log
2026-08-27 07:43:41 +08:00
Karl Seguin b5c25db3fc chore: silence test log 2026-08-27 07:42:23 +08:00
Karl Seguin 6955751c10 Merge pull request #3285 from lightpanda-io/mem-vmhwm
mem: include v8 functions in binary layout optimization
2026-08-27 07:35:30 +08:00
Karl Seguin fce38a1aa8 Merge pull request #3289 from lightpanda-io/fix-double-releases
fix: Fix double-release and other (edge-case) memory issues
2026-08-27 07:34:45 +08:00
Karl Seguin 00a2a78303 Merge pull request #3288 from lightpanda-io/WorkerNavigator
WebAPI: Add WorkerNavigator
2026-08-27 07:34:31 +08:00
Karl Seguin c70557ad08 Merge pull request #3287 from lightpanda-io/wpt-mouse-boundary-events
webapi: improve hover events
2026-08-27 07:32:34 +08:00
Karl Seguin e0f6eb5e04 Merge pull request #3286 from lightpanda-io/usp-iterable-init
webapi: URLSerachParams @@iterator init
2026-08-27 07:32:03 +08:00
Muki Kiboigo bcd77bf462 set ready state to done on sync XHR error 2026-08-26 08:05:53 -07:00
Muki Kiboigo b20bb1f553 get rid of extra releaseSelfRef 2026-08-26 08:05:23 -07:00
Pierre Tachoire 70d50b1f22 Merge pull request #3294 from lightpanda-io/ci-release-timeout
ci: increase release build timeout 20 -> 30
2026-08-26 16:01:43 +02:00
Adrià Arrufat f1ae05f6e7 Merge pull request #3291 from lightpanda-io/links-quality
links: dedup by href, skip hidden, fall back to alt/aria-label/title
2026-08-26 15:54:26 +02:00
Adrià Arrufat 33b8bdbb4c fetch: --dump-selector without --dump is an error, like --dump-max-bytes 2026-08-26 15:45:24 +02:00
Adrià Arrufat 56241e26b8 dump: take max_bytes in Opts
Review feedback: markdown caps its own output through Opts.max_bytes while
the html dump left it to each caller, so the html tool and fetch each
carried a copy of the LimitedWriter wrapping. root and deep now do it,
with a no-cap fast path so innerHTML/outerHTML are unaffected.
2026-08-26 15:44:48 +02:00
Adrià Arrufat 6811cc8226 fetch: per-page errors, an "error" field in --json, --fail-on-http-error
A wait failure on one URL aborted the whole multi-URL fetch with no
output, the wait_ms budget was computed once before the loop so N pages
could take N times the budget, navigation failures exited 0 with an empty
dump, and HTTP 4xx/5xx were indistinguishable from success by exit code.

Each page now has its own error slot: wait, navigation and dump failures
are recorded there instead of returned, every page is still written (the
JSON envelope carries the name under "error"), then the first failure is
returned so the process exits 1. The remaining budget is recomputed per
page. --fail-on-http-error turns a status >= 400 into exit 22, curl's
code for the same condition; the dump is written first either way.
2026-08-26 15:35:15 +02:00
Adrià Arrufat 1fb7a1b983 fetch: namespace the dump options in Config too 2026-08-26 15:34:15 +02:00
Adrià Arrufat e46964e261 markdown: reuse dump's shouldStripElement 2026-08-26 15:32:25 +02:00
Pierre Tachoire f1fcdb6617 ci: increase release build timeout 20 -> 30 2026-08-26 15:32:21 +02:00
Adrià ArrufatandKarl Seguin c78c1d3823 fetch: namespace dump flags
Co-authored-by: Karl Seguin <karlseguin@users.noreply.github.com>
2026-08-26 15:28:18 +02:00
Adrià Arrufat 5870ce1120 refactor(links): use accessible name from AXNode for link text 2026-08-26 15:16:56 +02:00
Adrià Arrufat d3bad960c3 fetch: add --selector and --max-bytes, honor --strip-mode for markdown
--strip-mode was silently ignored for --dump markdown, and fetch had no
way to scope a dump to one element or cap its size although the markdown
and html tools have both.

--selector dumps the first matching element in any dump mode, --max-bytes
caps html and markdown with the tools' truncation marker, and markdown
now honors strip ui (images; scripts, styles and hidden elements are
never rendered, so the other groups don't apply).
2026-08-26 13:23:18 +02:00
Adrià Arrufat fbb9f8c8fa links: fix test expectation, the test frame has no base URL 2026-08-26 13:14:30 +02:00
Adrià Arrufat 6dca2c8917 links: dedup by href, skip hidden, fall back to alt/aria-label/title
The links tool returned every a[href] verbatim: hidden nav entries,
one row per duplicate href, and null text for image and icon links even
though markdown already knows to use alt. Nav-heavy pages produced
thousands of rows for an agent looking for one link.

One entry per resolved href (the first, upgraded with text from a later
duplicate), hidden anchors skipped with the same check tree uses, text
falling back to aria-label, title, then a descendant img alt. The tool
gains an optional limit.
2026-08-26 13:13:08 +02:00
Karl Seguin cfd921ecab fix: Fix double-release and other (edge-case) memory issues
Our `Arena` from the `ArenaPool` now tracks if it's already been released. On
a subsequent release, it panics then and there. Without this, the code will
almost certainly panic anyways, but it will panic in a seemingly unrelated
place. Hopefully this makes identifying future cases of this easier (since we'll
get the stack trace of the re-releaser).

Fix 3 separate memory issues, all edge cases.

1 - an XHR error handler that re-open/sends would incorrectly null the new
    transfer (maybe this isn't that odd, maybe it's a common retry-on-error).

2 - On a curl_easy_pause error (from WebSocket.zig) we now unqueue the just-
    queued message, because the error will errdefer the message arena to be
    cleaned up.

3 - ScriptManager now cleans up after itself on a failure prior to submit()
    being called.
2026-08-26 18:24:12 +08:00
Karl Seguin f5c458047e WebAPI: Add WorkerNavigator
A worker gets a distinct Navigator type (WorkerNavigator) which only exposes
a subset of what Navigator does.

Previously, we achieved this by exposing Navigator but with a bunch of accessors
 / functions with .{.exposed = .window}. That worked fine, except the type name
was still "Navigator". This introduces an actual WorkerNavigator.
2026-08-26 16:34:26 +08:00
Pierre Tachoire 2013249a2a Merge pull request #3267 from lightpanda-io/strip-auth-cross-origin-redirect
http: strip Authorization on cross-origin redirects
2026-08-26 10:16:52 +02:00
Pierre Tachoire 467167d6e6 http: strip Authorization on cross-origin redirects 2026-08-26 10:00:11 +02:00
Adrià Arrufat 5f8eb43867 Merge pull request #3276 from lightpanda-io/mcp-tool-annotations
mcp: add title and annotations to tools/list
2026-08-26 09:46:48 +02:00