Commit Graph

8347 Commits

Author SHA1 Message Date
Adrià Arrufat
6c3f8c0f81 python: package moved to lightpanda-io/lightpanda-python
bindings/python was extracted to its own repository (imported there at
full fidelity from ed966e15). Development docs, wheel CI, and the
benchmarks' editable dependency now live against that repo.
2026-07-27 12:50:00 +02:00
Adrià Arrufat
ec6242edfa Merge branch 'main' into python-bindings-v1 2026-07-27 12:38:21 +02:00
Karl Seguin
3a84a83d8c Merge pull request #3033 from mh0pe/codex/svg-04-geometry
webapi: implement SVG geometry
2026-07-27 18:04:44 +08:00
Karl Seguin
952a860119 Add re-usable buffer (instead of frame.arena) to limit memory usage
Fix PathData.zig flatness bug.

Ensure tests pass on Chrome, and match implementation to that
2026-07-27 17:27:06 +08:00
Madison Steiner
2e89b805fc webapi: implement SVG geometry 2026-07-27 13:48:18 +08:00
Karl Seguin
8a256f59e0 Merge pull request #3030 from mh0pe/codex/svg-03-collections
webapi: add live SVG collections
2026-07-27 13:02:50 +08:00
Karl Seguin
e50c3e9a3b Align with Chrome/Firefox
1 - Split out test to have more granular units
2 - Try to make our test and implementation consistent with Chrome and Firefox
    - Chrome and Firefox diverge here in a lot of ways (e.g. serialization),
      and there isn't always a WPT tests to break the tie.
3 - Removed some defensive code around OOM. OOM isn't generally recoverable
4 - SVGTransform no longer pretends to be 3D. #D writes drop the z/w component
    and stays SVG_TRANSFORM_MATRIX

Small improvement to WPT correctness with no regression (though, the WPT tests
here seem to be a little lacking from what I can tell, which probably helps
explain why Chrome and Firefox disagree on things).
2026-07-27 12:26:30 +08:00
Madison Steiner
391993807d svg: make string list updates transactional 2026-07-26 11:58:11 -07:00
Madison Steiner
29109a2dea svg: make live collection mutations transactional
Keep SVGTransform.matrix synchronized with its owning transform and reflected attribute, including read-only animVal and 3D matrix state. Reserve collection storage before attribute commits so allocation failures cannot detach live objects or leave snapshots inconsistent.
2026-07-26 11:44:40 -07:00
Karl Seguin
e4b6b3298d Optimize collections; Fix unsafe Frame reference
Applies the same dictionary lookup pattern we did in https://github.com/lightpanda-io/browser/pull/3034
to the new Graphics, Polyline and Polygon fields.

Caps total memory from snapshot and retired items by collecting them in a buffer
rather than the frame arena. This allows the memory to be re-used at each sync.

Remove the Frame dependency from DOMPointReadOnly and DOMPoint. These types are
also accessible from a Worker (which has no Frame). The frame is captured at
creation time which the callback can access.
2026-07-26 09:38:32 -07:00
Madison Steiner
2e45e6487a webapi: add live SVG collections 2026-07-26 09:38:32 -07:00
Adrià Arrufat
b3f6b0a929 Merge pull request #3019 from lightpanda-io/brave-search
tools: add Brave search + /searchEngine metacommand
2026-07-26 17:44:13 +02:00
Adrià Arrufat
f73aff0336 browser: stream search markdown and sanitize newlines 2026-07-26 17:32:59 +02:00
Karl Seguin
c718235410 Merge pull request #3058 from navidemad/fix-select-optgroup-options
forms: include optgroup children in a select's list of options
2026-07-26 13:12:17 +08:00
Karl Seguin
f697c2087c Merge pull request #3056 from arimu1/fix/3052-fetch-readablestream-body
fix(net): buffer closed ReadableStream bodies for fetch POST
2026-07-26 12:54:18 +08:00
Karl Seguin
7e6bec8673 Simplify OptionIterator and node_live option matcher 2026-07-26 12:52:59 +08:00
Karl Seguin
e2f028ef8c Prevent double drain
Use existing toStringSmart to convert value to a string
2026-07-26 11:47:32 +08:00
Karl Seguin
a0fba9ba33 Merge pull request #3059 from lightpanda-io/call_arena-2-local_arena
mem: Change more call_arenas to local_arenas
2026-07-26 07:28:58 +08:00
Karl Seguin
09ca1e5a57 mem: Change more call_arenas to local_arenas
local_arena should always be used when it's safe. It's released earlier and thus
helps reduce peak memory.
2026-07-25 20:41:02 +08:00
Karl Seguin
f72cba80a8 Merge pull request #3037 from Ppsoft1991/fix/cdp-network-events
cdp: complete Network events and include worker requests
0.3.6
2026-07-25 12:32:18 +08:00
Karl Seguin
5acfd38250 Improve CDP response event data
Give accurate connectionId, connectionReused, initialPriority and securityState
values.

Always set `referrerPolicy` to `unsafe-url` as the most honest answer (we should
implement proper referrer policy!).

For workers, track the underlying frame_id so that it can be used for the
`documentURL` field.
2026-07-25 11:36:13 +08:00
Karl Seguin
063906ed23 Merge pull request #3036 from lightpanda-io/xhr-xmlresponse
webapi: XHR uses XML parser for XML content-type responses
2026-07-25 10:50:38 +08:00
Navid EMAD
f239004bbb forms: include optgroup children in a select's list of options
HTMLSelectElement collected its options from its direct children only, so an
<option> inside an <optgroup> was invisible to options, length, value,
selectedIndex, selectedOptions and to form submission. A grouped select could
not be read, set or submitted, while querySelectorAll("option") still found
every option.

Per HTML §the-select-element a select's list of options is its option element
descendants: its option children plus the option children of its optgroup
children.

- add a select_options collection mode, and move selected_options onto the
  same walk, matching an option whose parent is the select or an optgroup
  child of the select
- add one OptionIterator in Select.zig, used by effectiveOption, setValue,
  getSelectedIndex, setSelectedIndex, getLength and add
- effectiveOption skips options disabled through <optgroup disabled>
  (concept-option-disabled); those options only become reachable now that
  grouped options are part of the list
- select.add(option, index) inserts into the optgroup when the option at that
  index lives in one, per §dom-select-add

Closes #3057
2026-07-25 04:31:41 +02:00
arimu1
f47dac832f fix(net): use exec.js.local in collectBodyBytes
Drop nested localScope; fetch already runs under an active Caller local.
Fixes compile error where &ls (Scope) was passed where *js.Local is required.
2026-07-25 09:23:18 +07:00
arimu1
fdc98b7e4b fix(net): convert js_value stream chunks for fetch POST bodies
JS controller.enqueue stores chunks as .js_value via enqueueValue, so
collectBodyBytes must extract TypedArray/ArrayBuffer/string bytes with
local scope and arena.dupe before buffering. Add multi-chunk success and
open/locked reject fixtures in fetch.html.
2026-07-25 09:19:23 +07:00
Karl Seguin
c917cadcd0 Merge pull request #3054 from navidemad/fix-a51-form-method-dialog
forms: close the ancestor dialog on method=dialog submission
2026-07-25 10:18:55 +08:00
arimu1
f2ddaee8d1 fix(net): buffer closed ReadableStream bodies for fetch POST
BodyInit.extract returned an empty body for ReadableStream request
bodies, so fetch POST with duplex:half silently sent Content-Length: 0.
Drain closed streams synchronously via collectBodyBytes; reject open,
locked, or errored streams with TypeError instead of sending nothing.

Fixes lightpanda-io/browser#3052
2026-07-25 09:11:17 +07:00
Karl Seguin
705bc78b72 cleanup: Mechanical move various frame.parse* method
Follows the observer, user_input, etc.. pattern and relocates various
`Frame.parse*` methods into Frame.parse.* functions.

Goal is just to keep Frame neat.
2026-07-25 10:03:57 +08:00
Karl Seguin
dab5ff7779 webapi: XHR uses XML parser for XML content-type responses
Expand mime type to be aware of more XML types. DOMParser and XHR now use the
existing Parser.parseXML (via a Frame helper), rather than the HTML parser. Both
these APIs predate the addition of parseXML.
2026-07-25 10:01:53 +08:00
Karl Seguin
e8b58c5dd2 Merge pull request #3055 from lightpanda-io/fix-formdata-append-blob
Fix formdata append blob
2026-07-25 09:52:03 +08:00
Karl Seguin
c205e118eb Get submitter value from the IDL value
Move code that dialog block doesn't need under the dialog block (e.g. no need
to get an arena from the pool).
2026-07-25 09:50:54 +08:00
Karl Seguin
fda6cfcaf6 Merge pull request #3048 from lightpanda-io/scroll-with-content
derive scrollWidth/scrollHeight from element content
2026-07-25 09:34:08 +08:00
Karl Seguin
0e0d4418c3 Simplify FormData value union
Collapse File -> Blob, since a File is a blob. Code was already checking for
blob._type == .file.
2026-07-25 09:27:06 +08:00
Karl Seguin
d58cbc5440 explicit visibility check on root 2026-07-25 08:56:39 +08:00
Karl Seguin
e742d363c0 Merge pull request #3049 from navidemad/makefile-v8-cache-key-tag
make: key the prebuilt-V8 cache on the zig-v8 tag
2026-07-25 08:39:22 +08:00
Ppsoft1991
e3ec937f78 cdp: emit worker network requests
Keep worker requests visible on the page CDP session when their WorkerGlobalScope frame id is absent from the document frame tree. Add a regression fixture covering the worker script and a fetch from inside the worker.
2026-07-25 08:01:04 +08:00
Ppsoft1991
39981f2534 cdp: complete Network event payloads
Add required timestamp, type, request, response, and timing fields so strict CDP clients can deserialize emitted events.
2026-07-25 07:37:53 +08:00
Navid EMAD
77bbbf5e84 forms: close the ancestor dialog on method=dialog submission
`Form.normalizeMethod` already canonicalizes `method="dialog"`, but
`Frame.submitForm` only branched on `"post"`, so a dialog submission fell
through to the GET path: the document was reloaded, the dialog kept its
`open` attribute, `returnValue` was never set, and no `close` event fired.
A promise awaiting `close` — the idiomatic way to await a confirm dialog —
hung forever while the page reloaded underneath it.

Add the branch the HTML form-submission algorithm calls for: walk up from
the form to the nearest ancestor `<dialog>` and close it with the
submitter's value through the existing `Dialog.close()`, then return
without scheduling a navigation. With no ancestor dialog the submission is
dropped, which is also what the spec asks for — and still not a navigation.

Completes the `<dialog>` support started in #2435, which implemented
`show`/`showModal`/`close`/`returnValue` but left the form-submission
integration that drives them unwired.

Closes #3053
2026-07-24 21:23:52 +02:00
Navid EMAD
37aef53f5e net: accept Blob and File values in FormData.append/set
The JS-facing append() and set() took `value: []const u8`, so js.Bridge
coerced any object argument through toString(). Passing a Blob or File stored
the literal text "[object Blob]" / "[object File]" and the bytes never reached
the wire: a FormData carrying a 200 KB File produced a 209-byte request body,
with no filename parameter and no per-part Content-Type. The request still
succeeded with a 200, so nothing surfaced the loss.

Only the binding was string-typed. Entry.Value already carries a `file: *File`
variant with refcounting, and the multipart writer already emits filename= and
a per-part Content-Type for it — that is how <input type=file> submissions
work today.

Take a tagged union instead, following the shape body_init.zig already uses
for BodyInit (`bytes` last, so js.Bridge only falls back to a string once the
JsApi classes have been tried), and implement the entry-creation steps from
https://xhr.spec.whatwg.org/#create-an-entry: a Blob that is not a File
becomes a File named "blob", and an explicit filename produces a new File over
the same bytes rather than renaming the caller's object.

The internal append(name, value) helper keeps its string signature — it backs
form collection and the existing unit tests, neither of which goes through JS.

Closes #3050
2026-07-24 20:38:19 +02:00
Navid EMAD
862fc91f06 make: key the prebuilt-V8 cache on the zig-v8 tag
A zig-v8-fork release names its assets after the V8 version only, so the
same filename is reused across fork tags:

  v0.5.0  libc_v8_14.9.207.35_macos_aarch64.a  106944896 bytes
  v0.5.1  libc_v8_14.9.207.35_macos_aarch64.a  106945416 bytes
  v0.5.2  libc_v8_14.9.207.35_macos_aarch64.a  106945984 bytes

V8_CACHE was keyed on that filename alone, so a zig-v8 tag bump that
leaves V8_VERSION unchanged did not invalidate the cache: download-v8's
`test -f` guard saw the old archive and skipped the refresh. The build
then linked yesterday's bindings and failed on undefined symbols for
whatever the new tag added, e.g. after the v0.5.2 bump:

  error: undefined symbol: _v8__Value__IsFloat16Array
  error: undefined symbol: _v8__V8__SetFlagsFromString
  error: undefined symbol: _v8__Isolate__AddNearHeapLimitCallback

Putting the tag in the cache path gives each tag its own entry, so a bump
downloads and a repeat run still hits the cache. The URL keeps using the
bare asset name, which is what the release actually publishes.

Only affects local development; CI installs V8 through the install action
and never calls download-v8.
2026-07-24 19:29:07 +02:00
Adrià Arrufat
ed966e15ec python: kill the sidecar when its parent dies
PR_SET_PDEATHSIG on the spawned lightpanda mcp process (Linux) so a
SIGKILLed or crashed interpreter cannot leak a browser process — a
2h44m orphan surfaced during the v6 benchmark campaign. Regression
test kills a parent and asserts the sidecar exits.
2026-07-24 16:26:03 +02:00
Karl Seguin
044d5c9186 Merge pull request #3047 from lightpanda-io/parse-terminate-guard
stability: Poll terminate state during large HTML parsing
2026-07-24 21:36:40 +08:00
Karl Seguin
3364de74af Merge pull request #3045 from lightpanda-io/notificaiton-reregister-safe
cdp: ignore duplicate enable calls
2026-07-24 19:24:32 +08:00
Pierre Tachoire
51c9115e9b derive scrollWidth/scrollHeight from element content
Both aliased clientWidth/clientHeight, computed from the element's own box
without looking at its children, so any "measure, mutate, re-measure" loop
never terminated. The marquee idiom on readthetrieb.com is the reported case:

    while (lane.scrollWidth < track.offsetWidth * 2)
        lane.innerHTML += lane.innerHTML;

Doubling the markup left scrollWidth unchanged, so the loop spun while
innerHTML grew the DOM exponentially and wedged the page in under a second.

Return max(clientSize, contentSize), summing the direct child elements.

- No layout-mode detection: getStyle() sees only the inline style attribute,
  so display:flex or white-space:nowrap from a stylesheet is invisible. Each
  axis assumes the arrangement that produces overflow — width lays children in
  a row, height stacks them — bounding content extent per axis rather than
  modelling one layout.
- Text children are not measured. Estimating a run from its length needs a
  per-character advance that tracks font-size, or shrink-to-fit loops stop
  converging, and it reports overflow for nearly every element holding text.
- Direct children only, so cost is O(fan-out), with a shared VisibilityCache
  collapsing N ancestor walks into one.
- <html>/<body> keep their synthetic defaults, so page-level overflow and
  infinite-scroll checks are unaffected; only inner containers change.

Tests in element/position.html cover growth per child, text contributing to
neither axis, hidden elements, the root carve-out, and both loops terminating.
2026-07-24 12:23:22 +02:00
Karl Seguin
0066cad4d9 Merge pull request #3041 from lightpanda-io/runner-tick-preload
perf, fix: Avoid tight tick loop before page loads
2026-07-24 17:28:16 +08:00
Karl Seguin
553a3bad08 Merge pull request #3046 from lightpanda-io/resize-observer-perf
perf: improve ResizeObserver performance
2026-07-24 17:28:00 +08:00
Karl Seguin
5a59743f13 stability: Poll terminate state during large HTML parsing
V8's terminate isn't pre-emptive. We can arm it, but it still hast to cross
a boundary to fire. JavaScript that triggers a near endless Zig loop won't be
able to interrupt the Zig code:

```
while (true) {
  el.innerHTML += el.innerHTML;
}
```

Can generate a huge HTML input that the Parser will work on for ages. I don't
have a general solution to this. I've made the Parser (and DOMParser) check the
terminate state every 1024 appends. This only covers one specific case, but it's
possibly common enough to guard again, specifically because we don't have
rendering/dimensions, and many websites will append text until certain
dimensions are reached.

But it wouldn't for example, catch a similar:

while (true) {
  el.appendChild(el.firstChild.cloneNode(true));
}
2026-07-24 17:17:33 +08:00
Adrià Arrufat
73a7a44139 python: accept extra sidecar CLI args in Browser()
Browser(args=[...]) forwards flags like --http-cache-dir to the spawned
lightpanda mcp process; needed by the pandascript-vs-cdp benchmark leg
and useful for cookies/robots flags generally.
2026-07-24 10:54:33 +02:00
Adrià Arrufat
91a1bc371c Merge branch 'main' into python-bindings-v1 2026-07-24 10:41:24 +02:00
Karl Seguin
4565501aa8 Merge pull request #3034 from mh0pe/codex/svg-02-values
webapi: add live SVG scalar values
2026-07-24 14:13:41 +08:00