Truly independent web browser
Find a file
Ryan Liptak 6da1dfa8f2 LibWeb/HTML: Improve data structure of named character reference data
Introduces a few ad-hoc modifications to the DAFSA aimed to increase
performance while keeping the data size small.

- The 'first layer' of nodes is extracted out and replaced with a lookup
  table. This turns the search for the first character from O(n) to O
  (1), and doesn't increase the data size because all first characters
  in the set of named character references have the
  values 'a'-'z'/'A'-'Z', so a lookup array of exactly 52 elements can
  be used. The lookup table stores the cumulative "number" fields that
  would be calculated by a linear scan that matches a given node, thus
  allowing the unique index to be built-up as normal with a O(1) search
  instead of a linear scan.
- The 'second layer' of nodes is also extracted out and searches of the
  second layer are done using a bit field of 52 bits (the set bits of
  the bit field depend on the first character's value), where each set
  bit corresponds to one of 'a'-'z'/'A'-'Z' (similar to the first
  layer, the second layer can only contain ASCII alphabetic
  characters). The bit field is then re-used (along with an offset) to
  get the index into the array of second layer nodes. This technique
  ultimately allows for storing the minimum number of nodes in the
  second layer, and therefore only increasing the size of the data by
  the size of the 'first to second layer link' info which is 52 * 8 =
  416 bytes.
- After the second layer, the rest of the data is stored using a
  mostly-normal DAFSA, but there are still a few differences:
   - The "number" field is cumulative, in the same way that the
     first/second layer store a cumulative "number" field. This cuts
     down slightly on the amount of work done during the search of a
     list of children, and we can get away with it because the
     cumulative "number" fields of the remaining nodes in the DAFSA
     (after the first and second layer nodes were extracted out) happens
     to require few enough bits that we can store the cumulative version
     while staying under our 32-bit budget.
   - Instead of storing a 'last sibling' flag to denote the end of a
     list of children, the length of each node's list of children is
     stored. Again, this is mostly done just because there are enough
     bits available to do so while keeping the DAFSA node within 32
     bits.
   - Note: Together, these modifications open up the possibility of
     using a binary search instead of a linear search over the
     children, but due to the consistently small lengths of the lists
     of children in the remaining DAFSA, a linear search actually seems
     to be the better option.

The new data size is 24,724 bytes, up from 24,412 bytes (+312, -104 from
the 52 first layer nodes going from 4-bytes to 2-bytes, and +416 from
the addition of the 'first to second layer link' data).

In terms of raw matching speed (outside the context of the tokenizer),
this provides about a 1.72x speedup.

In very named-character-reference-heavy tokenizer benchmarks, this
provides about a 1.05x speedup (the effect of named character reference
matching speed is diluted when benchmarking the tokenizer).

Additionally, fixes the size of the named character reference data when
targeting Windows.
2025-07-14 09:43:08 +02:00
.devcontainer Meta: Switch to different source for pre-commit feature in dev-container 2025-06-21 20:18:23 +02:00
.github Meta: Remove Polar from FUNDING.yml and FAQ.md 2025-07-10 10:04:33 +02:00
AK AK: Define ConstIterator for SegmentedVector 2025-07-13 19:15:05 +02:00
Base/res Meta: Remove bookmarks.json 2025-07-11 14:04:23 +02:00
Documentation Documentation: Update the version of Android Studio 2025-07-10 15:44:53 -06:00
Libraries LibWeb/HTML: Improve data structure of named character reference data 2025-07-14 09:43:08 +02:00
Meta LibWeb/HTML: Improve data structure of named character reference data 2025-07-14 09:43:08 +02:00
Services UI+WebContent: Add menu option to dump display list 2025-07-13 19:15:05 +02:00
Tests LibWeb: Don't crash when appending to an XML document template element 2025-07-14 09:15:41 +02:00
Toolchain Meta: Add SPDX license identifier to ladybird.py and BuildVcpkg.py 2025-05-29 16:24:17 -04:00
UI UI+WebContent: Add menu option to dump display list 2025-07-13 19:15:05 +02:00
Utilities Utilites: Remove extra dashes from raw strings argument to js 2025-07-10 16:28:40 -06:00
.clang-format Meta: Enforce newlines around namespaces 2025-05-14 02:01:59 -06:00
.clang-tidy Meta: Disable clang-tidy's const correctness checks 2025-07-08 11:04:15 -04:00
.clangd Meta: Change the default build directories to exclude "ladybird" prefix 2024-11-06 10:38:57 -07:00
.editorconfig Meta: Add .editorconfig 2022-09-10 17:32:55 +01:00
.gitattributes LibGfx: Remove support for the various "portable" image formats 2024-06-17 21:57:35 +02:00
.gitignore CMake: Add a flatpak build for org.ladybird.Ladybird 2025-07-08 11:45:32 -06:00
.gn Meta: Automatically generate a compilation database for clangd 2023-11-14 14:29:35 -05:00
.mailmap Meta: Update my e-mail address everywhere 2024-10-04 13:19:50 +02:00
.pre-commit-config.yaml Meta: Replace deprecated pre-commit stage name 2024-10-18 09:40:59 +02:00
.prettierignore Meta: Don't lint imported WPT crash tests with prettier 2025-06-22 23:51:34 +02:00
.prettierrc Meta: Move prettier config files to the root of the repository 2020-08-24 18:21:33 +02:00
.swift-format Meta: Add swift-format configuration 2024-07-30 18:38:02 -06:00
.swift-version Meta: Update swift version to 2025-06-22 2025-07-09 16:26:49 -06:00
.ycm_extra_conf.py Meta: Sort all python imports 2025-06-09 11:25:14 -04:00
CMakeLists.txt CMake: Allow Windows to build Lib/Test GUI targets 2025-06-26 19:35:14 -06:00
CMakePresets.json CMake: Improve preset display names and descriptions 2025-07-09 16:26:59 -06:00
CODE_OF_CONDUCT.md Meta: Add code of conduct (from the Ruby community) 2024-10-02 09:49:52 +02:00
CONTRIBUTING.md Documentation: Fix Ladybird's documentation url 2025-05-20 15:53:48 -04:00
ISSUES.md Everywhere: Document use of ladybird.py over ladybird.sh 2025-05-29 16:24:17 -04:00
LICENSE Meta: Update license year 2025-02-10 11:40:57 +00:00
pyproject.toml Meta: Use "extend-select" to enable non-default python linters 2025-06-09 17:49:35 -04:00
README.md Libraries: Remove LibArchive 2024-11-25 13:37:45 +01:00
SECURITY.md Documentation: Make updates to align better with new issue template 2024-10-31 09:18:08 +01:00
vcpkg-configuration.json Meta: Add overlay port for vulkan-loader 2024-07-07 15:56:59 +02:00
vcpkg.json Meta: Enable the zstd feature for curl 2025-07-11 14:16:07 +02:00

Ladybird

Ladybird is a truly independent web browser, using a novel engine based on web standards.

Important

Ladybird is in a pre-alpha state, and only suitable for use by developers

Features

We aim to build a complete, usable browser for the modern web.

Ladybird uses a multi-process architecture with a main UI process, several WebContent renderer processes, an ImageDecoder process, and a RequestServer process.

Image decoding and network connections are done out of process to be more robust against malicious content. Each tab has its own renderer process, which is sandboxed from the rest of the system.

At the moment, many core library support components are inherited from SerenityOS:

  • LibWeb: Web rendering engine
  • LibJS: JavaScript engine
  • LibWasm: WebAssembly implementation
  • LibCrypto/LibTLS: Cryptography primitives and Transport Layer Security
  • LibHTTP: HTTP/1.1 client
  • LibGfx: 2D Graphics Library, Image Decoding and Rendering
  • LibUnicode: Unicode and locale support
  • LibMedia: Audio and video playback
  • LibCore: Event loop, OS abstraction layer
  • LibIPC: Inter-process communication

How do I build and run this?

See build instructions for information on how to build Ladybird.

Ladybird runs on Linux, macOS, Windows (with WSL2), and many other *Nixes.

How do I read the documentation?

Code-related documentation can be found in the documentation folder.

Get in touch and participate!

Join our Discord server to participate in development discussion.

Please read Getting started contributing if you plan to contribute to Ladybird for the first time.

Before opening an issue, please see the issue policy and the detailed issue-reporting guidelines.

The full contribution guidelines can be found in CONTRIBUTING.md.

License

Ladybird is licensed under a 2-clause BSD license.