mirrors/ladybird
0
0
Fork 0
mirror of https://github.com/LadybirdBrowser/ladybird.git synced 2025-05-10 13:12:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 9

LibWeb: Start building the tree building part of the new HTML parser

Browse source 
This patch adds a new HTMLDocumentParser class. It keeps a tokenizer
object internally and feeds itself with one token at a time from it.

The names and idioms in this class are expressed as closely to the
actual HTML parsing spec as possible, to make development as easy
and bug free as possible. :^)

This is going to become pretty large, but it's pretty cool!
This commit is contained in:
Andreas Kling 2020-05-24 00:14:23 +02:00
parent 0b61e21873
commit fd1b31d0ff
Notes: sideshowbarker 2024-07-19 06:12:03 +09:00
8 changed files with 515 additions and 76 deletions
Download patch file Download diff file Expand all files Collapse all files

3
Libraries/LibWeb/Parser/HTMLTokenizer.h
View file

@ -118,14 +118,13 @@ class HTMLTokenizer {
public:
explicit HTMLTokenizer(const StringView& input);
void run();
Optional<HTMLToken> next_token();
private:
Optional<u32> next_codepoint();
Optional<u32> peek_codepoint(size_t offset) const;
bool next_few_characters_are(const StringView&) const;
void consume(const StringView&);
void emit_current_token();
void create_new_token(HTMLToken::Type);
enum class State {