Add a dump-html-tokens utility that prints HTML tokenizer output in a stable text format, along with focused tokenizer input and expectation files. Include silent and repeated-iteration modes so the utility can also be used for local tokenizer throughput checks without changing the dumped token format.
4 lines
144 B
Text
4 lines
144 B
Text
StartTag <div> [id="main" class="container" data-value="foo" hidden=""] @0:1-0:54
|
|
EndTag </div> @0:57-0:60
|
|
Character U+000A @1:0
|
|
EndOfFile @1:0
|