ladybird/Tests/LibWeb/Text/input/Encoding/TextDecoder-decode.html

<!DOCTYPE html>
<script src="../include.js"></script>
<script>
    test(() => {
        try {
            let decoder = new TextDecoder("utf-8");
            println(`[${decoder.decode(new Uint8Array([0x41, 0x42, 0x43]))}]`); // "ABC"
            println(`[${decoder.decode()}]`);

            const surrogate = decoder.decode(new Uint8Array([0xed, 0xa0, 0x80])); // U+D800
            println(`[${surrogate.codePointAt(0).toString(16)}]`);

            const truncatedTail = decoder.decode(new Uint8Array([0xf0, 0x9f, 0x98]));
            println(`[${truncatedTail.length}, ${truncatedTail.codePointAt(0).toString(16)}]`);
        } catch (e) {
            println("ERROR: " + e.name + ": " + e.message);
        }
    });
</script>
Meta: Add DOCTYPEs to most text tests 2025-03-18 15:28:35 -03:00			`<!DOCTYPE html>`
LibWeb: Make 'optional BufferSource' IDL arguments actually optional Previously this was compiled to require an object despite the IDL file specifying 'optional'. This commit makes IDLGenerator respect this modifier, and fixes the only affected instance. 2023-05-30 03:18:23 -03:00			`<script src="../include.js"></script>`
			`<script>`
			`test(() => {`
			`try {`
			`let decoder = new TextDecoder("utf-8");`
			println(`[${decoder.decode(new Uint8Array([0x41, 0x42, 0x43]))}]`); // "ABC"
			println(`[${decoder.decode()}]`);
AK: Replace surrogates in String::from_utf8_with_replacement_character We are expected to replace lonely surrogates with U+FFFD when decoding UTF-8 text. 2025-07-05 13:00:04 -03:00
			`const surrogate = decoder.decode(new Uint8Array([0xed, 0xa0, 0x80])); // U+D800`
			println(`[${surrogate.codePointAt(0).toString(16)}]`);
LibTextCodec: Match UTF-8 replacement handling Consume truncated UTF-8 tails as one malformed sequence while preserving existing behavior for encoded surrogate code points. This keeps lazy SourceCode decoding and bytecode cache source hashing aligned with eager source text decoding for invalid cached script source bytes. Continue stripping an initial UTF-8 byte order mark in UTF8Decoder::to_utf8() so HTML parsing keeps matching the previous String-based implementation. Cover the shared decoder behavior and the TextDecoder API surface. 2026-05-17 20:47:40 -03:00
			`const truncatedTail = decoder.decode(new Uint8Array([0xf0, 0x9f, 0x98]));`
			println(`[${truncatedTail.length}, ${truncatedTail.codePointAt(0).toString(16)}]`);
AK: Replace surrogates in String::from_utf8_with_replacement_character We are expected to replace lonely surrogates with U+FFFD when decoding UTF-8 text. 2025-07-05 13:00:04 -03:00			`} catch (e) {`
LibWeb: Make 'optional BufferSource' IDL arguments actually optional Previously this was compiled to require an object despite the IDL file specifying 'optional'. This commit makes IDLGenerator respect this modifier, and fixes the only affected instance. 2023-05-30 03:18:23 -03:00			`println("ERROR: " + e.name + ": " + e.message);`
			`}`
			`});`
			`</script>`