tokenizeHtml

fun tokenizeHtml(xml: String, keepComments: Boolean = false, keepNames: Boolean = false): List<KiteXmlToken>(source)

tokenize for a document served as text/html: a numeric character reference follows HTML's rules, so one to 0x80..0x9F maps through windows-1252 and one to 0, a surrogate or past U+10FFFF is U+FFFD (HTML, 13.2.5.80; #871). An XHTML document keeps XML's rules.