This is the revision history for lexing in <*:##NULL>

factoid_idsubjectcopulapredicateauthornamespace
9168 lexing is for lexing use Parse::Lex and HOP::Lexer if you are lazy. If you want to roll your own you can use the \G anchor, /gc regex flags or use s/// to move along the stream. mucker