Implementation of lexer states over UTF8 strings based on the Camomile library
(available at http://camomile.sourceforge.net).
One is advised to use the
Utils.lexer_state class instead of this one.
char * char
exception Exception of
val string_of_error :
error -> string
class t :
This class encapsulates the state of a lexer over the UTF8 string that
is passed at instance creation (essentially an index over the string).
The next character being read is the first one of the UTF8 string passed
at instance creation (unless it is empty).