• dickelbeck's avatar
    DSNLEXER now supports: · 6700c604
    dickelbeck authored
        1)  nested quotes.  This is in anticipation of broader usage of the
            file type/syntax.  A string like this in the file:
                "my ""favorate"" string"
            can be returned as
                my "favorite" string
        2)  CommentsAsTokens is implemented, so you can ask the lexer to return
            comments as tokens, so they can be preserved.  The default is to ignore
            them.  A comment is defined as any line that has # as its first
            non-blank character.  (This means comments cannot follow anything else
            on a line.)
    6700c604
dsnlexer.cpp 11.9 KB