segment: Allow '.' as separate token with a line, for macros.
authorBen Pfaff <blp@cs.stanford.edu>
Tue, 13 Apr 2021 17:35:02 +0000 (10:35 -0700)
committerBen Pfaff <blp@cs.stanford.edu>
Tue, 13 Apr 2021 17:35:09 +0000 (10:35 -0700)
commite546c5d3c1ef7bc06c8d7bb6752a863ba3b041e5
treedbc7e44ba77492be082b4013b01bd37e0c4d1a72
parent1a507e967cecfffdc33a64e24b9865cfd0d2aee3
segment: Allow '.' as separate token with a line, for macros.

The description of macros just says that ^ and \ can't be used as macro
delimiters, so . is probably OK.
src/language/lexer/lexer.c
src/language/lexer/scan.c
src/language/lexer/scan.h
src/language/lexer/segment.c
src/language/lexer/segment.h
tests/language/lexer/lexer.at
tests/language/lexer/scan.at