lexer: Add support for macro punctuation.
authorBen Pfaff <blp@cs.stanford.edu>
Mon, 22 Mar 2021 06:06:14 +0000 (23:06 -0700)
committerBen Pfaff <blp@cs.stanford.edu>
Fri, 9 Apr 2021 18:16:48 +0000 (11:16 -0700)
commited109bf498216cef15a3cbf180827dc8b20eff0b
treec2355019f7d7b12784816616b0545951bd24d67c
parentd26105c398be227dc38668ce3e742c31adef15f7
lexer: Add support for macro punctuation.

These punctuation symbols can be used to delimit macro arguments, even
though they aren't allowed anywhere else in the language.
src/data/identifier.c
src/data/identifier.h
src/language/command.def
src/language/lexer/scan.c
src/language/lexer/segment.c
src/language/lexer/token.c
tests/language/lexer/lexer.at
tests/language/lexer/scan.at
tests/language/lexer/segment.at