From 831d3d4ca420713ba8fdffd56b3aec25d8b2ea03 Mon Sep 17 00:00:00 2001 From: Ben Pfaff Date: Tue, 30 Nov 2021 06:54:48 -0800 Subject: [PATCH] segment: Add comment about zero-length segments. --- src/language/lexer/segment.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/src/language/lexer/segment.c b/src/language/lexer/segment.c index e5d0af2352..05a9f57236 100644 --- a/src/language/lexer/segment.c +++ b/src/language/lexer/segment.c @@ -1893,6 +1893,9 @@ segmenter_get_mode (const struct segmenter *s) bytes as part of INPUT, because they have (figuratively) been consumed by the segmenter. + Segments can have zero length, including segment types SEG_END, + SEG_SEPARATE_COMMANDS, SEG_START_DOCUMENT, SEG_INLINE_DATA, and SEG_SPACES. + Failure occurs only if the segment type of the N bytes in INPUT cannot yet be determined. In this case segmenter_push() returns -1. If more input is available, the caller should obtain some more, then call again with a larger -- 2.30.2