The scanner is now able to produce a set of tokens that can be used by the parser. This part focuses on some of the design implementations that will support the parser's processing.
The scanner is stateless, so it can't know what a backslash expression means. This part designs the Command token and looks at the many shapes a command name can take.
This part of the series explores the Flex lexer and Bison parser that are the backbone of the LilyPond language. It also discusses the future plans and perceived problems.