sm-compiler

Write a compiler from scratch

1. Lexical Analyzer (a.k.a. tokenizer or scanner)

Scans the input and looks for basic language elements called tokens. The tokens are typically represented internally as unique integers or an enumerated type.