Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | lexer: support more operator tokens. | franck cuny | 2020-01-11 | 1 | -0/+13 |
| | | | | | Support the operator tokens that were added to our tokenizer. This also add a few more tests to ensure we handle them correctly. | ||||
* | lexer: initial lexer | franck cuny | 2020-01-11 | 1 | -0/+114 |
The initial lexer for the monkey language. We only support a small subset at this stage. We have some simple tests to ensure that we can parse some small snippet, and that the minimum number of tokens we need are also all supported correctly. |