Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | lexer: initial lexer | franck cuny | 2020-01-11 | 2 | -0/+218 |
| | | | | | | | | | The initial lexer for the monkey language. We only support a small subset at this stage. We have some simple tests to ensure that we can parse some small snippet, and that the minimum number of tokens we need are also all supported correctly. | ||||
* | token: initial tokenizer. | franck cuny | 2020-01-11 | 1 | -0/+48 |
This is the initial tokenizer for the monkey language. For now we recognize a limited number of tokens. We only have two keywords at this stage: `fn` and `let`. `fn` is used to create function, while `let` is used for assigning variables. The other tokens are mostly to parse the source code, and recognize things like brackets, parentheses, etc. |