Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Creating a tokens list #37

Open
HuseyinSimsek7904 opened this issue Jan 11, 2024 · 0 comments
Open

Creating a tokens list #37

HuseyinSimsek7904 opened this issue Jan 11, 2024 · 0 comments
Assignees
Labels
compiler Anything about the compiler enhancement New feature or request high-priority

Comments

@HuseyinSimsek7904
Copy link
Member

HuseyinSimsek7904 commented Jan 11, 2024

Currently, every time we need a token, we just ask the lexer to get the next token, we work with it and the cycle repeats. Instead what we need is for the lexer to run ONCE before the compiler and generate a list of tokens. We can then work on these tokens.

This will allow us to ignore unused procedures, add preprocessing and add better debugging information.

@HuseyinSimsek7904 HuseyinSimsek7904 added enhancement New feature or request high-priority compiler Anything about the compiler labels Jan 11, 2024
@HuseyinSimsek7904 HuseyinSimsek7904 self-assigned this Jan 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
compiler Anything about the compiler enhancement New feature or request high-priority
Projects
None yet
Development

No branches or pull requests

1 participant