5 Commits

Author	SHA1	Message	Date
Luna	6b9cc575d9	add draft scanner, remove messy Token union, replace by struct	2019-06-01 16:37:24 -03:00
Luna	9d4c1249b4	add keyword map when scanner is initialized ... - add basic identifier reading	2019-05-31 22:34:10 -03:00
Luna	69aa7b493d	add number tokens	2019-05-31 22:08:41 -03:00
Luna	d1db7a0bd9	add consumption of comments and strings	2019-05-31 21:46:18 -03:00
Luna	9a2c50a53e	add basic tokens and a basic lexer	2019-05-31 21:23:51 -03:00