Expected Token.Kind.Name, got Token.Kind.Comment

[kennethcochran]

I am attempting to use the AST modules as the basis for a refactoring tool. As a test I ran Lexer:scan() against the enumerate.lua source then ran Parser:parseChunk() on the token list it produced. This resulted in an error:

Expected Token.Kind.Name, got Token.Kind.Comment

I would expect comments at the beginning of a source file to be valid syntax. Is this a bug in the parser or am I using these modules incorrectly?

[optimisticside]

You seem to be using the code correctly. Can you show me what code seems to be causing the error?

[kennethcochran]

I'm running it from inside Roblox Studio using the Nexus Unit Testing plugin.

local NexusUnitTesting = require("NexusUnitTesting")

NexusUnitTesting:RegisterUnitTest(NexusUnitTesting.UnitTest.new("Test 1"):SetRun(function()
	local ServerScriptService = game:GetService("ServerScriptService")
	local Lexer = require(ServerScriptService.Folder.Lexer)
	local myLexer = Lexer.new(ServerScriptService.enumerate.Source)
	local tokens = myLexer:scan()

	local parser = require(ServerScriptService.Folder.Parser)
	local myParser = parser.new(tokens)
	local chunk = myParser:parseChunk()

end))

The enumerate module script is a verbatim copy of https://github.com/optimisticside/luaul/blob/master/Common/enumerate.lua.

The call stack looks like:

Parser:154 function _error
Parser:205 function _expect
Parser:484 function parseName
Parser:453 function parsePrefixExpr
Parser:737 function parsePrimaryExpr
Parser:946 function parseStat
Parser:991 function parseBlock
Parser:1011 function parseChunk

So I think the issue is that the Parser isn't expecting comments. I removed them from enumerate.lua and reran the test and got an error about missing function parseFunctionBody instead, which appears to be accurate. There is no parseFunctionBody defined in Parser. But that is another issue.

Btw, are you interested in contributors? I'm a complete novice when it comes to compiler writing but I'm interested in learning and helping you on this project looks like a fairly easy way to get some knowledge on the basics.