[Gambas-user] Eval tokenizer Fails in some cases

[Brian G]

Ok I attach a scripter file and input text file for the script to tokenize.

both as simple text files.

Put both on desktop and run in terminal
Thank You
Brian G

----- Original Message -----
From: "Brian" <brian at westwoodsvcs.com>
To: "Gambas mailing list" <user at lists.gambas-basic.org>
Subject: Re: [Gambas-user] Eval tokenizer Fails in some cases
-------------- next part --------------
A non-text attachment was scrubbed...
Name: testparser
Type: application/octet-stream
Size: 1072 bytes
Desc: not available
URL: <http://lists.gambas-basic.org/pipermail/user/attachments/20210202/2b79ae4f/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: DemoParse.gbs
Type: application/octet-stream
Size: 603 bytes
Desc: not available
URL: <http://lists.gambas-basic.org/pipermail/user/attachments/20210202/2b79ae4f/attachment-0001.obj>