[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: New routine in the development version : Tokenize()


Le 03/10/2025 à 21:30, Salva a écrit :
Hi,
Very useful. I'm working on a parser for SVG files and have a working version. Compared to XML, it's very slow (3-4 times slower), but the resulting files are 20% smaller. For me, size is more important than speed.

I've done a proof of concept, and Tokenizer is fast and simplifies development.
The results with a tiny SVG file:
- My parser: 1.02 msec
- XML: 0.31 msec
- Using Tokenizer: 0.43 msec

It's a huge improvement!
Best regards.


Do not hesitate to share the code! It will help me to test the function more, see if it can be enhanced or speeded up.

Regards,

--
Benoît Minisini.


References:
New routine in the development version : Tokenize()Benoît Minisini <benoit.minisini@xxxxxxxxxxxxxxxx>
Re: New routine in the development version : Tokenize()Benoît Minisini <benoit.minisini@xxxxxxxxxxxxxxxx>
Re: New routine in the development version : Tokenize()Fabien Bodard <gambas.fr@xxxxxxxxx>
Re: New routine in the development version : Tokenize()Salva <harpomix@xxxxxxxxx>