Re: Error 500

[Fabien Bodard <gambas.fr@xxxxxxxxx>]

robots.txt is ignored by ai crawlers. They do not respect this convention
So the need to find other indirect way  to block them.

Le jeu. 5 févr. 2026 à 16:14, Benoît Minisini
<benoit.minisini@xxxxxxxxxxxxxxxx> a écrit :
>
> Le 05/02/2026 à 15:58, Bruce Steers a écrit :
> >
> >
> > On Thu, 5 Feb 2026 at 14:28, Benoît Minisini <benoit.minisini@gambas-
> > basic.org <mailto:benoit.minisini@xxxxxxxxxxxxxxxx>> wrote:
> >
> >     Le 05/02/2026 à 15:20, Benoît Minisini a écrit :
> >      > Le 05/02/2026 à 15:15, Bruce Steers a écrit :
> >      >> Yep, it worked when i first tried, but now i'm getting a mixture of
> >      >> errors in a error 500 page.
> >      >> sometimes just and "internal server error" message.
> >      >> or one of these...
> >      >>
> >      >
> >      > I just connected to the server, and I do not see any full device.
> >     That's
> >      > strange...
> >      >
> >
> >     OK, it's a crawler that sends URL that crashes the wiki, and so
> >     temporary folder accumulate and eat all the inodes.
> >
> >     A 'robot.txt' is currently added to see if it will stop the crawler.
> >
> >     Regards,
> >
> >     --
> >     Benoît Minisini.
> >
> >
> > I guess it worked.
> > Thank you good sir :)
> > BruceS
>
> Actually no. But I fixed the wiki for generating incorrect URLs for
> enumeration symbols, and prevent it from crashing when receiving stupid
> URLs from crawler because of the previous bug.
>
> So now no '/tmp' filling, and the wiki and the bugtracker are back!
>
> --
> Benoît Minisini.
>
>


-- 
Fabien Bodard