Comments for Parallel URL fetcher

13 Aug 2002 13:35 oswaldbuddenhagen

Re: Behavior

> 403 means "access denied".

oh, really? *surprise surprise*


> Access modes don't change automatically or randomly.

explain this to the servers that have a different opinion.

13 Aug 2002 13:14 Bisqwit

Re: Behavior

> % (does 403 reply really mean "try
> again until it works"?).
>
> yes, 403 obviously sometimes is a
> transient error - otherwise i hadn't
> done it that way.

403 means "access denied".
Access modes don't change automatically or randomly.

15 Mar 2002 07:32 oswaldbuddenhagen

Re: Behavior

> this looks like an ideal DoS tool.

there are more effective tools for such purposes ...


> It seems to keep retrying (at least a couple of times) after it has already been banned for flooding
> (does 403 reply really mean "try again until it works"?).

yes, 403 obviously sometimes is a transient error - otherwise i hadn't done it that way.
the retry logic should be a lot smarter and server-based, not url-based, as it is currently.
also, it should be possible to specify a per-server connection limit, not only a global one. i have already started working in this direction, but the usual permanent lack of time prevents me from finishing it any time soon.

14 Mar 2002 04:55 Bisqwit

Behavior
From the webserver administrator point of view, this looks like an ideal DoS tool. It seems to keep retrying (at least a couple of times) after it has already been banned for flooding (does 403 reply really mean "try again until it works"?).

Screenshot

Project Spotlight

ReciJournal

An open, cross-platform journaling program.

Screenshot

Project Spotlight

Veusz

A scientific plotting package.