[Egothor-tech] How does Egothor handle:- HTTP 403 forbidden

[Leo Galambos]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Stuart David Lewis [sdl] wrote:

> Hi,
>
> What does Egothor do when it comes across a HTTP 403 (forbidden)?
> It seems that it is returning them in the searches. Is this
> expected? Is there any way in the rules file to stop it doing this?
>
Hello,

the robot does not save any document which was fetched with HTTP
status<>2xx. It implies, the indexer cannot index such pages. If it
happens on your box, send me URL so that I could test it here.

Thank you!

Leo

- --
Leo Galambos
Faculty of Mathematics and Physics, DSE
Malostranske namesti 25
Prague 1
CZE

http://kocour.ms.mff.cuni.cz/~galambos/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)

iD8DBQFC1vdcBBOhx7G4BXcRAm93AJ9Iy+EMrImilkq4z6E3I5tSE8MR4wCfTcJ9
1oFe9J4n6NxUcJBxItmChb0=
=T04w
-----END PGP SIGNATURE-----