[Egothor-tech] Duplicate default pages

[Leo Galambos]

Stuart David Lewis [sdl] wrote:

>Hi,
>
>Try the following search:
>
>http://www.aber.ac.uk/en/search/new.php?l=en&q=travel+maps&s=all
>
>The first two results are the same..
>
>http://www.aber.ac.uk/en/student/travel/ 
>http://www.aber.ac.uk/en/student/travel/index.php
>
>Could Egothor be improved to know that these are the same?
>  
>

Hi!

Unfortunately, you could only exclude the identical pages manually (in 
robot's rules file).

Cheers,
Leo

-- 
Leo Galambos
Faculty of Mathematics and Physics, DSE
Malostranske namesti 25
Prague 1
CZE

http://kocour.ms.mff.cuni.cz/~galambos/