Egothor Robot vs 7.0

You are viewing the page of the robot of the Egothor search engine. Version 7 of the robot is a late beta version and is used during the spring of 2007. It will eventually become part of version 2 of the complete Egothor search engine package. There is a full, live, implementation of the engine used at the University of Dundee, and can be found at http://www.egothor.dundee.ac.uk/.

We are indexing educational/university resources because:

• they provide a rich and finite data sample;
• the engine will be freely available once it is completed;
• finally we would like to create a 50M to 100M page live index of a useful resource.

Robot specification

• speed - It can fetch files at a selectable rate (set by the administrator). In the instance of www.egothor.org the rate is set at a maximum of 1 request per 1 second for each hostname and no more than 500 consecutive requests.
• frequency - The robot amongst other things calculates the frequency with which the content of pages changes. Pages and web-servers which are deemed to change often are visited more often. The frequency of the visits is selectable by the administrator, and in the instance of www.egothor.org it is set at no more than one visit per 30 minutes.
• user-agent - If you object to the engine visiting your server or domain please tell us to ignore it. However, we would prefer it if you were to include in your server's robots.txt the relevant exclusion string. You can find more information about robots.txt files at http://www.searchtools.com/robots/robots-txt.html. The robot of egothor obeys any instructions in robots.txt files or in meta tags in individual web pages. It listens to the User-Agent string egothor.
• contacts - For any problems or queries please email us.

Who we are:

Leo Galambos, the brains of the project, he is based at Charles University, Prague, Faculty of Mathematics and Physics, Department of Software Engineering.

Charles Christacopoulos, Management Information Officer at the University of Dundee in sunny Scotland.