Benchmark of the robot on *.cz
This test failed due to insufficient disk space. Therefore, there is not any detailed view to configuration and statistics. Fortunately, it was almost identical to the next benchmark on AC.UK.
'Weekly' Graph (30 Minute Average) - CZ TLD:
Benchmark of the robot on *.ac.uk
Configuration
- Hardware: single CPU Intel PIII 733MHz
- Software: single node Egothor 1.2.5-RC-V, Linux 2.4.25-gentoo-r2, reiserfs 3.6.11
- Domain: *.ac.uk, sessionid was eliminated from URLs
- The robot used the following RulesFile
user-agent +http://www.egothor.org/robot.html
loop 2
valid http://.*\.ac\.uk(:\d+)?/.*
replace & &
replace &\w+=[0-9a-fA-F]{8,}& &
replace &\w+=[0-9a-fA-F]{8,}\z <EMPTY>
replace \?\w+=[0-9a-fA-F]{8,}(&|\z) \?
replace ;\w+=[0-9a-fA-F]{8,}\? \?
replace && <EMPTY>
replace \?& \?
replace \?$ <EMPTY>
Results
| Statistics |
| Threads | 30 |
| Max idle time | 60000 |
| Last job at | 1086396429744 |
| Started at | 1086119703402 |
| Tasks | 7918207 |
| Rate (t/s) | 28.613847468112905 |
| Manager cache miss-rate | 0.012781068 |
| Records | 5432378 |
| ...links | 133436314 |
| Cache url->id miss-rate | 0.24589117 |
| Cache NodeOfSH miss-rate | 0.06130156 |
| Ready servers | 100 |
| Root level | 21666 |
| ...items planned | 21666 |
| Disk occupied |
| All data structures (disk blocks) | 67,740,528 kB |
| Scheduler data | 1,964,501 kB |
| Corpus auxiliary data | 2,689,281 kB |
| Gathered data (gzipped) | cca 63 GB |
Network statistics
`Weekly' Graph (30 Minute Average):
N/A
Maximum
In : 1100 kBps (5 min average)
Maximum
Out : 57 kBps (5 min average)