r4 - 18 Jul 2004 - 19:43:00 - LeoGalambosYou are here: TWiki >  Egothor Web  > RobotBenchmark

Benchmark of the robot on *.cz

This test failed due to insufficient disk space. Therefore, there is not any detailed view to configuration and statistics. Fortunately, it was almost identical to the next benchmark on AC.UK.

'Weekly' Graph (30 Minute Average) - CZ TLD:
127.0.0.1_1-week.png

Benchmark of the robot on *.ac.uk

Configuration

  1. Hardware: single CPU Intel PIII 733MHz
  2. Software: single node Egothor 1.2.5-RC-V, Linux 2.4.25-gentoo-r2, reiserfs 3.6.11
  3. Domain: *.ac.uk, sessionid was eliminated from URLs
  4. The robot used the following RulesFile
user-agent      +http://www.egothor.org/robot.html
loop            2

valid           http://.*\.ac\.uk(:\d+)?/.*
replace         &                   &
replace         &\w+=[0-9a-fA-F]{8,}&   &
replace         &\w+=[0-9a-fA-F]{8,}\z  <EMPTY>
replace         \?\w+=[0-9a-fA-F]{8,}(&|\z)     \?
replace         ;\w+=[0-9a-fA-F]{8,}\?  \?
replace         &&                      <EMPTY>
replace         \?&                     \?
replace         \?$                     <EMPTY>

Results

Statistics
Threads 30
Max idle time 60000
Last job at 1086396429744
Started at 1086119703402
Tasks 7918207
Rate (t/s) 28.613847468112905
Manager cache miss-rate 0.012781068
Records 5432378
...links 133436314
Cache url->id miss-rate 0.24589117
Cache NodeOfSH miss-rate 0.06130156
Ready servers 100
Root level 21666
...items planned 21666
Disk occupied
All data structures (disk blocks) 67,740,528 kB
Scheduler data 1,964,501 kB
Corpus auxiliary data 2,689,281 kB
Gathered data (gzipped) cca 63 GB

Network statistics

`Weekly' Graph (30 Minute Average):
N/A

Maximum In : 1100 kBps (5 min average)
Maximum Out : 57 kBps (5 min average)

Edit | Attach | Printable | Raw View | Backlinks: Web, All Webs | History: r4 < r3 < r2 < r1 | More topic actions
 
Powered by TWiki
This site is powered by the TWiki collaboration platformCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback