Robots |
1 | 225 | 28.34 | \"Mozilla/5.0 |
2 | 110 | 13.85 | Baiduspider/2.0 |
3 | 91 | 11.46 | compatible Mozilla/5.0 |
4 | 56 | 7.05 | YandexBot/3.0 |
5 | 44 | 5.54 | bingbot/2.0 |
6 | 35 | 4.41 | msnbot/2.0b (+http://search.msn.com/msnb... |
7 | 34 | 4.28 | Baiduspider+(+http://www.baidu.com/searc... |
8 | 34 | 4.28 | MJ12bot/v1.4.3 |
9 | 28 | 3.53 | Sosospider+(+http://help.soso.com/webspi... |
10 | 22 | 2.77 | Googlebot/2.1 |
11 | 18 | 2.27 | Exabot/3.0 |
12 | 14 | 1.76 | - |
13 | 8 | 1.01 | ia_archiver(OS-Wayback) |
14 | 8 | 1.01 | Ezooms/1.0 |
15 | 8 | 1.01 | CareerBot/1.1 |
16 | 8 | 1.01 | MLBot (www.metadatalabs.com/mlbot) |
17 | 7 | 0.88 | Blekkobot |
18 | 6 | 0.76 | SISTRIX Crawler |
19 | 5 | 0.63 | MSIE 6.0 |
20 | 4 | 0.50 | Fedora/1.0.7 |
21 | 4 | 0.50 | 123peoplebot/1.0 |
22 | 4 | 0.50 | My Nutch Spider/Nutch-1.4 |
23 | 2 | 0.25 | NextGenSearchBot 1 (for information visi... |
24 | 2 | 0.25 | discobot/2.0 |
25 | 2 | 0.25 | Aboundex/0.2 (http://www.aboundex.com/cr... |
26 | 2 | 0.25 | nutch-1.4/Nutch-1.4 |
27 | 2 | 0.25 | WBSearchBot/1.1 |
28 | 2 | 0.25 | coccoc/1.0 () |
29 | 2 | 0.25 | MSIE 8.0 |
30 | 2 | 0.25 | MSIE 5.01 |
31 | 1 | 0.13 | MJ12bot/v1.4.2 |
32 | 1 | 0.13 | AhrefsBot/3.1 |
33 | 1 | 0.13 | SeznamBot/3.0 (+http://fulltext.sblog.cz... |
34 | 1 | 0.13 | SearchmetricsBot |
35 | 1 | 0.13 | Toplistbot |