1 | 10305 | 72.24 | 542 | 75.49 | Mozilla/5.0 |
2 | 1678 | 11.76 | 43 | 5.99 | clark-crawler2/Nutch-1.19-SNAPSHOT |
3 | 20 | 0.14 | 20 | 2.79 | Expanse indexes the network perimeters o... |
4 | 124 | 0.87 | 15 | 2.09 | FirmoGraph |
5 | 14 | 0.10 | 14 | 1.95 | NetSystemsResearch studies the availabil... |
6 | 80 | 0.56 | 12 | 1.67 | Mozilla/5.0 AppleWebKit/537.36 |
7 | 11 | 0.08 | 11 | 1.53 | Expanse, a Palo Alto Networks company, s... |
8 | 19 | 0.13 | 10 | 1.39 | (unknown) |
9 | 60 | 0.42 | 10 | 1.39 | CCBot/2.0 |
10 | 71 | 0.50 | 6 | 0.84 | Internet Explorer 9.x |
11 | 4 | 0.03 | 4 | 0.56 | Mozilla/5.0 |
12 | 63 | 0.44 | 3 | 0.42 | Apache-HttpClient/4.5.2 |
13 | 15 | 0.11 | 2 | 0.28 | Screaming Frog SEO Spider/15.1 |
14 | 18 | 0.13 | 2 | 0.28 | Internet Explorer 7.x |
15 | 4 | 0.03 | 2 | 0.28 | webprosbot/2.0 |
16 | 5 | 0.04 | 2 | 0.28 | node-fetch/1.0 |
17 | 6 | 0.04 | 2 | 0.28 | facebookexternalhit/1.1 |
18 | 8 | 0.06 | 2 | 0.28 | Go-http-client/1.1 |
19 | 2 | 0.01 | 2 | 0.28 | BaiduSpider |
20 | 1 | 0.01 | 1 | 0.14 | Opera 9.x |
21 | 2 | 0.01 | 1 | 0.14 | Grover/Grover-1.18 |
22 | 2 | 0.01 | 1 | 0.14 | tes-cocrawler/0.1.16.dev2 g1e593fc.d2021... |
23 | 1 | 0.01 | 1 | 0.14 | okhttp/3.12.13 |
24 | 18 | 0.13 | 1 | 0.14 | ltx71 - |
25 | 1 | 0.01 | 1 | 0.14 | Mozilla 5.0x |
26 | 5 | 0.04 | 1 | 0.14 | Drupal/8.9.16 |
27 | 27 | 0.19 | 1 | 0.14 | python-requests/2.26.0 |
28 | 1 | 0.01 | 1 | 0.14 | colly - https://github.com/gocolly/colly... |
29 | 2 | 0.01 | 1 | 0.14 | Xenu Link Sleuth/1.3.8 |
30 | 1 | 0.01 | 1 | 0.14 | Safari/11605.3.8.1 CFNetwork/760.9 Darwi... |