Temat: Roboty
No dobrze, zaczęłam od identyfikacji tego co do mnie włazi poprzez logi serwera tak jak napisali w którymś linku
mam takie boty z sierpnia
Robots/Spiders visitors
33 different robots Hits Bandwidth Last visit
FaceBook bot 11785 553.12 MB 11 Aug 2012 - 03:35
Googlebot 11037+20 144.24 MB 11 Aug 2012 - 04:02
Unknown robot (identified by 'bot*') 5036+105 69.27 MB 11 Aug 2012 - 04:01
MSNBot 3392+29 41.89 MB 11 Aug 2012 - 03:19
WordPress 2832 787.16 KB 11 Aug 2012 - 04:00
Feedfetcher-Google 1349 47.75 MB 11 Aug 2012 - 03:33
Unknown robot (identified by empty user agent string) 1340 39.77 MB 11 Aug 2012 - 00:43
MSNBot-media 734+414 21.82 MB 11 Aug 2012 - 03:53
Unknown robot (identified by 'robot') 818+12 15.47 MB 11 Aug 2012 - 03:58
Mail.ru bot 425+2 24.52 MB 11 Aug 2012 - 02:46
Unknown robot (identified by '*bot') 98+126 5.95 MB 11 Aug 2012 - 03:08
Nutch 166+10 2.20 MB 10 Aug 2012 - 14:51
Yandex bot 146+15 2.04 MB 11 Aug 2012 - 03:18
Unknown robot (identified by 'crawl') 93+12 3.12 MB 11 Aug 2012 - 00:38
Yahoo Slurp 100+2 903.97 KB 10 Aug 2012 - 07:53
Unknown robot (identified by hit on 'robots.txt') 0+97 45.43 KB 10 Aug 2012 - 20:00
Web Core / Roots 63 1.01 MB 09 Aug 2012 - 20:35
SeznamBot 41+11 538.16 KB 10 Aug 2012 - 07:11
Java (Often spam bot) 23 1.42 MB 10 Aug 2012 - 23:15
CFNetwork 23 450.10 KB 05 Aug 2012 - 17:56
legs 14+4 182.58 KB 10 Aug 2012 - 11:40
lmspider 10+1 154.60 KB 07 Aug 2012 - 08:17
Powermarks 8 495.49 KB 08 Aug 2012 - 12:25
Alexa (IA Archiver) 3+3 209.30 KB 06 Aug 2012 - 05:33
FeedValidator 4 38.55 KB 10 Aug 2012 - 21:07
BaiDuSpider 1+3 15.15 KB 07 Aug 2012 - 12:28
Unknown robot (identified by 'spider') 1+1 63.32 KB 08 Aug 2012 - 12:36
StackRambler 2 24.46 KB 07 Aug 2012 - 11:14
Turn It In 1+1 14.33 KB 03 Aug 2012 - 10:16
Python-urllib 1 40.28 KB 01 Aug 2012 - 12:44
FavIconizer 1 13.64 KB 04 Aug 2012 - 13:44
WGet tools 1 39.59 KB 09 Aug 2012 - 03:32
W3C Validator 1 14.01 KB 06 Aug 2012 - 17:05
Co jest napewno do zablokowania? I co zrobić z tymi badziewiami, których serwer nie identyfikuje?
I co w rubryce hits oznacza np 3+3 ?bo to Bandwidth to jest to co mi zżerają?
Dominika M S. edytował(a) ten post dnia 11.08.12 o godzinie 22:02