Home Messages Index
[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index

Re: Bad request for robotsxx.txt

  • Subject: Re: Bad request for robotsxx.txt
  • From: Roy Schestowitz <newsgroups@xxxxxxxxxxxxxxx>
  • Date: Sun, 11 Sep 2005 02:58:32 +0100
  • Newsgroups: alt.www.webmaster
  • Organization: schestowitz.com / MCC / Manchester University
  • References: <nfAUe.71515$3S5.23958@tornado.rdc-kc.rr.com> <dfv2l0$7u4$2@godfrey.mcc.ac.uk> <3ogjrpF5rggiU1@individual.net> <slrndi6l5p.h8s.no.spam@thurston.blinkynet.net>
  • Reply-to: newsgroups@xxxxxxxxxxxxxxx
  • User-agent: KNode/0.7.2
__/ [Blinky the Shark] on Saturday 10 September 2005 22:48 \__

> Brian Wakem wrote:
>> Roy Schestowitz wrote:
>>
>>> [Sat Sep 10 07:31:08 2005] [error] [client 218.232.120.86] File does
>>> not exist: /home/schestow/public_html/robotsxx.txt
>>
>>
>> I just checked my error logs for this year on a busy site.  I have 5
>> reqests for robotsxx.txt, all from 218.232.120.83, which is very
>> similar to the IP address you noted.
>>
>> The IPs trace to Seoul.
> 
> I just found this opinion with a Google: "The robotsxx.txt is a bot:
> PlantyNetWebRobotV1, out of hinet.com in Taiwan, and obviously doesn't
> obey bot rules. Ban it."
> 
> That corresponds in part to a whois of that IP, which shows:
> 
> Network Name       : HANANET-HIGHBAN-PLANTYNET080

Good job finding that little nugget of information. How about redirecting
all requests for robotxx.txt back to them? You know, to mess up their own
logs... I already do that with /_vti_bin/owssvr.dll, /MSOffice/cltreq.asp
and /_vti_pvt/service.pwd, all of which are redirected to
microsoft.com/eat_your_own_garbage .

Roy

[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index