Roy Schestowitz <newsgroups@xxxxxxxxxxxxxxx> wrote:
>__/ [ Allis ] on Tuesday 28 February 2006 17:42 \__
>
>> Knowing the little foolery that wise men have makes a great show, Brian
>> Wakem has proclaimed :
>>
>>> Allis wrote:
>>>
>>>> Knowing the little foolery that wise men have makes a great show,
>>>> Brian Wakem has proclaimed :
>>>>
>>>>> Have been getting lots of requests for robots.txt these last few
>>>>> days.
>>>>>
>>>>> Big batches of them (100 at a time) from multiple IPs, all from
>>>>> Firefox 1.5.0.1
>>>>>
>>>>> Example:
>>>>>
>>>>> 62.252.224.18 - - [28/Feb/2006:17:06:52 +0000] "GET /robots.txt
>>>>> HTTP/1.1" 404 285 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1;
>>>>> en-GB; rv:1.8.0.1) Gecko/20060111 Firefox/1.5.0.1"
>>>>> "host:213.228.193.51"
>>>>>
>>>>> and so on for another 90 or so lines.
>>>>>
>>>>> Anyone else seen this? A bug in FF 1.5.0.1?
>>>>>
>>>>
>>>> http://www.dnsstuff.com/tools/whois.ch?ip=62.252.224.18&cache=off
>>>
>>>
>>> As I said ...from multiple IPs.
>>>
>>>
>>
>> Read that ;)
>> Thought I'd send the info in case the IP's are owned by the same
>> block/co.
>>
>> My mistake.
>> Not the first, won't be the last.
>
>The sarcastic answer: somebody is preparing for an 'ethical' DDOS attack.
>
>The more plausible answer: someone is surveying sites to studying if they
>serve different robots directives to differnet addresses. I can recall
>Web-wide waves that 'tickled' sites for 404's responses.
>
>Best wishes,
>
>Roy
Don't forget the possibility that some newb robot developer is running
a piece'o'crap code and doesn't realize it.
I recently saw an instance of a robot that requested robots.txt using
a ua of the null string, then requested other files using a
normal-for-a-robot looking ua. I figure it was a bug, but nefarious
intent is never discounted.
--
http://www.ren-prod-inc.com/hug_soft/store.php?action=contact
|
|
