Wolfman's Brother wrote:
> Borek wrote:
>> On Sun, 24 Jul 2005 19:45:22 +0200, ted <occasionaluse@hotmail.com>
>> wrote:
>>
>>> Disallow: /*.gif$
>>
>>
>> If I recall correctly wildcards are not allowed by the standard.
>>
>> Check at www.robotstxt.org
>>
>> Best,
>> Borek
>
> To be pedantic about it.. It's not that wildcards arent ALLOWED by the
> standard, but that they arent HANDLED by it. So a "*" is not illegal,
> but simply means the literal character "*" rather than some other
> special meaning.
>
> However .. Google's handling of robots.txt DOES include special meanings
> for wildcards, and in that sense is non-standard.
>
> Chris
> --
> http://www.lowth.com/rope - Scriptable packet match logic for IPCop and
> other linux-based firewalls.
>From http://www.robotstxt.org/wc/faq.html#info
<snip>
Two common errors:
* Wildcards are _not_ supported: instead of 'Disallow: /tmp/*' just say
'Disallow: /tmp/'.
...
</snip>
Roy
--
Roy S. Schestowitz
http://Schestowitz.com
|
|
