Home Messages Index
[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index

Re: Do HTTP headers get spidered?

__/ [ canadafred ] on Friday 31 March 2006 21:29 \__

> "Roy Schestowitz" <newsgroups@xxxxxxxxxxxxxxx> wrote in message
> news:5155077.qVxqJIUKLR@xxxxxxxxxxxxxxxxxx
> 
>>>> Im using classic ASP.
>>>> Do strings in my HTTP headers get spidered.
> 
>> No, but they should be interpreted for instructions, I imagine.
> 
>>> Code should always be considered visible to an intelligent spider.
> 
>> By "spidered", I suppose the intent is to say "recorded", in which case
>> the
>> answer is probably not. However, it would be nice to keep track of
>> redirection information. That might get stored in the crawler's server,
>> but
>> never made public. No-one knows. Not me anyway...
> 
> 
>>>> Should I have my HTTP headers show
>>>> search engine optimization type strings?
> 
>>> I suppose it depends on the intent; whether you want to manipulate the
>>> search engine or simply guide it.
> 
>> How do you reckon you can SEO HTTP header? Identify oneself as the key
>> words?
> 
> I was refering to tags like <meta http-equiv="Keywords" content="">

Ahh... that's different. It's embedded in the page itself rather than
associated with server configuration and the network layer.

Best Wishes,

Roy

-- 
Roy S. Schestowitz      |    "How do I set my laser printer on stun?"
http://Schestowitz.com  |    SuSE Linux    ¦     PGP-Key: 0x74572E8E
  9:40pm  up 23 days 11:25,  10 users,  load average: 0.30, 0.46, 0.60
      http://iuron.com - next generation of search paradigms

[Date Prev][Date Next][Thread Prev][Thread Next]
Author IndexDate IndexThread Index