> For several weeks my server logs have included the following error once
> 08/Feb/2005 14:23:35 220.127.116.11 /index.htm/robots.txt 404
> 09/Feb/2005 15:15:40 18.104.22.168 /index.htm/robots.txt 404
> 10/Feb/2005 22:26:25 22.214.171.124 /index.htm/robots.txt 404
> 11/Feb/2005 23:54:48 126.96.36.199 /index.htm/robots.txt 404
> I can't figure out why Microsoft is looking for my robots.txt file in a
> non-existant (non-standard) directory named index.htm
> I have a valid, properly written robots.txt file in my webroot directory.
> I've tried contacting Microsoft and MSN regarding the problem. My attempts
> to talk to someone who actually deals with MSN Search Engine or networking
> have been unsuccessful. Filling out the Search Engine support form at
> support.msn.com was useless.
> Any advice would be appreciated.
Contacting support teams of search engines is pointless. These bodies handle
potentially billions of people. Only when it comes to services like AdSense
which offer them income, then friendly support staff is put in place.
Speaking of search engine bugs, Google has at least one as well. This
morning I got a reminder (in the form of 404's) that Google cannot handle
frames properly if they come from different domains.