_____/ On Wed 23 Nov 2005 16:46:50 GMT, [Denis de Bernardy] wrote : \_____
[mailto:wp-hackers-bounces@xxxxxxxxxxxxxxxxxxxx] On Behalf Of
Sent: Wednesday, November 23, 2005 5:45 PM
Subject: [wp-hackers] Robots.txt
I was thinking it would be a good idea to include a simple robots.txt
file within the Wordpress release to block of bot access to the
wp-admin, wp-includes, and wp-content directories.
make that a robots-sample.txt
I'd hate to loose my robots.txt by mistake.
Not everyone installs WordPress at the top level either. The implication of
multiple robots.txt files would be user confusion. I suggest prepending to the
top of each administration page e.g.
<META HTTP-EQUIV="CACHE-CONTROL" CONTENT="NO-CACHE">
<META NAME="ROBOTS" CONTENT="NOINDEX,NOFOLLOW">
Roy S. Schestowitz
http://Schestowitz.com | SuSE Linux | PGP-Key: 0x74572E8E
4:15am up 21 days 0:09, 4 users, load average: 0.18, 0.33, 0.26