Comments on: Using FilesMatch and Files in htaccess http://www.askapache.com/htaccess/using-filesmatch-and-files-in-htaccess.html Web Development Sun, 20 Jul 2008 16:56:12 +0000 http://wordpress.org/?v=2.6 By: Playing with the X-Robots-Tag HTTP header - SEO - Joost de Valk's SEO Blog http://www.askapache.com/htaccess/using-filesmatch-and-files-in-htaccess.html#comment-35049 Playing with the X-Robots-Tag HTTP header - SEO - Joost de Valk's SEO Blog Sun, 20 Jan 2008 20:46:24 +0000 http://www.askapache.com.com/htaccess/using-filesmatch-and-files-in-htaccess.html#comment-35049 [...]Example uses of the X-Robots-Tag If you want to prevent search engines from showing files you've generated with PHP, add the following in the header file: <pre><br /> header(’X-Robots-Tag: noindex’, true);<br /> </pre> This would not prevent search engines from following the links on those pages, if you want to do that, do the following: <pre><br /> header(’X-Robots-Tag: noindex, nofollow’, true);<br /> </pre> But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following: <pre><br /> <FilesMatch "\.doc$"><br /> Header set X-Robots-Tag "index, noarchive, nosnippet"<br /> </Files><br /> </pre>[...] [...]Example uses of the X-Robots-Tag

If you want to prevent search engines from showing files you’ve generated with PHP, add the following in the header file:

header(’X-Robots-Tag: noindex’, true);

This would not prevent search engines from following the links on those pages, if you want to do that, do the following:

header(’X-Robots-Tag: noindex, nofollow’, true);

But doing it in PHP is probably not the easiest use for this kind of thing. I myself greatly prefer setting headers in Apache, when possible. Consider, for instance, preventing search engines from caching / showing a preview for all .doc files on your domain, you would only have to do the following:

<FilesMatch "\.doc$">
Header set X-Robots-Tag "index, noarchive, nosnippet"
</Files>

[...]

]]>