Russ Jones suggested on the Google Cache that search engines honor a disallow-by-keyword directive in robots.txt. This is a great idea. If someone injects spam pages into your site that use keywords in the URLs, you should be able to tell the spiders to ignore those pages — thus rendering the offensive and unwanted content ineffective.
This is far more useful than “rel=’nofollow’” or spam-tattling in Webmaster Central. The search engines can enlist Webmasters’ assistance by letting the Webmasters tell the search engines what should not be considered legitimate content.
Would it require some thought and tweaking? Sure. But I would do this in a heartbeat if people were injecting spam into my own sites.
Great idea, Russ!
If you have a blog or a forum where you discuss Webmaster issues, I encourage you to discuss Russ’ idea with your visitors. Let the search community know about this proposal. Let’s give it some visibility and see what happens.
{ 0 comments… add one now }
You must log in to post a comment.