Comments on: Robots.txt basics http://www.bloggingtips.com/2007/05/14/robotstxt-basics/ Blog Themes, Blog Design & Daily Blog Tips Wed, 08 Feb 2012 15:16:10 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Internet Shopping http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-168139 Internet Shopping Sun, 08 Jun 2008 22:04:55 +0000 http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-168139 Kevin, this is the Terrific post by you, wonderful. I got every thing which i want to know about robots.txt at one place and that's your informative post. many thanks for it. Kevin, this is the Terrific post by you, wonderful.

I got every thing which i want to know about robots.txt at one place and that's your informative post. many thanks for it.

]]> By: AskApache http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-607 AskApache Thu, 17 May 2007 17:38:09 +0000 http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-607 <a href="http://www.askapache.com/seo/wordpress-robotstxt-optimized-for-seo.html" rel="nofollow">Original Article</a> at AskApache. Original Article at AskApache.

]]> By: Stephen Welton http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-468 Stephen Welton Mon, 14 May 2007 13:12:55 +0000 http://www.bloggingtips.com/2007/05/14/robotstxt-basics/#comment-468 I might wait to spend some time on this one when you get back. I have been wondering what the buzz was about this and I'm sure it will become important to me as my site begins to grow to prevent the nasty crawlers out there that can slide by your website. I have seen a few sites that show up in google and they don't index pretty. I might wait to spend some time on this one when you get back.

I have been wondering what the buzz was about this and I’m sure it will become important to me as my site begins to grow to prevent the nasty crawlers out there that can slide by your website.

I have seen a few sites that show up in google and they don’t index pretty.

]]>