How Robots.txt works in Google

by seosurvivor on October 11, 2009

Matt Cutts put up a video about how Google deals with Robots.txt files. This will be a good one if you’re wondering exactly how Google sees your blocked URLs, etc…

Share and Enjoy:
  • Sphinn
  • StumbleUpon
  • Google Bookmarks
  • Digg
  • Propeller
  • Mixx
  • Reddit
  • Bumpzee
  • Facebook
  • del.icio.us
  • Technorati

{ 1 comment… read it below or add one }

Nick Stamoulis October 19, 2009 at 7:17 am

It is good to see that Google is worried about the used experience. As long as they can keep keep increasing use experience they will keep most users happy.

Leave a Comment

Previous post:

Next post: