Robot

What will the following robots.txt file do?
User-agent:Googlebot
Disallow:/*?
User-agent:Scooter
Disallow:

That will tell Google not to rank your website. Robots txt should be avoided altogether unless you have a very good reason for using it (assuming you wish to rank on Google).

Quote:

---

Originally Posted by stephanieadams

What will the following robots.txt file do?
User-agent:Googlebot
Disallow:/*?
User-agent:Scooter
Disallow:

---

Actually there are two robots that are being disallowed to a certain page. Google's robot is named Googlebot while Scooter is AltaVista's robot.