Results 1 to 3 of 3

Thread: Robot

  1. #1
    stephanieadams is offline Public Member
    Join Date
    February 2011
    Posts
    29
    Thanks
    1
    Thanked 0 Times in 0 Posts

    Default Robot

    What will the following robots.txt file do?
    User-agent:Googlebot
    Disallow:/*?
    User-agent:Scooter
    Disallow:

  2. #2
    webber286 is offline Private Member
    Join Date
    April 2006
    Posts
    110
    Thanks
    22
    Thanked 13 Times in 11 Posts

    Default

    That will tell Google not to rank your website. Robots txt should be avoided altogether unless you have a very good reason for using it (assuming you wish to rank on Google).
    We help market the following websites: PlayersJet Online Gambling Sites | The Standard Pay Per Head

  3. #3
    Join Date
    February 2011
    Posts
    48
    Thanks
    1
    Thanked 7 Times in 7 Posts

    Default

    Quote Originally Posted by stephanieadams View Post
    What will the following robots.txt file do?
    User-agent:Googlebot
    Disallow:/*?
    User-agent:Scooter
    Disallow:
    Actually there are two robots that are being disallowed to a certain page. Google's robot is named Googlebot while Scooter is AltaVista's robot.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •