-
robots.txt
Anyone have any idea why in webmaster tools it shows files that I do not have restricted by my robots.txt file show as restricted?
For example my playersonly review is said to be restricted but nowhere on the actual robots.txt file do I even mention this folder?
-
There is only 2 places you can do this: webmaster tools and the actual robots.txt file.
If you didn't manually exclude google its the file. Can you post your robots.txt file here without your actual url?
-
Here is my robots file copied directly. Does anything look amiss?
User-Agent: *
Disallow: /banners/
Disallow: /out
Disallow: /out/
Disallow: /play
Disallow: /play/
Allow: /
-
When I run your robots.txt file through an online checker it throws an error on the user-agent.
-
-
You may find it easier to create a new robots.txt file here; http://www.searchenginepromotionhelp...ts-creator.php
-
Thanks Gary - That worked - when I run it through the tool now I receive no errors! Thanks again
-
Now go to webmaster central and request a crawl so it pushes everything out quicker.
You may even want to ping it here
Then post it on a couple social networks like Facebook and Myspace and ping those as well.
You'll be back up to par in no time.
Do a site:yoursite search on google to see if its there or assign a google alert to the page you are targeting to see when Google reindexes it.