...goes in the root of your web site. This suggests that this variation of robots.txt will allow search engines to crawl the whole of the site.
User-agent: *
Disallow:
...goes in the root of your web site. This suggests that this variation of robots.txt will allow search engines to crawl the whole of the site.
User-agent: *
Disallow:
No comments:
Post a Comment