|
How do I stop search engines indexing my site? |
|
|
You can keep search engines from indexing your 'tosort' directory by creating a robots.txt file in the top-level directory of your web site, containing the text:
User-agent: *
Disallow: /tosort/ |
For more information take a look at http://www.robotstxt.org/
Do NOT use robots.txt to 'hide' a private directory from people. robots.txt can be read by anyone and hackers will have a look in there to see what may be of interest. If it is sensitive, password protect it.
|