| Robots.txt Generator |
An easy to use tool which will allow you to generate a robots.txt file for your web site. This tool is ideal for people who just wish to generate specific commands for hiding files or directories that you don’t wish the search engine crawlers to find. To create file, select particular search engine agent, set options, enter URL's which are to be excluded and click create button. It will create all the respective commands. Just copy the result output to a text file and save it with exact name robots.txt. Finally place it under the root directory of your website.
|
||||
