| Robots.txt Validator |
This robots.txt validator analyzes the syntax of commands for valid format which are provided by robot exclusion standard. To test, enter the full path of robots.tx and hit enter or click 'check robots.txt' button. If it contains errors it will highlight and display the result information accordingly. when checking for validation, the tool checks for syntax error, logical errors and mistyped words. Besides following robots exclusion standard rules it also considers spider specific extensions like sitemap command for google.
|
||||
