See also: | This category in other languages: |
|
- Robots.txt Checker - - Analyzes a robots.txt file searching for syntax and "logical" errors, and shows a summary of what effect it will have.
|
- Robots.txt File Generator - - Assists in creating robots.txt files for controlling page inclusion and exclusion in search engines.
|
- Robots.txt Generator - - Information on the use of robots.txt as well s a robots.txt generator and a list of search engine robots.
|
- Robots.txt Validator - - Checks your robots.txt to insure it conforms to the robots exclusion standard.
|
|