Robots / Noindex Checker

Analyze robots directives and HTTP status to determine if a page is indexable by search engines.