Fetch and parse robots.txt, listing user-agent rules, disallowed/allowed paths and sitemap references.
Run a complete 50+ check SEO audit of this website.