Archives

A WordPress site we administer had the following automatically generated robots.txt file (in a fairly vanilla installation). User-agent: * Disallow: Disallow: /wp-admin Disallow: /wp-includes [...]