Opened 3 years ago

Closed 17 months ago

#5806 closed defect (bug) (fixed)

Remove legacy robots.txt disallow directives

Reported by: jonoaldersonwp's profile jonoaldersonwp Owned by:
Milestone: Priority: low
Component: General Keywords: seo

Description + Rosetta site robots.txt files (such as, and prevent crawling of the wp-admin directory.

These rules should be removed, for the following reasons:

*A separate ticket will alter where these resources are loaded from and how they're served.


Change History (3)

#1 @dd32
3 years ago

Remove legacy robots.txt disallow directives

These are the current core robots.txt directives, please follow up with a Core ticket if these are not appropriate for all WordPress sites.

I'll take a middle-ground approach here and specifically allow access to /wp-admin/load-*.php because I do know that some themes trigger some WordPress functionality that other sites wouldn't on the front-end.

#2 @dd32
3 years ago

In 11094:

Robots: Alow access to wp-admin/load-*.php as some themes load resources from there.

This should be upstreamed to Core.
See #5806.

#3 @jonoaldersonwp
17 months ago

  • Resolution set to fixed
  • Status changed from new to closed
Note: See TracTickets for help on using tickets.