Making WordPress.org

Opened 5 weeks ago

Last modified 5 weeks ago

#4817 new defect

Change meta robots directive on systems

Reported by: jonoaldersonwp Owned by:
Milestone: Priority: lowest
Component: Make (Get Involved) / P2 Keywords: seo


At the moment, systems URLs (such as https://make.wordpress.org/systems/, https://make.wordpress.org/systems/2019/10/01/redirect-downloads-wordpress-org-to-wordpress-org-download-currently/) output a meta robots tag with a value of noindex, nofollow.

This should be altered to noindex, follow.

Change History (2)

#1 @Otto42
5 weeks ago

That's not a tag which is specific to the systems blog, it is simply using the WordPress core "Discourage search engines from indexing this site" setting.

Which seems correct, as we don't want search engines indexing that site. Or looking at it in any way.

#2 @jonoaldersonwp
5 weeks ago

That tag/setting won't stop them looking at it. It prevents them from indexing it, and it prevents them from then following any links (though as of ~Oct, the nofollow directive in this case, as far as Google is concerned, is actually just a hint, rather than a directive).

If we want to stop them from looking at it, it needs blocking in robots.txt.

Given that isn't the case, we _do_ want them to follow links (and flow pagerank) _out_ of those pages back into other areas of the WP ecosystem.

If there's truly sensitive stuff here which we don't want crawling at all, it shouldn't be public.

Note: See TracTickets for help on using tickets.