WordPress.org

Making WordPress.org

Opened 2 weeks ago

Last modified 12 days ago

#4817 new defect

Change meta robots directive on systems

Reported by: jonoaldersonwp Owned by:
Milestone: Priority: lowest
Component: Make (Get Involved) / P2 Keywords: seo
Cc:

Description

At the moment, systems URLs (such as https://make.wordpress.org/systems/, https://make.wordpress.org/systems/2019/10/01/redirect-downloads-wordpress-org-to-wordpress-org-download-currently/) output a meta robots tag with a value of noindex, nofollow.

This should be altered to noindex, follow.

Change History (2)

#1 @Otto42
12 days ago

That's not a tag which is specific to the systems blog, it is simply using the WordPress core "Discourage search engines from indexing this site" setting.

Which seems correct, as we don't want search engines indexing that site. Or looking at it in any way.

#2 @jonoaldersonwp
12 days ago

That tag/setting won't stop them looking at it. It prevents them from indexing it, and it prevents them from then following any links (though as of ~Oct, the nofollow directive in this case, as far as Google is concerned, is actually just a hint, rather than a directive).

If we want to stop them from looking at it, it needs blocking in robots.txt.

Given that isn't the case, we _do_ want them to follow links (and flow pagerank) _out_ of those pages back into other areas of the WP ecosystem.

If there's truly sensitive stuff here which we don't want crawling at all, it shouldn't be public.

Note: See TracTickets for help on using tickets.