WordPress.org
Get WordPress

Making WordPress.org

Changes between Version 2 and Version 3 of Ticket #6763


Ignore:
Timestamp:
02/17/2023 04:11:32 AM (20 months ago)
Author:
jonoaldersonwp
Comment:

Legend:

Unmodified
Added
Removed
Modified

  • Ticket #6763 – Description

    v2 v3  
    88- Tweak the 'search' disallow rule to add a trailing slash
    99- Moving sitemap references to the end
    10 - Disallow `/*/wp-json/` (which is crawled by Google upwards of 40k times per day!)
     10- Disallow `/plugins/wp-json/plugins/v1/locale-banner` (which is crawled by Google upwards of 40k times per day!)
    1111- Disallow subfolder variations of some rules so that they catch subsites (e.g., `/*/wp-admin/`)
    1212- Disallow 'non-pretty' variations (e.g., `?rest_route=`)
    … …  
    2222Disallow: /wp-admin/
    2323Disallow: /*/wp-admin/
    24 Disallow: /wp-json/
    25 Disallow: /*/wp-json/
    2624Disallow: /?rest_route=
    2725Disallow: /xmlrpc.php
     26
     27# Prevent crawling of leaky theme endpoints
     28# --------------------------------
     29User-agent: *
     30Disallow: /plugins/wp-json/plugins/v1/locale-banner
    2831
    2932# Prevent crawling of search URLs