Uploaded image for project: 'Hippo Plugins'
  1. Hippo Plugins
  2. HIPPLUG-1182

[robots.txt] Root facet navigation URLs must not be excluded, but their subpaths

    XMLWordPrintable

    Details

    • Similar issues:
    • Story Points:
      0.5
    • Sprint:
      Tiger Sprint 117

      Description

      We now automagically exclude facet navigation URLs. That may render a too large part of the content to be excluded from indexing. E.g. if /products points to the general products facets overview without any filters, then none of the products are indexed.

      What we should exclude is its subpaths instead, since those lead to the same resultsets and documents being available under multiple URLs, and those should be excluded from indexing. E.g. /products/price, /products/categories etc.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              bleunis Bert Leunis (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: