Uploaded image for project: '[Read Only] - Hippo Plugins'
  1. [Read Only] - Hippo Plugins
  2. HIPPLUG-1336

[Robots.txt] Support for "allow" rules

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Normal
    • Resolution: Won't Fix
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: plugins-robots.txt
    • Labels:
      None
    • Similar issues:

      Description

      Some customers have expressed the need for "Allow" support

      See usecase:
      http://tools.seobook.com/robots-txt/

      Disallow Googlebot from indexing of a folder, except for allowing the indexing of one file in that folder
      User-agent: Googlebot 
      Disallow: /folder1/ 
      Allow: /folder1/myfile.html
      

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              clam Christopher Lam (Inactive)
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: