Uploaded image for project: '[Read Only] - Hippo Plugins'
  1. [Read Only] - Hippo Plugins
  2. HIPPLUG-1336

[Robots.txt] Support for "allow" rules

    XMLWordPrintable

Details

    • Improvement
    • Status: Closed
    • Normal
    • Resolution: Won't Fix
    • None
    • None
    • plugins-robots.txt
    • None

    Description

      Some customers have expressed the need for "Allow" support

      See usecase:
      http://tools.seobook.com/robots-txt/

      Disallow Googlebot from indexing of a folder, except for allowing the indexing of one file in that folder
User-agent: Googlebot 
Disallow: /folder1/ 
Allow: /folder1/myfile.html

      Attachments

        Activity

          People

            Unassigned Unassigned
            clam Christopher Lam (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: