summaryrefslogtreecommitdiff
path: root/public/robots.txt
diff options
context:
space:
mode:
authorAchilleas Pipinellis <axil@gitlab.com>2018-03-22 10:55:02 +0100
committerAchilleas Pipinellis <axil@gitlab.com>2018-03-22 10:55:02 +0100
commit71f707bfe86f2f0a90182bc92033963aef32ce15 (patch)
tree8fb0f4fdee1e0699c6a8f8548774b98504329ea2 /public/robots.txt
parent5790caa7dc2fccf506a58da65f7d8aefaae3a18b (diff)
downloadgitlab-ce-71f707bfe86f2f0a90182bc92033963aef32ce15.tar.gz
Add the /help page in robots.txtrobots-help
The /help page has docs which we don't want to be crawled as we prefer the docs website instead. Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
Diffstat (limited to 'public/robots.txt')
-rw-r--r--public/robots.txt1
1 files changed, 1 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt
index 123272a9834..1f9d42f4adc 100644
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -20,6 +20,7 @@ Disallow: /projects/new
Disallow: /groups/new
Disallow: /groups/*/edit
Disallow: /users
+Disallow: /help
# Global snippets
User-Agent: *