diff options
| author | Achilleas Pipinellis <axil@gitlab.com> | 2018-03-22 10:55:02 +0100 |
|---|---|---|
| committer | Achilleas Pipinellis <axil@gitlab.com> | 2018-03-22 10:55:02 +0100 |
| commit | 71f707bfe86f2f0a90182bc92033963aef32ce15 (patch) | |
| tree | 8fb0f4fdee1e0699c6a8f8548774b98504329ea2 | |
| parent | 5790caa7dc2fccf506a58da65f7d8aefaae3a18b (diff) | |
| download | gitlab-ce-robots-help.tar.gz | |
Add the /help page in robots.txtrobots-help
The /help page has docs which we don't want to be crawled
as we prefer the docs website instead.
Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
| -rw-r--r-- | public/robots.txt | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt index 123272a9834..1f9d42f4adc 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -20,6 +20,7 @@ Disallow: /projects/new Disallow: /groups/new Disallow: /groups/*/edit Disallow: /users +Disallow: /help # Global snippets User-Agent: * |