Add the /help page in robots.txt

The /help page has docs which we don't want to be crawled
as we prefer the docs website instead.

Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
This commit is contained in:
Achilleas Pipinellis 2018-03-22 10:55:02 +01:00
parent 5790caa7dc
commit 71f707bfe8
No known key found for this signature in database
GPG Key ID: A0996FBD3E92C17B
1 changed files with 1 additions and 0 deletions

View File

@ -20,6 +20,7 @@ Disallow: /projects/new
Disallow: /groups/new
Disallow: /groups/*/edit
Disallow: /users
Disallow: /help
# Global snippets
User-Agent: *