kotovalexarian-likes-gitlab/gitlab-org--gitlab-foss
1
0
Fork 0
Code Releases Activity

Add the /help page in robots.txt

Browse source 
The /help page has docs which we don't want to be crawled
as we prefer the docs website instead.

Related https://gitlab.com/gitlab-org/gitlab-ce/issues/44433
This commit is contained in:
Achilleas Pipinellis 2018-03-22 10:55:02 +01:00
parent 5790caa7dc
commit 71f707bfe8
No known key found for this signature in database
GPG key ID: A0996FBD3E92C17B
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
public/robots.txt
View file

@ -20,6 +20,7 @@ Disallow: /projects/new
Disallow: /groups/new
Disallow: /groups/*/edit
Disallow: /users
Disallow: /help
# Global snippets
User-Agent: *