gitlab-org--gitlab-foss/public
Ben Bodenmiller 595a93ee2c disallow irrelevant pages by default in robots
Update default robots.txt rules to disallow irrelevant pages that search
engines should not care about. This will still allow important pages
like the files, commit details, merge requests, issues, comments, etc.
to be crawled.
2015-08-17 23:11:16 -07:00
..
uploads Make sure important directories exist in git 2014-03-30 22:45:28 -04:00
404.html Improve text on error pages. 2015-05-13 09:41:55 +02:00
422.html Fix 422 error page. 2015-05-13 09:41:56 +02:00
500.html Improve text on error pages. 2015-05-13 09:41:55 +02:00
502.html Improve text on error pages. 2015-05-13 09:41:55 +02:00
apple-touch-icon-precomposed.png Replace old logo with new one 2015-06-19 16:59:16 +02:00
apple-touch-icon.png Replace old logo with new one 2015-06-19 16:59:16 +02:00
deploy.html Replace old logo with new one 2015-06-19 16:59:16 +02:00
favicon.ico Replace old logo with new one 2015-06-19 16:59:16 +02:00
logo.svg Replace old logo with new one 2015-06-19 16:59:16 +02:00
robots.txt disallow irrelevant pages by default in robots 2015-08-17 23:11:16 -07:00
static.css Improve text on error pages. 2015-05-13 09:41:55 +02:00