595a93ee2c
Update default robots.txt rules to disallow irrelevant pages that search engines should not care about. This will still allow important pages like the files, commit details, merge requests, issues, comments, etc. to be crawled. |
||
|---|---|---|
| .. | ||
| uploads | ||
| 404.html | ||
| 422.html | ||
| 500.html | ||
| 502.html | ||
| apple-touch-icon-precomposed.png | ||
| apple-touch-icon.png | ||
| deploy.html | ||
| favicon.ico | ||
| logo.svg | ||
| robots.txt | ||
| static.css | ||
