diff options
| author | Ben Bodenmiller <bbodenmiller@hotmail.com> | 2015-08-17 23:11:16 -0700 |
|---|---|---|
| committer | Ben Bodenmiller <bbodenmiller@hotmail.com> | 2015-08-17 23:11:16 -0700 |
| commit | 595a93ee2c89be666725aa793a013179537d98b0 (patch) | |
| tree | f8b6795172c020dd2f581c286c7ac44484c3dc9f /Procfile | |
| parent | 5fad0b585eb50e86aa09b18e99c5efdc4357ba2c (diff) | |
| download | gitlab-ce-595a93ee2c89be666725aa793a013179537d98b0.tar.gz | |
disallow irrelevant pages by default in robots
Update default robots.txt rules to disallow irrelevant pages that search
engines should not care about. This will still allow important pages
like the files, commit details, merge requests, issues, comments, etc.
to be crawled.
Diffstat (limited to 'Procfile')
0 files changed, 0 insertions, 0 deletions