No changes between revisions
| /gestion/robots.txt |
|---|
| 0,0 → 1,19 |
|---|
| # exclude help system from robots |
| User-agent: * |
| Disallow: /manual/ |
| Disallow: /manual-1.3/ |
| Disallow: /manual-2.0/ |
| Disallow: /manual-2.2/ |
| Disallow: /addon-modules/ |
| Disallow: /doc/ |
| Disallow: /images/ |
| # the next line is a spam bot trap, for grepping the logs. you should _really_ change this to something else... |
| Disallow: /all_our_e-mail_addresses |
| # same idea here... |
| Disallow: /admin/ |
| # but allow htdig to index our doc-tree |
| #User-agent: htdig |
| #Disallow: |
| # disallow stress test |
| user-agent: stress-agent |
| Disallow: / |
| Property changes: |
|---|
| Added: svn:eol-style |
|---|
| +native |
|---|
| \ No newline at end of property |
|---|