diff options
| author | alex <alex@pdp7.net> | 2021-03-15 12:07:27 +0000 |
|---|---|---|
| committer | alex <alex@pdp7.net> | 2021-03-15 12:07:27 +0000 |
| commit | 9a091cb2ff2b83f45aefdcf754dce14c9bc284e2 (patch) | |
| tree | df2297622df75aa22c2e198476145d20ac3dbdc4 /static/gmi/robots.txt | |
| parent | 01ab47968c0b620f8012c0d2dc969f5788c0d581 (diff) | |
Add robots.txt to prevent scraping of full Geminispace
Diffstat (limited to 'static/gmi/robots.txt')
| -rw-r--r-- | static/gmi/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/static/gmi/robots.txt b/static/gmi/robots.txt new file mode 100644 index 00000000..da2aac59 --- /dev/null +++ b/static/gmi/robots.txt @@ -0,0 +1,2 @@ +User-agent: * +Disallow: /x/ |