summaryrefslogtreecommitdiff
path: root/priv/static/robots.txt
diff options
context:
space:
mode:
authorWilliam Pearson <uiri00@gmail.com>2019-01-20 01:44:00 +0000
committerWilliam Pearson <uiri00@gmail.com>2019-03-15 02:28:18 +0000
commit3dadaa4432b442d75b0ac0425aa05527d52f0e7a (patch)
tree84b54ea9b38a8765a3cdda450e4bf9d61a9e7c4c /priv/static/robots.txt
parent4e72762322a5616ce426df62888ee3bc7af19dc8 (diff)
downloadpleroma-3dadaa4432b442d75b0ac0425aa05527d52f0e7a.tar.gz
pleroma-3dadaa4432b442d75b0ac0425aa05527d52f0e7a.zip
robots.txt
Add default robots.txt that allows bots access to all paths. Add mix task to generate robots.txt taht allows bots access to no paths. Document custom emojis, MRF and static_dir static_dir documentation includes docs for the robots.txt Mix task.
Diffstat (limited to 'priv/static/robots.txt')
-rw-r--r--priv/static/robots.txt2
1 files changed, 2 insertions, 0 deletions
diff --git a/priv/static/robots.txt b/priv/static/robots.txt
new file mode 100644
index 000000000..25781b7d7
--- /dev/null
+++ b/priv/static/robots.txt
@@ -0,0 +1,2 @@
+User-Agent: *
+Disallow: