diff options
author | William Pearson <uiri00@gmail.com> | 2019-01-20 01:44:00 +0000 |
---|---|---|
committer | William Pearson <uiri00@gmail.com> | 2019-03-15 02:28:18 +0000 |
commit | 3dadaa4432b442d75b0ac0425aa05527d52f0e7a (patch) | |
tree | 84b54ea9b38a8765a3cdda450e4bf9d61a9e7c4c /priv/static/robots.txt | |
parent | 4e72762322a5616ce426df62888ee3bc7af19dc8 (diff) | |
download | pleroma-3dadaa4432b442d75b0ac0425aa05527d52f0e7a.tar.gz pleroma-3dadaa4432b442d75b0ac0425aa05527d52f0e7a.zip |
robots.txt
Add default robots.txt that allows bots access to all paths.
Add mix task to generate robots.txt taht allows bots access to no paths.
Document custom emojis, MRF and static_dir
static_dir documentation includes docs for the robots.txt Mix task.
Diffstat (limited to 'priv/static/robots.txt')
-rw-r--r-- | priv/static/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/priv/static/robots.txt b/priv/static/robots.txt new file mode 100644 index 000000000..25781b7d7 --- /dev/null +++ b/priv/static/robots.txt @@ -0,0 +1,2 @@ +User-Agent: * +Disallow: |