From 3dadaa4432b442d75b0ac0425aa05527d52f0e7a Mon Sep 17 00:00:00 2001
From: William Pearson <uiri00@gmail.com>
Date: Sun, 20 Jan 2019 01:44:00 +0000
Subject: robots.txt

Add default robots.txt that allows bots access to all paths.
Add mix task to generate robots.txt taht allows bots access to no paths.
Document custom emojis, MRF and static_dir
static_dir documentation includes docs for the robots.txt Mix task.
---
 priv/static/robots.txt | 2 ++
 1 file changed, 2 insertions(+)
 create mode 100644 priv/static/robots.txt

(limited to 'priv/static')

diff --git a/priv/static/robots.txt b/priv/static/robots.txt
new file mode 100644
index 000000000..25781b7d7
--- /dev/null
+++ b/priv/static/robots.txt
@@ -0,0 +1,2 @@
+User-Agent: *
+Disallow: 
-- 
cgit v1.2.3