Add robots.txt for web robots
Allow all robots to access any part of the site. This may change in the future, as the html snippets that are generated for the posts and pages should not be directly indexed. See: http://www.robotstxt.org/robotstxt.html Signed-off-by: Collin J. Doering <collin.doering@rekahsoft.ca>
This commit is contained in:
vecāks
b41c58246f
revīzija
92acb5344e
|
@ -0,0 +1,2 @@
|
|||
User-agent: *
|
||||
Allow: /
|
|
@ -105,7 +105,7 @@ main = do
|
|||
|
||||
hakyllWith myConfig $ do
|
||||
-- All Versions ------------------------------------------------------------------------------------------
|
||||
match ("action/**" .||. "files/**" .||. "images/**" .||. "fonts/**") $ do
|
||||
match ("action/**" .||. "files/**" .||. "images/**" .||. "fonts/**" .||. "robots.txt") $ do
|
||||
route idRoute
|
||||
compile copyFileCompiler
|
||||
|
||||
|
|
Notiek ielāde…
Atsaukties uz šo jaunā problēmā