robots allow sitemap
This commit is contained in:
@ -14,6 +14,8 @@
|
||||
# http://www.robotstxt.org/robotstxt.html
|
||||
|
||||
User-agent: *
|
||||
# sitemap
|
||||
Allow: /sitemap.xml
|
||||
# CSS, JS, Images
|
||||
Allow: /core/*.css$
|
||||
Allow: /core/*.css?
|
Reference in New Issue
Block a user