update core to 7.36
This commit is contained in:
@@ -11,10 +11,7 @@
|
||||
# Ignored: http://example.com/site/robots.txt
|
||||
#
|
||||
# For more information about the robots.txt standard, see:
|
||||
# http://www.robotstxt.org/wc/robots.html
|
||||
#
|
||||
# For syntax checking, see:
|
||||
# http://www.sxw.org.uk/computing/robots/check.html
|
||||
# http://www.robotstxt.org/robotstxt.html
|
||||
|
||||
User-agent: *
|
||||
Crawl-delay: 10
|
||||
|
||||
Reference in New Issue
Block a user