Commit 7bc8b517 authored by alexpott's avatar alexpott

Issue #2446657 by rpayanm: Dead link on robots.txt

parent cbcf2722
......@@ -12,9 +12,6 @@
#
# For more information about the robots.txt standard, see:
# http://www.robotstxt.org/robotstxt.html
#
# For syntax checking, see:
# http://www.frobee.com/robots-txt-check
User-agent: *
Crawl-delay: 10
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment