1
0
Эх сурвалжийг харах

For server-load and privacy reasons, disallow robots.

Greg Knaddison 14 жил өмнө
parent
commit
f37303d858
1 өөрчлөгдсөн 3 нэмэгдсэн , 0 устгасан
  1. 3 0
      robots.txt

+ 3 - 0
robots.txt

@@ -0,0 +1,3 @@
+# Might as well keep robots away for performance and privacy reasons.
+User-agent: *
+Disallow: /