projects
/
mspang
/
www.git
/ commitdiff
commit
grep
author
committer
pickaxe
?
search:
re
summary
|
shortlog
|
log
|
commit
| commitdiff |
tree
raw
|
patch
| inline |
side by side
(parent:
6cb2897
)
Add a robots.txt to prevent people from spidering, the now 403 Forbidden,
author
Simon Law
<sfllaw@csclub.uwaterloo.ca>
Fri, 1 Oct 2004 14:53:43 +0000
(14:53 +0000)
committer
Simon Law
<sfllaw@csclub.uwaterloo.ca>
Fri, 1 Oct 2004 14:53:43 +0000
(14:53 +0000)
stats directory.
robots.txt
[new file with mode: 0755]
patch
|
blob
diff --git a/robots.txt
b/robots.txt
new file mode 100755
(executable)
index 0000000..
65362e9
--- /dev/null
+++ b/
robots.txt
@@ -0,0
+1,2
@@
+User-agent: *
+Disallow: /stats/ # Webalizer logs