瀏覽代碼

Added Some constraints to robots file

Yoginth 7 年之前
父節點
當前提交
7f6dbf3926
共有 1 個文件被更改,包括 6 次插入1 次删除
  1. 6 1
      public/robots.txt

+ 6 - 1
public/robots.txt

@@ -8,14 +8,19 @@ Disallow: /admin
 Disallow: /*/*/forks
 Disallow: /*/*/stars
 Disallow: /*/*/pulls
-Disallow: /*/*/archive/
+Disallow: /*/*/archive
+Disallow: /*/*/settings
 Disallow: /*/*/raw/*
+Disallow: /*/*/wiki/_new
+Disallow: /*/*/wiki/*/_edit
 Disallow: /*/*/commits
 Disallow: /*/followers
 Disallow: /*/following
 Disallow: /*/*/src/*
+Disallow: /*/*/_edit
 Disallow: /*/*/issues/new
 Disallow: /*/*/issues?
+Disallow: /*/*/compare
 Disallow: /*?
 
 Sitemap: https://gitote.in/sitemap.xml