diff options
| author | Kornel <kornel@geekhood.net> | 2019-07-28 23:24:35 +0100 |
|---|---|---|
| committer | Kornel <kornel@geekhood.net> | 2019-07-28 23:24:35 +0100 |
| commit | e5cba0dd034364f30839111780b8c164d4e204ac (patch) | |
| tree | e62e8d01fdbcc01075fe7743b04737ddd723b692 /front_end/public | |
| parent | 452296a544f55c36136b7aeb7eb9e926f3bc8258 (diff) | |
Goaway
Diffstat (limited to 'front_end/public')
| -rw-r--r-- | front_end/public/robots.txt | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/front_end/public/robots.txt b/front_end/public/robots.txt index eba7322..e18be8b 100644 --- a/front_end/public/robots.txt +++ b/front_end/public/robots.txt @@ -1,3 +1,6 @@ User-Agent: * Disallow: /keywords/ Disallow: /search? + +User-agent: SemrushBot +Disallow: / |