robots.txt « public « front_end - crates.rs - Contrib clone of crates.rs

summary refs log tree commit diff stats

path: root/front_end/public/robots.txt

blob: e18be8b88a17845cd554582f6c506b0959573cbe (plain)

User-Agent: *
Disallow: /keywords/
Disallow: /search?

User-agent: SemrushBot
Disallow: /