Dosiye y'umwimerere ikora
before/robots.txt
Kode n'impapuro z'ingero zikora bigumana amazina n'inyandiko by'umwimerere. Isomo n'amabwiriza ya dosiye birabisobanura mu rurimi rwawe.
# Urugero rwa mbere: iri tegeko ribuza crawling ku nzira zose.
User-agent: *
Disallow: /