English: Robots.txt

Definition

This is a permissions file, located in the root directory that controls which web pages can be harvested or indexed by a search engine.