This web part renders different robots.txt content based on the current domain.
Handy when you have a content pipeline and are using content staging. In such a scenario you need to be able to conditionally render different Robots.txt content to appropriately handle crawlers should non-production builds in the content pipeline be publicly accessible.
Installation instructions are included in the download package. Unzip package.zip and follow the instructions in the PDF.