ByteEditor Site Builder

Configure robots.txt

You can configure your robots.txt file to set URLs that search engine crawlers can access on your site.

Step 1

In the Content Menu, click on robots.txt.

Rob1

Step 2

Enter your crawling rules in the indexing guidelines window.

Note: The crawling rules you set will be updated in your sitemap.xml file

Rob2

Step 3

Add your sitemap.xml file.

Rob3

Step 4

Save your changes.

Rob4