About the Robots Txt API

With the Robots Txt API, Wix users can define which crawlers are allowed to access and index their website content. This API allows you to control search engine visibility, while ensuring proper SEO management and content protection.

You can view the site's robots.txt file by adding /robots.txt to your root domain. For example: https://www.gardencenter.com/robots.txt.

Learn more about robots.txt in Wix.

The Robots Txt API allows you to:

• Retrieve an existing robots.txt file.
• Update the robots.txt file.

Terminology

• robots.txt: A simple text file placed in the root directory of a website, that provides instructions to web crawlers about which parts of the site they should access.