With the Robots Txt API, Wix users can define which crawlers are allowed to access and index their website content. This API allows you to control search engine visibility, while ensuring proper SEO management and content protection.
You can view the site's robots.txt
file by adding /robots.txt
to your root domain. For example: https://www.gardencenter.com/robots.txt.
Learn more about robots.txt
in Wix.
The Robots Txt API allows you to: