> Portal Navigation:
> 
> - Append `.md` to any URL under `https://dev.wix.com/docs/` to get its markdown version.
> - Pages are either content pages (article or reference text) or menu pages (a list of links to child pages).
> - To get a menu page, truncate any URL to a parent path and append `.md` (e.g. `https://dev.wix.com/docs/sdk.md`, `https://dev.wix.com/docs/sdk/core-modules.md`).
> - Top-level index of all portals: https://dev.wix.com/docs/llms.txt
> - Full concatenated docs: https://dev.wix.com/docs/llms-full.txt

## Resource: Introduction

## Article: Introduction

## Article Link: https://dev.wix.com/docs/api-reference/business-management/marketing/seo/txt-file-server/robots-txt/introduction.md

## Article Content:

# About the Robots Txt API

With the Robots Txt API, Wix users can define which crawlers are allowed to access and index their website content. This API allows you to control search engine visibility, while ensuring proper SEO management and content protection.

You can view the site's `robots.txt` file by adding `/robots.txt` to your root domain. For example: https://www.gardencenter.com/robots.txt.

[Learn more](https://support.wix.com/en/article/editing-your-sites-robotstxt-file) about `robots.txt` in Wix.

The Robots Txt API allows you to:

- [Retrieve](https://dev.wix.com/docs/rest/business-management/marketing/txt-file-server/robots-txt/get-robots-txt.md) an existing `robots.txt` file.
- [Update](https://dev.wix.com/docs/rest/business-management/marketing/txt-file-server/robots-txt/update-robots-txt.md) the `robots.txt` file.

## Terminology

- **robots.txt**: A simple text file placed in the root directory of a website, that provides instructions to web crawlers about which parts of the site they should access.


@sdk_package_setup