> Portal Navigation: > > - Append `.md` to any URL under `https://dev.wix.com/docs/` to get its markdown version. > - Pages are either content pages (article or reference text) or menu pages (a list of links to child pages). > - To get a menu page, truncate any URL to a parent path and append `.md` (e.g. `https://dev.wix.com/docs/sdk.md`, `https://dev.wix.com/docs/sdk/core-modules.md`). > - Top-level index of all portals: https://dev.wix.com/docs/llms.txt > - Full concatenated docs: https://dev.wix.com/docs/llms-full.txt # UpdateRobotsTxt # Package: txtFileServer # Namespace: RobotsServiceV2 # Method link: https://dev.wix.com/docs/api-reference/business-management/marketing/seo/txt-file-server/robots-txt/update-robots-txt.md ## Permission Scopes: Manage SEO Settings: SCOPE.PROMOTE.MANAGE-SEO ## Introduction Updates the `robots.txt` file entity. The content can be set to an empty string to create a blank file. To restore Wix's default content, set the `default` field to `true` and omit the `content` field. --- ## REST API ### Schema ``` Method: updateRobotsTxt Description: Updates the `robots.txt` file entity. The content can be set to an empty string to create a blank file. To restore Wix's default content, set the `default` field to `true` and omit the `content` field. URL: https://www.wixapis.com/promote-seo-robots-server/v2/robots Method: PUT Method parameters: param name: robotsTxt | type: RobotsTxt | description: Represents a `robots.txt` file entity that controls web crawler access to a website or subdomain. It defines crawling rules and directives for search engines and other automated agents, ensuring proper indexing behavior and preventing unauthorized access to specific site areas. - name: content | type: string | description: Full text content of the `robots.txt` file. - name: default | type: boolean | description: Whether this `robots.txt` file uses Wix's [default content](https://support.wix.com/en/article/editing-your-sites-robotstxt-file). - name: subdomain | type: string | description: If applicable, target subdomain for the `robots.txt` file. For example, a site can have multiple subdomains like `www.example.com`, `es.example.com`, `fr.example.com`. Each subdomain can have its own `robots.txt` file with different rules. Default: 'www' Return type: UpdateRobotsTxtResponse - name: robotsTxt | type: RobotsTxt | description: Updated `robots.txt` file. - name: content | type: string | description: Full text content of the `robots.txt` file. - name: default | type: boolean | description: Whether this `robots.txt` file uses Wix's [default content](https://support.wix.com/en/article/editing-your-sites-robotstxt-file). - name: subdomain | type: string | description: If applicable, target subdomain for the `robots.txt` file. For example, a site can have multiple subdomains like `www.example.com`, `es.example.com`, `fr.example.com`. Each subdomain can have its own `robots.txt` file with different rules. Default: 'www' Possible Errors: HTTP Code: 428 | Status Code: FAILED_PRECONDITION | Application Code: | Description: Site GUID is missing. ``` ### Examples ### Update robots.txt ```curl curl -X PUT https://www.wixapis.com/promote-seo-txt-file-server/v2/robots \ -H 'Content-Type: application/json;charset=UTF-8' \ -H 'Authorization: ' \ -d '{ "robotsTxt": { "content": "User-agent: *\nDisallow: /internals/\nAllow: /", "default": false, "subdomain": "www" } }' ``` --- ## JavaScript SDK ### Schema ``` Method: wixClientAdmin.txtFileServer.RobotsServiceV2.updateRobotsTxt(options) Description: Updates the `robots.txt` file entity. The content can be set to an empty string to create a blank file. To restore Wix's default content, set the `default` field to `true` and omit the `content` field. Method parameters: param name: options | type: UpdateRobotsTxtOptions none - name: robotsTxt | type: RobotsTxt | description: `robots.txt` file to update. - name: content | type: string | description: Full text content of the `robots.txt` file. - name: default | type: boolean | description: Whether this `robots.txt` file uses Wix's [default content](https://support.wix.com/en/article/editing-your-sites-robotstxt-file). - name: subdomain | type: string | description: If applicable, target subdomain for the `robots.txt` file. For example, a site can have multiple subdomains like `www.example.com`, `es.example.com`, `fr.example.com`. Each subdomain can have its own `robots.txt` file with different rules. Default: 'www' Return type: PROMISE - name: robotsTxt | type: RobotsTxt | description: Updated `robots.txt` file. - name: content | type: string | description: Full text content of the `robots.txt` file. - name: default | type: boolean | description: Whether this `robots.txt` file uses Wix's [default content](https://support.wix.com/en/article/editing-your-sites-robotstxt-file). - name: subdomain | type: string | description: If applicable, target subdomain for the `robots.txt` file. For example, a site can have multiple subdomains like `www.example.com`, `es.example.com`, `fr.example.com`. Each subdomain can have its own `robots.txt` file with different rules. Default: 'www' Possible Errors: HTTP Code: 428 | Status Code: FAILED_PRECONDITION | Application Code: | Description: Site GUID is missing. ``` ### Examples ### updateRobotsTxt ```javascript import { robotsTxt } from '@wix/seo'; async function updateRobotsTxt(options) { const response = await robotsTxt.updateRobotsTxt(options); }; ``` ### updateRobotsTxt (with elevated permissions) ```javascript import { robotsTxt } from '@wix/seo'; import { auth } from '@wix/essentials'; async function myUpdateRobotsTxtMethod(options) { const elevatedUpdateRobotsTxt = auth.elevate(robotsTxt.updateRobotsTxt); const response = await elevatedUpdateRobotsTxt(options); } ``` ### updateRobotsTxt (self-hosted) Self-hosted SDK calls require you to [create a client](https://dev.wix.com/docs/sdk/articles/work-with-the-sdk/about-the-wix-client.md). ```javascript import { createClient } from '@wix/sdk'; import { robotsTxt } from '@wix/seo'; // Import the auth strategy for the relevant access type // Import the relevant host module if needed const myWixClient = createClient ({ modules: { robotsTxt }, // Include the auth strategy and host as relevant }); async function updateRobotsTxt(options) { const response = await myWixClient.robotsTxt.updateRobotsTxt(options); }; ``` ---