{"id":171863,"date":"2026-06-10T17:26:24","date_gmt":"2026-06-10T17:26:24","guid":{"rendered":"https:\/\/digitionary.com\/dictionnaire\/x-robots-tag\/"},"modified":"2026-06-10T19:26:26","modified_gmt":"2026-06-10T19:26:26","slug":"x-robots-tag","status":"publish","type":"dictionnaire-dico","link":"https:\/\/digitionary.com\/en\/dictionnaire\/x-robots-tag\/","title":{"rendered":"X-robots-tag"},"content":{"rendered":"\nThe X-robots-tag is an HTTP-level instruction that tells search engine crawlers how to handle the indexing of non-HTML files, such as images and PDFs. Key directives in the X-robots-tag include:\n\n&#8211; noindex: This directive tells search engines not to index the page, making it invisible in search results. It is particularly useful for sensitive pages such as login pages or any content you want to keep private.\n\n&#8211; nofollow: Using this directive, you tell search engines not to follow links on the page, thus preserving &#8220;link juice.&#8221;\n\n&#8211; noarchive: By preventing search engines from caching the page, this directive ensures that archived versions of the page will not be accessible.\n\n&#8211; nosnippet: This instruction blocks the display of a snippet of the page in search results, thus preventing the creation of snippets.\n\n&#8211; max-snippet:[number]: By specifying a character limit, this directive controls the maximum length of the page snippet displayed in search results.\n\n&#8211; unavailable_after:[date]: By setting a specific date, this directive instructs search engines to stop indexing the page after that date, which can be useful for seasonal or outdated content.\n\nTo implement the X-Robots-Tag on an Apache web server, it is recommended to add a directive to the site&#8217;s .htaccess or httpd.config file, such as:\n\n<Files ~ \".pdf$\">\nHeader set X-Robots-Tag &#8220;noindex, follow&#8221;\n\n<\/Files>\n\nOn an Nginx server, simply add the following code to the site&#8217;s .conf file:\n\nlocation ~* .pdf$ {\nadd_header X-Robots-Tag &#8220;noindex, follow&#8221;;\n\n\n\nIt is essential to use X-robots-tag directives judiciously. Their correct application should be verified using\n","protected":false},"template":"","categories-glossary":[336],"class_list":["post-171863","dictionnaire-dico","type-dictionnaire-dico","status-publish","hentry","categories-glossary-seo-natural-referencing"],"_links":{"self":[{"href":"https:\/\/digitionary.com\/en\/wp-json\/wp\/v2\/dictionnaire-dico\/171863","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/digitionary.com\/en\/wp-json\/wp\/v2\/dictionnaire-dico"}],"about":[{"href":"https:\/\/digitionary.com\/en\/wp-json\/wp\/v2\/types\/dictionnaire-dico"}],"wp:attachment":[{"href":"https:\/\/digitionary.com\/en\/wp-json\/wp\/v2\/media?parent=171863"}],"wp:term":[{"taxonomy":"categories-glossary","embeddable":true,"href":"https:\/\/digitionary.com\/en\/wp-json\/wp\/v2\/categories-glossary?post=171863"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}