Q.How do I control which pages I want indexed by search engines?
To specify which pages should or should not be indexed by search engines, you can use metatags. Navigate to Marketing → SEO (Global) to configure search engine crawler behavior.
In the Header field, enter your robots metatags. These should take the following form:
<meta name="robots" content="noindex, nofollow">
By default, search engine crawlers will index pages on your website, and will follow links to other pages. The
noindex value prevents robots from indexing the current page, and the
nofollow value prevents robots from following links. If you wish to disable one behavior or the other, you can enter
index, nofollow or
noindex, follow here. More information about robots metatags can be viewed at this page.
Please be aware that robots metatags are simply a request, and do not prevent all robots (particularly malicious ones) from indexing your website. Additionally, links from other pages can cause pages on your website to be indexed on major search engines even when these metatags are applied.