|
Other attributes include noarchive, noimageindex, and nosnippet. However, these are more advanced values, so we are not going to discuss them in this article. best practice Use meta robots tags only if you want to limit how Google crawls your pages . Do not block pages with meta robots tags in robots.txt . Also read : Robot meta tags and X-Robots-Tag: everything you need to know How to add meta robots tags to pages Paste the appropriate code above into the <head> section of your page. In WordPress, use Yoast advanced settings to configure the meta robots tag:
Most CMSs have similar options built in. How to diagnose and fix common meta robots mistakes There are three common Bolivia Email List mistakes with meta robots: Noindexed pages blocked by robots.txt. This will prevent Google from seeing the noindex robots tag and potentially indexing that URL. Bad meta noindex. It prevents Google from indexing the page, so you can't get organic traffic from it. Invalid meta nofollow. This prevents Google from crawling the links on your page, which can prevent important content from being discovered and indexed. It also prevents PageRank from flowing into that page , which may be undesirable. The first two issues can be seen in Google Search Console's coverage report. To find indexed pages that may be set to meta robots noindex, click the Valid with warnings tab and look for the Indexed, though blocked by robots.txt warning: Remove the robots

meta tag from pages that should be indexed. To find pages with invalid meta robots nofollow tags, crawl your site with Ahrefs' Site Audit and check your Indexability report for "Nofollow page" warnings. Especially if you don't want search engines to crawl the links on your page, remove this tag. Note: There are some other issues not covered in this article, such as having pages with noindex tags in your sitemap . For those questions, check out the Indexability report in Ahrefs' Site Audit . Meta viewport The meta viewport tag sets the display area of a web page. Used to tell the browser how to display the page on different screen sizes, such as desktop/tablet/mobile. Why is it important as an SEO measure? Google states that “the presence of this tag indicates to Google that the page is mobile-friendly . ” This is important because as of 2015 , Google ranks mobile-friendly web pages higher in mobile search results.
|
|