diff --git a/source/docs/theme-settings/seo.md b/source/docs/theme-settings/seo.md index ba10794a..0d912be2 100644 --- a/source/docs/theme-settings/seo.md +++ b/source/docs/theme-settings/seo.md @@ -12,6 +12,27 @@ By default a canonical link tag is created in Hexo after you have set up your UR {% endnote %} {% tabs SEO %} + +[Robots meta directives](https://moz.com/learn/seo/robots-meta-directives) (sometimes called "meta tags") are pieces of code that provide crawlers instructions for how to crawl or index web page content. You can tell the search engines to don't index the page by setting the value `noindex` to `true` in [Front-matter](./custom-pages.html#adding-custom-page-2). +You can also specify a certain value of robots directive by setting the `robots` in Front-matter. `noindex: true` is equivalent to `robots: noindex`. + +Simple usage case: +```md +title: custom_name +date: 2014-12-22 12:39:04 +noindex: true +--- +``` + +Advanced usage case: +```md +title: custom_name +date: 2014-12-22 12:39:04 +robots: noimageindex, nofollow, nosnippet +--- +``` + + By default China's search engine Baidu will cache and rewrite your site to provide a webpage snapshot for mobile users. You can disable this by setting the value `disable_baidu_transformation` to `true` in {% label primary@theme config file %}.