17 Sept 2015 — Learn how to use crawling and indexing directives for better SEO. Covering nofollow, noindex, and disallow directives.