Sign up to The Evergreen Way and receive SEO insights, PPC ideas, Digital PR tips & Agency updates


To make this site work properly, we sometimes place small data files called cookies on your device. Find out more


How do you stop crawlers?

Using your robots.txt file you can stop search engines like Google from crawling certain pages or the entire site. To stop Google crawling your website altogether set your root domain to be disallowed. In many websites, especially sites like WordPress you can use SEO tools like Yoast to block search engines if your site is temporarily under construction.

Sign up to our newsletter