Get a video review of your website by our experts & improve your enquiries, leads and sales. Yes please!

Cookies

To make this site work properly, we sometimes place small data files called cookies on your device. Find out more

OK
Share

How do I edit my robots.txt file?

Firstly, find your robots.txt file from your website. Most SEO tools give you the option to either edit or ‘block’ certain pages from your txt file. Plugins like Yoast SEO even give you the option to mass block styles and categories of pages if you wish. For more technical edits, adding the instruction “Disallow: ” followed by the folder’s path (/pagename) to the txt file will stop Google indexing it after you resubmit it.