Robots.txt Blog Archives

[michaelm73]

Hi guys,

Please can you tell me if it's possible to include blog archive pages as disallows into robot.txt so they aren't indexed by Google? Currently they are showing up as errors in a variety of testing tools for duplicate titles and the like. If my understanding is right (and it may well not be) the individual blog post links should suffice and not effect SEO?

[Bernadette3]

Thanks for reaching out. I'm not entirely sure on this question, but @Adam or @whitemonkey may be able to provide some insight for you.

[whitemonkey]

Hi @michaelm73 @Bernadette 

I removed my categories to get rid of the google error messages...   i dt believe it effects the seo.    As its the post/page content that google is looking at

[michaelm73]

Hi @whitemonkey to the best of my knowledge I don't have any categories. I will delete the Archives side bar widget and see if that does anything to help