Welcome to Rise Forums

Join our fantastic community to connect with like-minded website owners, WordPress users, and online entrepreneurs.

Crawl Errors For The Wordpress Wp-includes Folder Just Appeared

Discussion in 'SEO & PPC Marketing' started by Kevin Muldoon, Jun 15, 2017.

Thread Status:
Not open for further replies.
  1. I got this email from Google the other day.

    Googlebot found an increase in server errors onhttp://www.kevinmuldoon.com/

    To: Webmaster of http://www.kevinmuldoon.com/,

    Googlebot has identified that an increased number of URLs on http://www.kevinmuldoon.com/ return a server error HTTP 5xx. As a result, users might not be able to see your content at all, and Google might not be able to index and show your pages in search results.
    Looking on Webmaster Tools, there seems to be a lot of crawl errors that have arisen over the last few days. All of them are from the WordPress wp-includes folder.


    I haven't changed my robots.txt file, so I suspect this is a change in the latest version of WordPress or in the way that Google indexes WordPress websites. Or perhaps something from Yoast SEO?

    I don't exclude the wp-includes folder in the robots.txt file. Perhaps that's something I need to do.

    Have any of you guys seen this?

  2. That is very weird. Certainly excluding will help. I've never seen it.
  3. I've added an exclusion line for the wp-includes folder to the robots.txt file. I'll see how that affects it.
  4. That is strange. I haven't seen this happen on any of my sites. But ya, excluding the wp-includes folder would be fine, and should fix your problem.
  5. No change in crawl errors yet. I'll check again in a few days and see if things have improved :)
Thread Status:
Not open for further replies.

Share This Page