Googlebot spiders some of controllers?

• reformatco

• September 16, 2013 at 7:22 pm

Not sure why but some of the controller files are being spidered by Googlebot

/var/log/apache2/domain.log:66.249.74.139 - - [14/Sep/2013:12:21:32 +0100] "GET /wp-content/plugins/advanced-custom-fields/core/controllers/everything_fields.php HTTP/1.1" 500 273 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
/var/log/apache2/domain.log:66.249.74.139 - - [14/Sep/2013:12:21:43 +0100] "GET /wp-content/plugins/advanced-custom-fields/core/controllers/field_group.php HTTP/1.1" 500 273 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
/var/log/apache2/domain.log:66.249.74.139 - - [14/Sep/2013:12:21:56 +0100] "GET /wp-content/plugins/advanced-custom-fields/core/controllers/third_party.php HTTP/1.1" 500 273 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
/var/log/apache2/domain.log:66.249.74.139 - - [14/Sep/2013:12:22:11 +0100] "GET /wp-content/plugins/advanced-custom-fields/core/controllers/location.php HTTP/1.1" 500 273 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"
/var/log/apache2/domain.log:66.249.74.139 - - [14/Sep/2013:12:23:08 +0100] "GET /wp-content/plugins/advanced-custom-fields/core/controllers/export.php HTTP/1.1" 500 273 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

No whitespace on the files, not sure why Googlebot is trying to spider them?

• Elliot

• September 17, 2013 at 12:17 pm

Hi @roflman79

Thanks for the info. I’ll look into this.

Cheers
E