mod_security and block google bot

Portal Home > Knowledgebase > Articles Database > mod_security and block google bot

Posted by ttgt, 11-28-2013, 09:58 AM
Hi, i use mod_security with atomicorp rules,and with the following setting on my whm/cpanel, but my user tell me google notify him google bot can not search his site, how can i modify my rules to let the searching work well ? thanx SecRequestBodyAccess On SecAuditLogType Concurrent SecResponseBodyAccess On SecResponseBodyMimeType (null) text/html text/plain text/xml SecResponseBodyLimit 2621440 SecAuditLogRelevantStatus "^(?:5|4(?!04))" SecServerSignature Apache SecUploadDir /var/asl/data/suspicious SecUploadKeepFiles Off SecAuditLogParts ABIFHZ SecArgumentSeparator "&" SecCookieFormat 0 SecRequestBodyInMemoryLimit 131072 SecDataDir /var/asl/data/msa SecTmpDir /tmp SecAuditLogStorageDir /var/asl/data/audit SecResponseBodyLimitAction ProcessPartial Include /usr/local/apache/conf/modsec_rules/10_asl_antimalware.conf Include /usr/local/apache/conf/modsec_rules/10_asl_rules.conf Include /usr/local/apache/conf/modsec_rules/20_asl_useragents.conf Include /usr/local/apache/conf/modsec_rules/30_asl_antispam.conf Include /usr/local/apache/conf/modsec_rules/50_asl_rootkits.conf Include /usr/local/apache/conf/modsec_rules/60_asl_recons.conf Include /usr/local/apache/conf/modsec_rules/99_asl_jitp.conf Include /usr/local/apache/conf/modsec2.whitelist.conf
Posted by raffo, 11-28-2013, 08:27 PM
try to comment: #Include /usr/local/apache/conf/modsec_rules/20_asl_useragents.conf or to find in this files the rules that block google bot user agent. maybe is missing some external software.. for example geoip? there are some rules, for example, that block http request that use google bot user agent if provide by a non-google ip.
Posted by ttgt, 11-28-2013, 08:37 PM
but it seems some rules about other attack at the file /usr/local/apache/conf/modsec_rules/20_asl_useragents.conf
Posted by raffo, 11-28-2013, 08:58 PM
try to disable it and restart apache

Add to Favourites Print this Article