In what regard do you speak? Are you asking for a reverse proxy environment for which MWG is protecting your website?
If so, then I would say not, but all that may entail is building a list of user-agents that are associated with "web-crawling".
Alternativley you could log all requests that do not match the standard browser user-agent Mozilla*.
There would be no protection for web crawlers? Would this feature be added to the future release of MWG?. What does Search/Indexing Engine Spiders and Crawlers in the link below, is it for internal users going to the web spider sites?
Also can McAfee be a web application firewall? Can it protect web servers from SQL Injection, XSS and CSRF?. If not what are the difference of a WAF with MWG?Message was edited by: ralzaga on 1/23/13 4:56:58 AM CST