cancel
Showing results for 
Search instead for 
Did you mean: 
ralzaga
Level 7

Web Crawlers

Hi,

   Does McAfee Webgateway have a feature of anti-webcrawlers?.

0 Kudos
2 Replies
McAfee Employee

Re: Web Crawlers

Hi ralzaga,

In what regard do you speak? Are you asking for a reverse proxy environment for which MWG is protecting your website?

If so, then I would say not, but all that may entail is building a list of user-agents that are associated with "web-crawling".

Alternativley you could log all requests that do not match the standard browser user-agent Mozilla*.

Best,

Jon

0 Kudos
ralzaga
Level 7

Re: Web Crawlers

Hi Jon,

          There would be no protection for web crawlers? Would this feature be added to the future release of MWG?. What does Search/Indexing Engine Spiders and Crawlers in the link below, is it for internal users going to the web spider sites?

http://www.mcafee.com/us/products/email-and-web-security/web-application-control.aspx

Also can McAfee be a web application firewall? Can it protect web servers from SQL Injection, XSS and CSRF?. If not what are the difference of a WAF with MWG?

Message was edited by: ralzaga on 1/23/13 4:56:58 AM CST
0 Kudos