Ideally all of your hosts should have AV installed and running in real-time (workstations and servers). If you are having poor performance issues, you might have to review your configuration and then try to tune it. The following KB should help you:
Exclusions depending on the server type that you have in your environment:
Best Practices guides (for VSE 8.7 and VSE 8.8):
Hope this helps.