Showing results for 
Show  only  | Search instead for 
Did you mean: 
Former Member
Not applicable
Report Inappropriate Content
Message 1 of 2

Import Large Watchlist

I am trying to import and regularly update a large watchlist into the SIEM. The watchlist is ~242k domains. 

I have tried using the SIEM API for this however, SIEM only allows for the addition of ~2K values at a time (WHY!??)   so this is not realistic. 

My next attempt was to setup a NFS share that the SIEM could pull from, but this just causes the SIEM to choke and freeze up. 

Does anyone know of a good way to create a dynamic watchlist that can handle this many values?

1 Reply
Reliable Contributor
Reliable Contributor
Report Inappropriate Content
Message 2 of 2

Re: Import Large Watchlist

For large watchlists I have always done an import using a Cyberthreat feed (TAXII), this is also one of the only ways to do back tracing. I am surprised your ESM had problems with the NFS import, it's always worked sufficiently fine for me.

Do you have a lot of operations on your SIEM?

Could you run `iostat -dhxm 10` and wait about 1 minute then CTRL-C and paste or message me the results?

You Deserve an Award
Don't forget, when your helpful posts earn a kudos or get accepted as a solution you can unlock perks and badges. Those aren't the only badges, either. How many can you collect? Click here to learn more.

Community Help Hub

    New to the forums or need help finding your way around the forums? There's a whole hub of community resources to help you.

  • Find Forum FAQs
  • Learn How to Earn Badges
  • Ask for Help
Go to Community Help

Join the Community

    Thousands of customers use the McAfee Community for peer-to-peer and expert product support. Enjoy these benefits with a free membership:

  • Get helpful solutions from McAfee experts.
  • Stay connected to product conversations that matter to you.
  • Participate in product groups led by McAfee employees.
Join the Community
Join the Community