I found two job running so another jobs must waiting. My customer have 100MB log every 5 minutes (over 1000 users). So web gateway must push logs to web reporter every 5 minutes. To import success for 100MB logs into web reporter need 15 days . So can not create reporters... Anyone here can advise me how to make this run smooth? Thanks!
1 of 1 people found this helpful
I think something else must be going on... my general rule of thumb is 10,000 users should produce about 1GB of log data a day.
1000 users should not produce 100MB every 5 minutes...
I would advise opening an SR to investigate further to see if there is a log pushing problem. Include a feedback and a Web Reporter server.log file when you open the SR.
What versions are you running for (Web Reporter and Web Gateway)?
Hi Jon, Assume 100Mb/day so to import 100Mb into reporter need 17days (see image above). So it too long time to create reports when we need... . Thanks for advance!
Can you attach a server.log and a screenshot of Administration -> Options -> Performance -> Database Statistics
Warning: there might be sensitive data in the server.log. If you can use grep, I'm interested in seeing the lines that contain these classes.
One more useful thing, each physical appliance needs to be using a different log source. On the log sources, do you know which options are enabled for the processing tab?
Message was edited by: sroering on 8/2/11 7:55:26 AM CDT
i just make default settings. Now i reinstall and web reporter process 100Mb file on 2 minutes. Don't why before it process files with long time. Thanks!
And last question: my customers still have 100MB logs every 5 minutes on web gateway. I think logs include just text (100Mb text is too large). So could you show me how to configurate on web gateway that can reduce size logs smaller? Thanks!
can you state which log files are growing so much on your Web Gateway? Is it the access.log?
It would be interesting to understand what data you are logging for each request, maybe you are logging too much information. Can you let us know in detail what logs seem to be too large?
Can you provide us with a line of this log, so that we can see what data you are writing?