cancel
Showing results for 
Search instead for 
Did you mean: 
ittech
Level 13

Internal Database not connecting

We had a power issue a couple of weeks ago where are power went out, the generator was off due to repairs and our UPS ran out of juice (oh noes!)

Apparently, ever since then our Web Reporter hasn't been able to connect to the database and I'm not sure where to look for a log or what log to look in to help fix this.

Capture.PNG

Capture1.PNG

0 Kudos
12 Replies
sroering
Level 13

Re: Internal Database not connecting

0 Kudos
ittech
Level 13

Re: Internal Database not connecting

I dont think so. I couldn't find a reference to .myi in the server or server_err logs.

Unfortunately, it doesn't look like I can attach the logs :/

0 Kudos
sroering
Level 13

Re: Internal Database not connecting

You may also see the crashed table messages in .../reporter/mysql/temp/errors.log

This may sound like a dumb question, but is the Internal DB service started?  Netstat -na should show tcp port 9129 on the loopback interface.

0 Kudos
ittech
Level 13

Re: Internal Database not connecting

That one just keeps repeating this:

101118 11:38:41  InnoDB: Started; log sequence number 0 43655

101118 11:38:41 [Note] .\libexec\mysqld: ready for connections.

Version: '5.0.66a-enterprise-nt'  socket: ''  port: 9129  MySQL Enterprise Server (Commercial)

101214 23:33:40  InnoDB: Started; log sequence number 0 43655

101214 23:33:41 [Note] .\libexec\mysqld: ready for connections.

Version: '5.0.66a-enterprise-nt'  socket: ''  port: 9129  MySQL Enterprise Server (Commercial)

0 Kudos
ittech
Level 13

Re: Internal Database not connecting

I see these repeat in the server.log

2013-08-01 00:00:02,300 INFO [securecomputing.smartfilter.logparsing.LogParsing] StartJob - enter,file=C:\Program Files\McAfee\WebReporter\reporter\jboss\bin\..\..\tmp\logparsing\processing\mwg-core.errors1308010000.log20130801-000002253.dat

2013-08-01 00:00:07,846 ERROR[securecomputing.smartfilter.server.project.reportdbbuilder.tasks.DatabaseMaintenanceTask]Reporting database is not available.

2013-08-01 07:00:13,331 ERROR[securecomputing.smartfilter.reportengine.advanced.output.processing.QueryGenerator]setErrorMessage=reporting database is currently not available,state=OFFLINE_SYSTEM_FORCED

sql: null

java.sql.SQLException: reporting database is currently notavailable, state=OFFLINE_SYSTEM_FORCED

                atsecurecomputing.smartfilter.reportengine.advanced.output.processing.QueryGenerator.createConnection(QueryGenerator.java:980)

                atsecurecomputing.smartfilter.reportengine.advanced.output.processing.QueryGenerator.openQueryStream(QueryGenerator.java:697)

                atsecurecomputing.smartfilter.reportengine.advanced.output.processing.QueryProcessor.processQuery(QueryProcessor.java:362)

                atsecurecomputing.smartfilter.reportengine.advanced.output.renderers.BaseReportRenderer.processQuery(BaseReportRenderer.java:599)

                atsecurecomputing.smartfilter.reportengine.advanced.output.renderers.BaseReportRenderer.runOneReport(BaseReportRenderer.java:315)

                atsecurecomputing.smartfilter.reportengine.advanced.output.renderers.BaseReportRenderer.generateReport(BaseReportRenderer.java:152)

                atsecurecomputing.smartfilter.reportengine.advanced.output.processing.ReportRunner.render(ReportRunner.java:195)

                atsecurecomputing.smartfilter.reportengine.advanced.output.processing.ReportRunner.runIt(ReportRunner.java:103)

                atsecurecomputing.smartfilter.server.util.report.ReportUtil.runAdvReport(ReportUtil.java:79)

                atsecurecomputing.smartfilter.server.project.services.runReport.RunReportTask.runReport(RunReportTask.java:669)

                atsecurecomputing.smartfilter.server.project.services.runReport.RunReportTask.runit(RunReportTask.java:293)

                atsecurecomputing.smartfilter.server.project.ScheduledTask.run(ScheduledTask.java:67)

                atjava.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)

                atjava.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)

                atjava.lang.Thread.run(Thread.java:619)

0 Kudos
sroering
Level 13

Re: Internal Database not connecting

So the errors log is good if you only see service restarts.

Regarding the server log error, I'm not sure.  There might be something wrong.  have you tried restarting the service to see if it clears?  Make sure it shuts down completely before you start it. Web Reporter is the java.exe running under the SYSTEM account.  Kill it if it doesn't stop on its own.

Otherwise open a support ticket and send us a feedback.

0 Kudos
ittech
Level 13

Re: Internal Database not connecting

Sorry for the delay. Have tried everything (even repairing the internal databases) so far and no luck. This particular server is in the process of being decommisioned and we were about to move the Web Reporter anyways. So I guess we'll just start our logs over, no big deal.

Would going with an SQL database on a seperae server be more stable than the internal database?

0 Kudos
sroering
Level 13

Re: Internal Database not connecting

I wouldn't say that Microsoft SQL server is more "stable" since MySQL (including the internal DB) is stable.  Tables only "crash" as a result of catastrophic failure such as running out of disk space or power failure, etc.  But the advantages of SQL Server is better scalability for large deployments if you have an enterprise license, and much more efficient disk space usage. The drawback is clearly cost.

0 Kudos
ittech
Level 13

Re: Internal Database not connecting

Okay, so I've set up my new Web Reporter on a new server and a couple of things are different. Also, I've upgraded from 5.2.0.1 to 5.2.1.1

1) The logs from the MWG7 fail due to the parser (if I'm reading this correctly). I had it set on "McAfee Web Gateway (Webwasher) - AutoDiscover" and got the error below.

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.reportdbbuilder.process.LogLineProcessor] implementBuffering = false

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.reportdbbuilder.process.LogLineProcessor] condenseToPageViews = true

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.process.LogParsingJob] timeZoneId=America/New_York

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.LogAudit] (LogAudit[1005]) Begin processing file 'update1308150922.log20130815-092202129.dat'.

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.LogAudit] (LogAudit[1005]) Finish counting: [0 seconds to complete]  File='C:\Program Files\McAfee\Web Reporter (64-bit)\reporter\jboss\bin\..\..\tmp\logparsing\processing\update1308150922.log20130815-092202129.dat' contains 152 lines and 13262 bytes.

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.process.LogParsingJob] Parse is a ParserInitFromFile.  Initializing.

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.process.LogParsingJob] Using charEncoding: UTF-8

2013-08-15 09:22:02,176 INFO  [securecomputing.smartfilter.logparsing.parsers.builtins.ParseWebWasher] using charEncoding=UTF-8

2013-08-15 09:22:02,192 WARN  [securecomputing.smartfilter.logparsing.parsers.builtins.ParseWebWasher] no more header lines found

2013-08-15 09:22:02,192 ERROR [securecomputing.smartfilter.logparsing.parsers.builtins.ParseWebWasher] Log file invalid:'update1308150922.log20130815-092202129.dat'. See server.log for details.

2013-08-15 09:22:02,192 ERROR [securecomputing.smartfilter.logparsing.LogAudit] (LogAudit[1005]) Invalid parser, parser initialization failed, id='WebWasherV1'

2013-08-15 09:22:02,192 ERROR [securecomputing.smartfilter.logparsing.LogAudit] (LogAudit[1005]) update1308150922.log20130815-092202129.dat: processing failed:Unable to determine log format due to invalid parser ID.

2013-08-15 09:22:02,192 INFO  [securecomputing.smartfilter.server.facade.impl.reporter.LogSourceStatusImpl] Adding Data Log Source Status: DataLogSourceStatus [logFileName='update1308150922.log20130815-092202129.dat' logFileSize='13262' logFileSizeCompressed='13262' bytesProcessed='0' logSourceName='mwgappl' state='failed' submitTime='Thu Aug 15 09:22:02 EDT 2013' (08-15-2013 09:22 AM) totalLogRecords='152' logRecordsProcessed='0' logRecordsIgnored='0' logErrors='0' elapsedTimeMilliSecs='1' logRecordsPerSecond='152000.0' bytesPerSecond='1.3262E7']

2013-08-15 09:22:02,192 INFO  [securecomputing.smartfilter.server.ejb3.handler.reporter.LogSourceStatusHandler] creating dataLogSourceStatus=DataLogSourceStatus [logFileName='update1308150922.log20130815-092202129.dat' logFileSize='13262' logFileSizeCompressed='13262' bytesProcessed='0' logSourceName='mwgappl' state='failed' submitTime='Thu Aug 15 09:22:02 EDT 2013' (08-15-2013 09:22 AM) totalLogRecords='152' logRecordsProcessed='0' logRecordsIgnored='0' logErrors='0' elapsedTimeMilliSecs='1' logRecordsPerSecond='152000.0' bytesPerSecond='1.3262E7']

2013-08-15 09:22:02,208 INFO  [securecomputing.smartfilter.logparsing.LogAudit] (LogAudit[1005]) Aborted processing file 'update1308150922.log20130815-092202129.dat': 0 lines processed with 0 errors.

2013-08-15 09:22:02,208 INFO  [securecomputing.smartfilter.common.core.util.scheduler.SchedulerAudit] finished securecomputing.smartfilter.logparsing.process.LogParsingJob@38382b26

2013-08-15 09:22:02,208 INFO  [securecomputing.smartfilter.common.core.util.scheduler.SchedulerThreadPool] After execute: securecomputing.smartfilter.logparsing.process.LogParsingJob@38382b26

pool: LogParsing

  thread: null r: securecomputing.smartfilter.logparsing.process.LogParsingJob@38382b26

    queued: 0

    active: 1

    completed: 5

    taskcount: 6

2) I cannot reach the Web Reporter from another PC (it works fine on the installed server). All firewalls are disabled. I can still reach the old Web Reporter fine, but I suspect this is a Java issue. I get to the webpage and Java loads, after that I get a blank grey screen.

0 Kudos