4 Replies Latest reply on Oct 15, 2009 12:12 PM by MagnumVP

    Failed to Replicate Sitestat.xml

      I have 5 SuperAgents in 6 locations. 3 are working as expected but two do not copy because of the following error;

      Failed to upload file SiteStat.xml to site AVSRV1:8081, error code 5 ( Access is denied. )

      I enabled Logging Level 8 and also received "HTTP/1.0 500 Internal Server Error"

      I have uninstalled everything from the server, cleaned the registry, removed McAfee from the Application Data and verified that McAfee was also removed from Program Fies, then rebooted. Reinstalled the agent and attempted to perform the replication.

      Here is the log of the failure.

      20091013093016 I #1620 naInet HTTP Session initialized
      20091013093016 I #1620 naInet Connecting to HTTP Server in socket-mode
      20091013093016 I #1620 naInet Connecting to Real Server: AVSRV1 on port: 8081
      20091013093016 X #1620 naInet Socket created, Handle 4704
      20091013093016 I #1620 naInet Connected to Real Server: AVSRV1 on port: 8081. No Proxy used!
      20091013093016 X #1620 naInet Socket getting closed, Handle 4704
      20091013093016 X #1620 usermgr Attempting to add user: FRESNO-PDC\Administrator
      20091013093016 X #1620 usermgr Current user: SYSTEM
      20091013093016 X #1620 DAL DAL2_CConnection::GetConnection: Available = 0
      20091013093016 X #1620 DAL Executing: SELECT TOP 1 AutoID,ParentID,TheTimestamp,PolicyTimestamp,TaskTimestamp,Type,ServerKeyHash FROM EPOLeafNode WHERE (AgentGUID=N'8DCEF089-D025-4D6C-8D1F-445BD9B5BD1F')
      20091013093016 X #1620 DAL DAL2_CConnection::ReleaseConnection: Available = 1
      20091013093016 I #1620 SIM_InetMgr Started upload session 1 for site 8DCEF089-D025-4D6C-8D1F-445BD9B5BD1F
      20091013093016 X #4008 CmnLib Queue 0x33bdd75c Get work queue item 316f46a0, cookie=2f0d8d60, Param1=33bdd804, Param2=0, QueueLength=0
      20091013093016 X #4008 CmnLib Queue 0x33bdd75c Calling WQItem callback function...
      20091013093016 I #4008 SiteMgr ReplicationUploadFile: Uploading file SiteStat.xml to site ePOSA_AVSRV1::, retry limit remaining: 5
      20091013093016 I #4008 SIM_InetMgr Uploading file SiteStat.xml from session 1, LocalDir=C:\WINDOWS\TEMP\nai579.tmp\00000001, RemoteDir=
      20091013093016 I #4008 naInet Uploading file C:\WINDOWS\TEMP\nai579.tmp\00000001\SiteStat.xml to HTTP Server
      20091013093016 I #4008 naInet Connecting to Real Server: AVSRV1 on port: 8081
      20091013093016 I #4008 naInet Connected to HTTP Server: AVSRV1
      20091013093016 X #4008 naInet Uploading HTTP Header
      20091013093016 X #4008 naInet Uploading data in bytes: 87
      20091013093016 X #4008 naInet Reading acknowledgement from Server
      20091013093017 X #4008 naInet Response Header: HTTP/1.0 500 Internal Server Error

      20091013093017 X #4008 naInet Response Header: Server: Agent-ListenServer-HttpSvr/1.0

      20091013093017 X #4008 naInet Response Header: Date: Tue, 13 Oct 2009 16:30:17 GMT

      20091013093017 X #4008 naInet Response Header:

      20091013093017 X #4008 naInet Received response [] from Server
      20091013093017 W #4008 naihttp failed upload file: /Software/SiteStat.xml
      20091013093017 X #4008 naInet Socket getting closed, Handle 4836
      20091013093017 I #4008 SIM_InetMgr Upload file SiteStat.xml failed in session 1, nainet ret=5
      20091013093017 X #4008 DAL DAL2_CConnection::GetConnection: Available = 0
      20091013093017 X #4008 DAL Executing: EXECUTE EPORepositoryMgr_UpdateTasklogMessage 1924,1367,10,N'<a href=''/RepositoryMgmt/viewRepositoryTaskLogDetails.do?taskLogId=1924''>Replica te to site ePOSA_AVSRV1 in progress (0%), 1 warnings</a>'
      20091013093017 X #4008 DAL DAL2_CConnection::ReleaseConnection: Available = 1
      20091013093017 X #4008 DAL DAL2_CConnection::GetConnection: Available = 0
      20091013093017 X #4008 DAL Executing: EXECUTE EPORepositoryMgr_AddLogMessage 1924,N'ePOSA_AVSRV1',1,4021,3,N'AVSRV1:8081',N'SiteStat.xml',N'5 ( Access is denied. )',N''
      20091013093017 X #4008 DAL DAL2_CConnection::ReleaseConnection: Available = 1
      20091013093017 I #4008 SiteMgr ReplicationUploadFile: Failed to upload file SiteStat.xml to site ePOSA_AVSRV1::, hr=-2147467259, retry limit remaining: 4
      20091013093017 X #4008 CmnLib Queue 0x33bdd75c Get work queue item 316f38d8, cookie=2f0d8d60, Param1=33bdd804, Param2=0, QueueLength=0
      20091013093017 X #4008 CmnLib Queue 0x33bdd75c Calling WQItem callback function...
      20091013093017 I #4008 SiteMgr ReplicationUploadFile: Uploading file SiteStat.xml to site ePOSA_AVSRV1::, retry limit remaining: 4
      20091013093019 I #4008 SIM_InetMgr Uploading file SiteStat.xml from session 1, LocalDir=C:\WINDOWS\TEMP\nai579.tmp\00000001, RemoteDir=
      20091013093019 I #4008 naInet Uploading file C:\WINDOWS\TEMP\nai579.tmp\00000001\SiteStat.xml to HTTP Server
      20091013093019 I #4008 naInet Connecting to Real Server: AVSRV1 on port: 8081
      20091013093019 I #4008 naInet Connected to HTTP Server: AVSRV1
      20091013093019 X #4008 naInet Uploading HTTP Header
      20091013093019 X #4008 naInet Uploading data in bytes: 87
      20091013093019 X #4008 naInet Reading acknowledgement from Server
      20091013093019 X #4008 naInet Response Header: HTTP/1.0 500 Internal Server Error

      20091013093019 X #4008 naInet Response Header: Server: Agent-ListenServer-HttpSvr/1.0

      20091013093019 X #4008 naInet Response Header: Date: Tue, 13 Oct 2009 16:30:19 GMT

      20091013093019 X #4008 naInet Response Header:

      20091013093019 X #4008 naInet Received response [] from Server
      20091013093019 W #4008 naihttp failed upload file: /Software/SiteStat.xml
        • 1. RE: Failed to Replicate Sitestat.xml
          JoeBidgood
          Check the agent log on the failing SA repository machines and see if there's anything corresponding to the time of the failure - it looks like the SA is up, but is returning a 500 error code.

          HTH -

          Joe
          • 2. RE: Failed to Replicate Sitestat.xml
            I was able to fix the issue but uninstalled all McAfee products, manually cleaning the registry and reinstalling. However that only fixed part of the problems. From there I was able to reinstall the Agent again and configure it to be a SuperAgent. From there it still wouldn't replicate to it.

            Fishing through the Event Logs (on the SuperAgents) I saw a few events that had to refer to the SChannel Event ID 36872. Since replication occurs on an SSL channel (443) I figured, hey can't hurt to try to fix that. I ended up having to Add Administrators and System (removing Everyone) giving them FC to the C:\Documents and Settings\All Users\Application Data\Microsoft\Crypto\RSA\MachineKeys directory.

            After a reboot everything worked including no errors in the Event Logs and Replication to the SuperAgents worked.

            I hope this helps with others having similar issues.
            • 3. RE: Failed to Replicate Sitestat.xml
              JoeBidgood
              That's good information, thanks :)

              Joe
              • 4. RE: Failed to Replicate Sitestat.xml
                One more thing.

                After the initial successful sync I went home. The next day the sync failed and continue to fail throughout the day.

                After further investigating I found in the logs (ePOSRV) a reference to "Unable to Verify Signature Repository". So I figured that overnight the replication of Active Directory changed the Crypto keys so that all Domain Controllers shared the same keys (theory) the CA Certificate that was installed from McAfee is no longer based off the original Crypto.

                I had to remove all McAfee products and reinstall starting with the Agent. It seems to be working now, but will keep this updated.