I had a set of 2013 DAG Exchange servers with windows 2012 OS in virtual environment( VMware vCenter ):
A Domain controller, two mailboxes, a client access.
Recently when I tried to access https://<CASServerName>/ecp I got the following error page:
Then I found some errors in Event Viewer:
Log Name: System
Source: Microsoft-Windows-DistributedCOM
Date: 4/21/2014 2:43:10 PM
Event ID: 10028
Task Category: None
Level: Error
Keywords: Classic
User: SYSTEM
Computer: zhuvm-fog-2928.qa2013dag.local
Description:
DCOM was unable to communicate with the computer ZHUVM-FOG-2927.qa2013dag.local using any of the configured protocols; requested by PID 95c (C:\Program Files\Microsoft\Exchange Server\V15\Bin\MSExchangeHMWorker.exe).
Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"><System><Provider Name="Microsoft-Windows-DistributedCOM" Guid="{1B562E86-B7AA-4131-BADC-B6F3A001407E}" EventSourceName="DCOM" /><EventID Qualifiers="0">10028</EventID><Version>0</Version><Level>2</Level><Task>0</Task><Opcode>0</Opcode><Keywords>0x8080000000000000</Keywords><TimeCreated SystemTime="2014-04-21T06:43:10.813315700Z" /><EventRecordID>24185</EventRecordID><Correlation /><Execution ProcessID="640" ThreadID="544" /><Channel>System</Channel><Computer>zhuvm-fog-2928.qa2013dag.local</Computer><Security UserID="S-1-5-18" /></System><EventData><Data Name="param1">ZHUVM-FOG-2927.qa2013dag.local</Data><Data Name="param2"> 95c</Data><Data Name="param3">C:\Program Files\Microsoft\Exchange Server\V15\Bin\MSExchangeHMWorker.exe</Data><Binary>3C5265636F726423313A20436F6D70757465723D286E756C6C293B5069643D3634303B342F32312F3230313420363A34333A31303A3831333B5374617475733D313732323B47656E636F6D703D323B4465746C6F633D313731303B466C6167733D303B506172616D733D313B7B506172616D23303A307D3E3C5265636F726423323A20436F6D70757465723D286E756C6C293B5069643D3634303B342F32312F3230313420363A34333A31303A3831333B5374617475733D313732323B47656E636F6D703D31383B4465746C6F633D313434323B466C6167733D303B506172616D733D313B7B506172616D23303A5A4855564D2D464F472D323932372E7161323031336461672E6C6F63616C7D3E3C5265636F726423333A20436F6D70757465723D286E756C6C293B5069643D3634303B342F32312F3230313420363A34333A31303A3831333B5374617475733D313732323B47656E636F6D703D31383B4465746C6F633D3332323B466C6167733D303B506172616D733D303B3E3C5265636F726423343A20436F6D70757465723D286E756C6C293B5069643D3634303B342F32312F3230313420363A34333A31303A3831333B5374617475733D31313030313B47656E636F6D703D31383B4465746C6F633D3332303B466C6167733D303B506172616D733D313B7B506172616D23303A5A4855564D2D464F472D323932372E7161323031336461672E6C6F63616C7D3E</Binary></EventData></Event>Log Name: Application Source: MSExchange ADAccess Date: 4/24/2014 9:58:02 AM Event ID: 4027 Task Category: General Level: Error Keywords: Classic User: N/A Computer: zhuvm-fog-2928.qa2013dag.local Description: Process MSExchangeHMWorker.exe (ExHMWorker) (PID=544). WCF request (Get Servers for qa2013dag.local) to the Microsoft Exchange Active Directory Topology service on server (TopologyClientTcpEndpoint (localhost)) failed. Make sure that the service is running. In addition, make sure that the network ports that are used by Microsoft Exchange Active Directory Topology service are not blocked by a firewall. The WCF call was retried 3 time(s). Error Details System.ServiceModel.EndpointNotFoundException: Could not connect to net.tcp://localhost:890/Microsoft.Exchange.Directory.TopologyService. The connection attempt lasted for a time span of 00:00:02.0436133. TCP error code 10061: No connection could be made because the target machine actively refused it 127.0.0.1:890. ---> System.Net.Sockets.SocketException: No connection could be made because the target machine actively refused it 127.0.0.1:890 at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress) at System.Net.Sockets.Socket.Connect(EndPoint remoteEP) at System.ServiceModel.Channels.SocketConnectionInitiator.Connect(Uri uri, TimeSpan timeout) --- End of inner exception stack trace --- Server stack trace: at System.ServiceModel.Channels.SocketConnectionInitiator.Connect(Uri uri, TimeSpan timeout) at System.ServiceModel.Channels.BufferedConnectionInitiator.Connect(Uri uri, TimeSpan timeout) at System.ServiceModel.Channels.ConnectionPoolHelper.EstablishConnection(TimeSpan timeout) at System.ServiceModel.Channels.ClientFramingDuplexSessionChannel.OnOpen(TimeSpan timeout) at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.OnOpen(TimeSpan timeout) at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout) Exception rethrown at [0]: at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg) at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type) at System.ServiceModel.ICommunicationObject.Open() at Microsoft.Exchange.Net.ServiceProxyPool`1.GetClient() at Microsoft.Exchange.Net.ServiceProxyPool`1.TryCallServiceWithRetry(Action`1 action, String debugMessage, WCFConnectionStateTuple proxyToUse, Int32 numberOfRetries, Boolean doNotReturnProxyOnSuccess, Exception& exception) Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"><System><Provider Name="MSExchange ADAccess" /><EventID Qualifiers="49156">4027</EventID><Level>2</Level><Task>1</Task><Keywords>0x80000000000000</Keywords><TimeCreated SystemTime="2014-04-24T01:58:02.000000000Z" /><EventRecordID>3810658</EventRecordID><Channel>Application</Channel><Computer>zhuvm-fog-2928.qa2013dag.local</Computer><Security /></System><EventData><Data>MSExchangeHMWorker.exe (ExHMWorker)</Data><Data>544</Data><Data>Get Servers for qa2013dag.local</Data><Data>TopologyClientTcpEndpoint (localhost)</Data><Data>3</Data><Data>System.ServiceModel.EndpointNotFoundException: Could not connect to net.tcp://localhost:890/Microsoft.Exchange.Directory.TopologyService. The connection attempt lasted for a time span of 00:00:02.0436133. TCP error code 10061: No connection could be made because the target machine actively refused it 127.0.0.1:890. ---> System.Net.Sockets.SocketException: No connection could be made because the target machine actively refused it 127.0.0.1:890 at System.Net.Sockets.Socket.DoConnect(EndPoint endPointSnapshot, SocketAddress socketAddress) at System.Net.Sockets.Socket.Connect(EndPoint remoteEP) at System.ServiceModel.Channels.SocketConnectionInitiator.Connect(Uri uri, TimeSpan timeout) --- End of inner exception stack trace --- Server stack trace: at System.ServiceModel.Channels.SocketConnectionInitiator.Connect(Uri uri, TimeSpan timeout) at System.ServiceModel.Channels.BufferedConnectionInitiator.Connect(Uri uri, TimeSpan timeout) at System.ServiceModel.Channels.ConnectionPoolHelper.EstablishConnection(TimeSpan timeout) at System.ServiceModel.Channels.ClientFramingDuplexSessionChannel.OnOpen(TimeSpan timeout) at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout) at System.ServiceModel.Channels.ServiceChannel.OnOpen(TimeSpan timeout) at System.ServiceModel.Channels.CommunicationObject.Open(TimeSpan timeout) Exception rethrown at [0]: at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg) at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type) at System.ServiceModel.ICommunicationObject.Open() at Microsoft.Exchange.Net.ServiceProxyPool`1.GetClient() at Microsoft.Exchange.Net.ServiceProxyPool`1.TryCallServiceWithRetry(Action`1 action, String debugMessage, WCFConnectionStateTuple proxyToUse, Int32 numberOfRetries, Boolean doNotReturnProxyOnSuccess, Exception& exception)</Data></EventData></Event>
Log Name: Application Source: MSExchangeDiagnostics Date: 4/24/2014 9:56:45 AM Event ID: 1015 Task Category: General Level: Error Keywords: Classic User: N/A Computer: zhuvm-fog-2928.qa2013dag.local Description: Unable to contact the active directory. Inner Exception System.DirectoryServices.ActiveDirectory.ActiveDirectoryObjectNotFoundException: The computer is not in a site. at System.DirectoryServices.ActiveDirectory.ActiveDirectorySite.GetComputerSite() at Microsoft.Exchange.Diagnostics.Service.MachineInformationSource.PollMachineInformation() Event Xml:<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event"><System><Provider Name="MSExchangeDiagnostics" /><EventID Qualifiers="49156">1015</EventID><Level>2</Level><Task>1</Task><Keywords>0x80000000000000</Keywords><TimeCreated SystemTime="2014-04-24T01:56:45.000000000Z" /><EventRecordID>3810649</EventRecordID><Channel>Application</Channel><Computer>zhuvm-fog-2928.qa2013dag.local</Computer><Security /></System><EventData><Data>System.DirectoryServices.ActiveDirectory.ActiveDirectoryObjectNotFoundException: The computer is not in a site. at System.DirectoryServices.ActiveDirectory.ActiveDirectorySite.GetComputerSite() at Microsoft.Exchange.Diagnostics.Service.MachineInformationSource.PollMachineInformation()</Data></EventData></Event>
Besides, there are many services in Exchange server stopped & could not be started:
I observed no ERRORs in Domain Controller, the firewall of all servers had been turned off and IPv6 enabled.
I could not determine what happened to my server, it's really urgent issue for me!!!
How could I fix these servers?