After initially migrating from an Exchange 2007 to 2013 (CU1 was the initial install) and then upgrading to CU3, we are facing a lot of errors in the eventlog.
The system is operational and the errors does not seem to affect user experience, BUT it is filling up the monitoring system (SCOM) and basically making it impossoble to monitor. When displaying the 'ManagedAvailibility --> Monitoring' log, these errors seems to be reoccuring for 9 different events (the text is basically the same on all and Get-ServerHealth reports unhealthy on the following as well)
-------This is reported for the following items: EventBasedAssistantsMaintenanceWorkitem, FEP.Maintenance.Workitem, Search.FAST.Host.Controller.Maintenance.Workitem, ClientAccess Maintenance Workitem, HighAvailability.Maintenance.Workitem, Wac.Maintenance.Workitem,
EdiscoveryDiscovery, OAuthMaintenanceWorkitem ------------------
Maintenance workitem "EventBasedAssistantsMaintenanceWorkitem" (ID: 25) has failed. Health Manager has detected it is either set to run once and failed, or has been failing consistently. Maintenance workitem failure could cause monitoring gap and
should be investigated.
The error message from the last result is:
Microsoft.Exchange.Data.Directory.ADOperationException: Active Directory operation failed on dcname.domain.priv. This error is not retriable. Additional information: Directory object not found.
Active directory response: 0000208D: NameErr: DSID-0310020A, problem 2001 (NO_OBJECT), data 0, best match of:
'CN=Microsoft Exchange System Objects,DC=domain,DC=priv'
---> System.DirectoryServices.Protocols.DirectoryOperationException: The object does not exist.
at System.DirectoryServices.Protocols.LdapConnection.ConstructResponse(Int32 messageId, LdapOperation operation, ResultAll resultType, TimeSpan requestTimeOut, Boolean exceptionOnTimeOut)
at System.DirectoryServices.Protocols.LdapConnection.SendRequest(DirectoryRequest request, TimeSpan requestTimeout)
at Microsoft.Exchange.Data.Directory.PooledLdapConnection.SendRequest(DirectoryRequest request, LdapOperation ldapOperation, Nullable`1 clientSideSearchTimeout, IActivityScope activityScope, String callerInfo)
at Microsoft.Exchange.Data.Directory.ADDataSession.ExecuteModificationRequest(ADObject entry, DirectoryRequest request, ADObjectId originalId, Boolean emptyObjectSessionOnException, Boolean isSync)
--- End of inner exception stack trace ---
at Microsoft.Exchange.Data.Directory.ADDataSession.AnalyzeDirectoryError(PooledLdapConnection connection, DirectoryRequest request, DirectoryException de, Int32 totalRetries, Int32 retriesOnServer)
at Microsoft.Exchange.Data.Directory.ADDataSession.ExecuteModificationRequest(ADObject entry, DirectoryRequest request, ADObjectId originalId, Boolean emptyObjectSessionOnException, Boolean isSync)
at Microsoft.Exchange.Data.Directory.ADDataSession.ExecuteModificationRequest(ADObject entry, DirectoryRequest request, ADObjectId originalId, Boolean emptyObjectSessionOnException)
at Microsoft.Exchange.Data.Directory.ADDataSession.Save(ADObject instanceToSave, IEnumerable`1 properties, Boolean bypassValidation)
at Microsoft.Exchange.Data.Directory.Recipient.ADRecipientObjectSession.Save(ADRecipient instanceToSave)
at Microsoft.Exchange.Management.Common.MailboxTaskHelper.CreateMonitoringMailbox(Guid guid, MailboxDatabase database, ADObjectId[] forcedReplicationSites, ErrorLoggerDelegate errorLogger, TaskWarningLoggingDelegate warningLogger, TaskVerboseLoggingDelegate
verboseLogger, Action`1 liveIdFiller, String displayName, String monitoringTenantName)
at Microsoft.Exchange.Monitoring.ActiveMonitoring.Common.DirectoryAccessor.SearchOrCreateMonitoringMailbox(Boolean canUpdate, MailboxDatabase& database, Guid guid, String userPrincipalName)
at Microsoft.Exchange.Monitoring.ActiveMonitoring.Common.BackendMailboxDatabaseEndpointDelegate.ConfigureMonitoringMailbox(MailboxDatabaseInfo dbInfo, DatabaseCopy copy, MailboxDatabase database)
at Microsoft.Exchange.Monitoring.ActiveMonitoring.Common.BackendMailboxDatabaseEndpointDelegate.GetMailboxDatabaseInfo(DatabaseCopy copy, MailboxDatabase database)
at Microsoft.Exchange.Monitoring.ActiveMonitoring.Common.BackendMailboxDatabaseEndpointDelegate.<>c__DisplayClass5.<Initialize>b__3(Object dbCopy)
at System.Threading.Tasks.Task.Execute()
-------------------------------------------------------------------------------
States of all monitors within the health set:
Note: Data may be stale. To get current data, run: Get-ServerHealth -Identity 'server' -HealthSet 'EventAssistants'
State Name
TargetResource HealthSet
AlertValue ServerComponent
----- ----
-------------- ---------
---------- ---------------
NotApplicable EventAssistantsServiceMonitor MSExchangeMailboxAssistants EventAssistants
Healthy None
NotApplicable MaintenanceFailureMonitor.EventAssis...
EventAssistants Healthy None
NotApplicable PrivateWorkingSetWarning....angemail... msexchangemailboxassistants EventAssistants
Healthy None
NotApplicable PrivateWorkingSetError....changemail... msexchangemailboxassistants EventAssistants
Healthy None
NotApplicable ProcessProcessorTimeWarning....email... msexchangemailboxassistants EventAssistants
Healthy None
NotApplicable ProcessProcessorTimeError....ngemail... msexchangemailboxassistants EventAssistants
Healthy None
NotApplicable LongRunningWatsonWarning....angemail... msexchangemailboxassistants EventAssistants
Healthy None
NotApplicable LongRunningWerMgrWarning....angemail... msexchangemailboxassistants EventAssistants
Healthy None
States of all health sets:
Note: Data may be stale. To get current data, run: Get-HealthReport -Identity 'servername'
State HealthSet AlertValue LastTransitionTime
MonitorCount
----- --------- ---------- ------------------
------------
Online HubTransport Healthy 12/12/2013
9:09:59 AM 134
NotApplicable Search Unhealthy 12/12/2013 9:27:46 AM
53
NotApplicable MessageTracing Healthy 12/12/2013 3:53:12 AM 8
NotApplicable CentralAdmin Healthy 12/12/2013 3:52:22 AM 7
NotApplicable AD Healthy
12/12/2013 3:51:45 AM 19
NotApplicable EDS Healthy
12/12/2013 9:09:59 AM 84
NotApplicable ECP Unhealthy 12/12/2013
9:27:19 AM 4
NotApplicable EventAssistants Healthy 12/12/2013 9:14:27 AM 8
NotApplicable FIPS Healthy 12/12/2013
9:09:57 AM 28
NotApplicable ProcessIsolation Healthy 12/12/2013 3:54:14 AM 21
Online FrontendTransport Healthy 12/12/2013 3:51:25 AM
15
NotApplicable UM.Protocol Healthy 12/12/2013 9:10:00 AM
22
NotApplicable Monitoring Degraded 12/12/2013 9:28:39 AM
17
NotApplicable Store Healthy 12/12/2013
3:53:38 AM 21
NotApplicable Autodiscover.Protocol Healthy 12/12/2013 3:54:01 AM 8
Online ECP.Proxy Healthy
12/12/2013 3:53:22 AM 7
NotApplicable OWA.Protocol.Dep Healthy 12/12/2013 9:09:57 AM 1
NotApplicable OAB Healthy
12/12/2013 3:54:06 AM 8
NotApplicable Network Healthy 12/12/2013 3:56:12
AM 2
NotApplicable OWA.Protocol Healthy 12/12/2013 3:54:09 AM 7
NotApplicable Calendaring Healthy 12/12/2013 3:54:11 AM
8
NotApplicable AntiSpam Healthy 12/12/2013 9:09:59 AM
8
Online RPS.Proxy Healthy
12/12/2013 3:54:12 AM 28
NotApplicable MRS Healthy
12/12/2013 3:58:27 AM 19
NotApplicable MailboxMigration Healthy 12/12/2013 3:50:40 AM 3
NotApplicable Psws Healthy 12/12/2013
3:54:07 AM 14
NotApplicable MailboxTransport Unhealthy 12/12/2013 9:09:59 AM 63
NotApplicable PushNotifications.Protocol Healthy 12/12/2013 3:52:47 AM 7
Online RWS.Proxy Healthy
12/12/2013 3:53:50 AM 7
Online Outlook.Proxy Healthy 12/12/2013 3:53:05
AM 7
NotApplicable EWS.Protocol Healthy 12/12/2013 3:53:57 AM 8
NotApplicable ActiveSync.Protocol Healthy 12/12/2013 3:53:23 AM 7
Online OutlookMapi.Proxy Healthy 12/12/2013 3:53:07 AM
7
NotApplicable Inference Healthy 12/12/2013 3:52:04 AM
1
NotApplicable OWA Unhealthy 12/12/2013
9:25:54 AM 2
NotApplicable MailboxSpace Unhealthy 12/12/2013 9:19:03 AM 16
NotApplicable MSExchangeCertificateDeplo... Disabled 1/1/0001 1:00:00 AM 2
NotApplicable PublicFolders Healthy 12/12/2013 4:02:25 AM 4
NotApplicable SiteMailbox Healthy 12/12/2013 3:54:21 AM
3
NotApplicable UserThrottling Healthy 12/12/2013 9:20:57 AM 7
Online UM.CallRouter Healthy 12/12/2013 9:09:59
AM 12
NotApplicable DAL Healthy
11/29/2013 12:10:03 PM 11
NotApplicable Antimalware Healthy 12/12/2013 3:46:13 AM
11
NotApplicable RemoteMonitoring Healthy 12/11/2013 8:55:41 PM 4
NotApplicable MigrationMonitor Healthy 12/12/2013 3:54:02 AM 3
Online Transport Healthy
12/12/2013 9:09:59 AM 10
NotApplicable EAS Healthy
11/29/2013 12:13:41 PM 1
NotApplicable Autodiscover Healthy 11/29/2013 12:10:10 PM 1
NotApplicable ClientAccess.Proxy Unhealthy 12/12/2013 9:27:46 AM 1
NotApplicable EWS Unhealthy 12/12/2013
9:24:42 AM 1
NotApplicable DataProtection Unhealthy 12/12/2013 9:26:04 AM 1
NotApplicable BitlockerDeployment Healthy 12/12/2013 3:46:37 AM 1
NotApplicable Compliance Unhealthy 12/12/2013 9:25:19 AM 1
NotApplicable FEP Degraded 12/12/2013
9:29:05 AM 1
NotApplicable FfoRws Healthy 11/29/2013 12:11:37
PM 1
NotApplicable FreeBusy Healthy 11/29/2013 12:10:47 PM
1
NotApplicable Places Healthy 11/29/2013 12:10:33
PM 1
NotApplicable Security Healthy 12/12/2013 3:48:09 AM
7
NotApplicable IMAP.Protocol Healthy 12/12/2013 3:50:20 AM 7
NotApplicable Datamining Healthy 12/12/2013 3:48:28 AM
7
NotApplicable Provisioning Healthy 12/12/2013 3:54:11 AM 7
NotApplicable POP.Protocol Healthy 12/12/2013 3:47:44 AM 7
NotApplicable Outlook.Protocol Healthy 12/12/2013 3:51:06 AM 7
NotApplicable TransportSync Healthy 12/12/2013 3:50:34 AM 7
Note: Subsequent detected alerts are suppressed until the health set is healthy again.
------------------ This is reported on each server, even though DriveSpaceTrigger is set to false ---------------------------
EventID 1006
The performance counter '\\server\LogicalDisk(C:)\Free Megabytes' sustained a value of '51,912.00', for the '15' minute(s) interval starting at '12/12/2013 10:30:00 AM'. Additional information: None. Trigger Name:DatabaseDriveSpaceTrigger. Instance:c: