RMS is gray
Home  » Operations Manager  » RMS is gray

RMS is gray
Posted: Tue, Jun 23, 2009 7:55 AM :: Rank: 0
Author
Points: 245
Level: System Center Hero

When I trying execute the command setspn -L ........., on RMS server - result:
ldap_init failed = Server Down

It is not a firewall - I'm sure!!!!

I thinking that it problem bring the RMS to gray state, but
in Operations Manager log presents some events that can bring RMS to the gray state too.

It 7016 and 7021. What can I do with my problem?

And finally: in OpsMgr log presents many events 4506 "Data was dropped due to too much outstanding datan in rule ....... (many others rules)........ - what this?

Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 9:04 AM :: Rank: 0
Author
Points: 2580
Level: System Center Specialist

Starley,

 

Restart the RMS services ( OMSDK, OMCGF and Healthservice) . After restart the services please check the eventlogs  and give us more detail about the issue.   I dont think SPN registration cause the issue, if you need to set spn you can log on to your domain controller and setspn or use adsiedit to to make sure you created spn records.

Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 9:21 AM :: Rank: 0
Author
Points: 20243
Level: System Center Expert
Hi Starley, Can I confirm the following, Have you just installed SP1, Have you tried to repair any clients using the automated system 'Agent Managed? Are you infact getting any errors where the events report there is a problem with the SPN's? Was this working then stopped or is it a new install?
Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 10:51 AM :: Rank: 2
Author
Points: 245
Level: System Center Hero

I changed the IP at RMS and SQL servers. When I restarted the OMSDK, OMCFG and Healthservice:

From bottom to up

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 7016
The Health Service cannot verify the future validity of the
RunAs account DOMAIN\Account for management
group ............. due to an error retrieving information from
Active Directory (for Domain Accounts) or the local security
authority (for Local Accounts).  The error is The network
path was not found.
(0x80070035).

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 7021
The Health Service was unable to validate any user accounts
in management group ............ .

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.Discovery.StandardDataSet"
running for instance "Performance data set" with id:
"{5C248BE4-DA80-453E-AA21-0D398C9A7CF2}" cannot be initialized
and will not be loaded. Management group "........."

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.Discovery.StandardDataSet"
running for instance "State data set" with id:
"{40B9B0A3-F682-6E1E-39AA-C7B3CDD6B974}" cannot be initialized
and will not be loaded. Management group "..........."
 

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.StandardDataSetMaintenance"
running for instance "State data set" with id:
"{40B9B0A3-F682-6E1E-39AA-C7B3CDD6B974}" cannot be initialized
and will not be loaded. Management group ".........."

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.Discovery.StandardDataSet"
running for instance "Performance data set" with id:
"{5C248BE4-DA80-453E-AA21-0D398C9A7CF2}" cannot be initialized
and will not be loaded. Management group "........."
 

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.StandardDataSetMaintenance"
running for instance "Performance data set" with id:
"{5C248BE4-DA80-453E-AA21-0D398C9A7CF2}" cannot be initialized
and will not be loaded. Management group "............"

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.Discovery.StandardDataSet"
running for instance "Alert data set" with id:
"{582364A3-314B-70FE-CCA4-3D3C1E23E83E}" cannot be initialized
and will not be loaded. Management group "............"

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.StandardDataSetMaintenance"
running for instance "Alert data set" with id:
"{582364A3-314B-70FE-CCA4-3D3C1E23E83E}" cannot be initialized
and will not be loaded. Management group "............"

    ...   
    ...   
    ...


Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 1102
Rule/Monitor "Microsoft.SystemCenter.DataWarehouse.StandardDataSetMaintenance"
running for instance "Event data set" with id:
"{84ADFF68-467C-EFDD-D920-CBE0F3CF3882}" cannot be initialized
and will not be loaded. Management group ".........."


Type: Warning
Computer: Name of RMS
Source: Health Service Modules
Category: None
Event ID: 10103
In PerfDataSource, could not find counter OpsMgr DW Writer Module, Data Items/sec,
All Instances in Snapshot. Unable to submit Performance value.
Module will not be unloaded.

One or more workflows were affected by this. 

Workflow name: Microsoft.SystemCenter.DataWarehouse.CollectionRule.Performance.Writer.DataItemsPerSecond
Instance name: FQDN RMS Servers
Instance ID: {FBC6EBD6-9AB3-8F08-90EA-C04DD797917B}
Management group: ............


Type: Warning
Computer: Name of RMS
Source: Health Service Modules
Category: None
Event ID: 25017
The Windows Event Log Provider monitoring the System Event Log is 2307
minutes behind in processing events.  This can occur when the provider is
restarted after being offline for some time, or there are too many events to be
handled by the workflow.

One or more workflows were affected by this. 

Workflow name: many
Instance name: many
Instance ID: many
Management group: .............

Type: Warning
Computer: Name of RMS
Source: Health Service Script
Category: None
Event ID: 6028
DiscoverHealthServiceCommunicationRelationships.js : HealthServiceCommuncation
relationship discovery for HealthServices configured via AD Integration

Could not find "HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\
Agent Management Groups\..............\AD Cache\Primary SCP Info\Service DNS Name"
The HealthService needs at least a primary management server to communicate.
This may indicate that the following:
    * HealthService has not queried and cached the AD SCPs yet
    * HealthService doesn't have access to any SCPs, yet is configured for AD Integration
Match results: undefined
 


Type: Warning
Computer: Name of RMS
Source: Health Service Modules
Category: None
Event ID: 21405

The process started at 1:19:10 AM failed to create System.Discovery.Data, no errors
detected in the output.  The process exited with 1
 
Command executed:    "C:\WINDOWS\system32\cscript.exe" /nologo
"DiscoverHealthServiceCommunicationRelationships.js" 0
{3237253B-2A1C-38E7-8E52-588635224D35}
{FBC6EBD6-9AB3-8F08-90EA-C04DD797917B} NAme RMS "............."
Working Directory:    C:\Program Files\System Center Operations Manager 2007
\Health Service State\Monitoring Host Temporary Files 21\2903\

One or more workflows were affected by this. 

Workflow name: Microsoft.SystemCenter.DiscoveryHealthServiceCommunication
Instance name: NAme RMS
Instance ID: {FBC6EBD6-9AB3-8F08-90EA-C04DD797917B}
Management group: ..........


Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 11:29 AM :: Rank: 0
Author
Points: 20243
Level: System Center Expert

Starley, in an earlier thread I had asked the following,

 "Can I confirm the following, Have you just installed SP1, Have you tried to repair any clients using the automated system 'Agent Managed? Are you infact getting any errors where the events report there is a problem with the SPN's? Was this working then stopped or is it a new install?"

I see in your lastest post that in fact you have change the IP address of the two concerned servers instead.

But we do have some clearer events to work with.

The first error maybe around the fact the DNS has not updated to reflect your changes so for now I am going to ignor the event ID 7016 But then I find this one; "Could not find "HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\ Agent Management Groups\..............\AD Cache\Primary SCP Info\Service DNS Name" The HealthService needs at least a primary management server to communicate. This may indicate that the following: * HealthService has not queried and cached the AD SCPs yet * HealthService doesn't have access to any SCPs, yet is configured for AD Integration Match results: undefined"

So can you please check this; HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\ConnectorManager Is there the key "EnableADIntegration"=1 if so can you post back what it's config is '0' or '1'.

Before we go any further can you also let me know if you ever had this running correctly or the errors (before IP change) started on a preivously healthy server

Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 12:57 PM :: Rank: 0
Author
Points: 245
Level: System Center Hero
I have instaled SP1 in 2008. "EnableADIntegration"=1 is 1 I can't say what be Before IP Change, the log Operations Manager is 15 000 kb and events that we interesting was deleted.
Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 1:04 PM :: Rank: 0
Author
Points: 20243
Level: System Center Expert
OK, so you have got AD integration enabled, is that correct? Can you confirm that the DNS has reflected your changes to the IP address changes? Was this a working setup before? I really would like to get an answer to this question before we move forward
Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 3:35 PM :: Rank: 0
Author
Points: 245
Level: System Center Hero
I would like to get AD integration is enable. At the DNS I checked the record of my new IP RMS address (I removed old record manually and new IP record is present).
Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 3:41 PM :: Rank: 1
Author
Points: 20243
Level: System Center Expert
OK, Shall we forget AD Intergrattion for now, what are the events in the Operation Manager Log saying now? Is the RMS still grey?
Reply  
Report Abuse
Re: RMS is gray
Posted: Tue, Jun 23, 2009 4:53 PM :: Rank: 0
Author
Points: 2580
Level: System Center Specialist

 

Verify you Operation Manager Service accounts SDK and CFG and Management server action account. Check the AD make sure accounts are not locked out.  Verift your passwords ( try to logon the server with SDK, CFG and MSAA )  and check the other Eventlogs not just the OperationManager.

 

Reply  
Report Abuse
Re: RMS is gray
Posted: Thu, Jun 25, 2009 8:09 PM :: Rank: 1
Author
Points: 245
Level: System Center Hero

All my passwords was checked. All of them is properly work. I also checked the event logs but I did't see anything suspected events.

Type: Error
Computer: Name of RMS
Source: HealthService
Category: Health Service
Event ID: 7016
The Health Service cannot verify the future validity of the
RunAs account DOMAIN\Account for management
group ............. due to an error retrieving information from
Active Directory (for Domain Accounts) or the local security
authority (for Local Accounts).  The error is The network
path was not found.
(0x80070035).

Seems to me this event is problem. How can I resolving this trouble.

Reply  
Report Abuse
Re: RMS is gray
Posted: Thu, Jun 25, 2009 11:17 PM :: Rank: 0
Author
Points: 25175
Level: System Center Expert

 Is this account in a remote domain from the RMS? When working with AD Integration, we noticed that the RunAs checks for the remote domain failed, and that this was a known issue. 

If this applies to you, check out the troubleshooting section of our AD Integration whitepaper.

http://www.systemcentercentral.com/Downloads/DownloadsDetails/tabid/144/IndexID/7936/Default.aspx

Reply  
Report Abuse

Home  » Operations Manager  » RMS is gray
Tag Cloud
Quick Links
Top Contributors
Pete Zerger
Points: 25175
Level: System Center Expert
Simon Skinner
Points: 20243
Level: System Center Expert
Tommy Gunn
Points: 19054
Level: System Center Expert
MadHatter
Points: 11573
Level: System Center Expert
Stefan Koell
Points: 10134
Level: System Center Expert