Thanks a lot!

So my new question is: how can I have an idea, why have the measurements lost? It's OK, that the connection between a guest VM (agent) and the host (server) has been lost, it can be a Virtualization platform bug, but, there're no values for the interval at all.

Attila


2014/1/15 Jay Shaughnessy <jshaughn@redhat.com>

The server log indicates that the agent was unable to ping the server for at least 5 minutes.  It would seem to indicate a connectivity/network error.  The backfilling means the server set the Agent/Platform to DOWN avail and all of its resources to UNKNOWN avail (because we don't actually know whether they are up or down when the agent fails to report).  When the agent does re-establish contact any collected metrics should actually b sent unless the spooled reports was somehow lost.  And then availability should re-establish itself.



On 1/14/2014 2:00 PM, Attila Heidrich wrote:
Hi!

Running on a virtualized Linux, one agent has lost for several minutes. No measurements are present in the servers database, while theres no any sign of problem in the virtualization log, or even in the agent's own log. There is en exception, but the very same happens many time.

According the log, it sent the reports regularly for the server:

2014-01-14 10:17:41,788 INFO  [MeasurementManager.sender-1] (rhq.core.pc.measurement.MeasurementSenderRunner)- Measurement collection for [14] metrics took 94ms - sending report to Server...
2014-01-14 10:18:09,712 INFO  [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Scan Starting: Tue Jan 14 10:18:09 CET 2014
2014-01-14 10:18:09,733 INFO  [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Scan Ended   : Tue Jan 14 10:18:09 CET 2014 : Scan [startTime=1389691089712, endTime=1389691089732, runtime=20, isFull=false, isForced=false, numResources=179, numGetAvailabilityCalls=7, numScheduledRandomly=0, numPushedByInterval=6, numAvailabilityChanges=0, numDeferToParent=0]
2014-01-14 10:18:11,788 INFO  [MeasurementManager.sender-1] (rhq.core.pc.measurement.MeasurementSenderRunner)- Measurement collection for [14] metrics took 67ms - sending report to Server...
2014-01-14 10:18:11,812 INFO  [ConfigurationManager.threadpool-1] (rhq.core.pc.configuration.ConfigurationCheckExecutor)- Starting configuration update check...
2014-01-14 10:18:11,814 INFO  [ResourceContainer.invoker.daemon-56351] (org.rhq.plugins.jmx.MBeanResourceComponent)- Configuration management is currently disabled for the ResourceType[id=0, name=java.util.logging, plugin=RHQAgent, category=Service] Resource with key [java.util.logging:type=Logging] - it can be enabled in the Resource's Inventory > Connection tab.
2014-01-14 10:18:12,793 WARN  [ConfigurationManager.threadpool-1] (rhq.core.pc.configuration.ConfigurationCheckExecutor)- An error occurred while checking for an updated Resource configuration for Resource[id=11763, uuid=74154a3e-07fc-4b0e-88be-f14e95059b8a, type={OpenSSH}SSHD, key=sshd, name=OpenSSH sshd, parent=amweb-se, version=1.0].
net.augeas.AugeasException: get failed
        at net.augeas.Augeas.processLastCall(Unknown Source)
        at net.augeas.Augeas.get(Unknown Source)
        at org.rhq.plugins.sshd.OpenSSHDComponent.getConfig(OpenSSHDComponent.java:189)
        at org.rhq.plugins.sshd.OpenSSHDComponent.loadResourceConfiguration(OpenSSHDComponent.java:168)
        at org.rhq.plugins.sshd.OpenSSHDComponent.loadResourceConfiguration(OpenSSHDComponent.java:119)
        at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.rhq.core.pc.inventory.ResourceContainer$ComponentInvocation.call(ResourceContainer.java:654)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
        at java.lang.Thread.run(Thread.java:662)
2014-01-14 10:18:12,793 WARN  [ConfigurationManager.threadpool-1] (rhq.core.pc.configuration.ConfigurationCheckExecutor)- An error occurred while checking for an updated Resource configuration for Resource[id=11765, uuid=d9704c88-052e-47e2-8b9e-3495a57bb5c5, type={Apache}Apache HTTP Server, key=/etc/apache2||/etc/apache2/apache2.conf, name=127.0.1.1:80, parent=amweb-se, version=2.2.22].
java.lang.IllegalStateException: Configuration and child resource creation/deletion support for Apache is optional. If you switched it on by enabling Augeas support in the connection settings of the Apache server resource and still get this message, it means that either your Apache version is not supported (only Apache 2.x is supported) or Augeas is not available on your platform.
        at org.rhq.plugins.apache.ApacheServerComponent.loadResourceConfiguration(ApacheServerComponent.java:369)
        at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.rhq.core.pc.inventory.ResourceContainer$ComponentInvocation.call(ResourceContainer.java:654)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
        at java.lang.Thread.run(Thread.java:662)
2014-01-14 10:18:12,794 WARN  [ConfigurationManager.threadpool-1] (rhq.core.pc.configuration.ConfigurationCheckExecutor)- An error occurred while checking for an updated Resource configuration for Resource[id=11799, uuid=63150549-2454-4218-aaad-ddcffc071718, type={Apache}Apache Virtual Host, key=MainServer, name=Main, parent=127.0.1.1:80].
java.lang.IllegalStateException: Configuration and child resource creation/deletion support for Apache is optional. If you switched it on by enabling Augeas support in the connection settings of the Apache server resource and still get this message, it means that either your Apache version is not supported (only Apache 2.x is supported) or Augeas is not available on your platform.
        at org.rhq.plugins.apache.ApacheVirtualHostServiceComponent.loadResourceConfiguration(ApacheVirtualHostServiceComponent.java:165)
        at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.rhq.core.pc.inventory.ResourceContainer$ComponentInvocation.call(ResourceContainer.java:654)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
        at java.lang.Thread.run(Thread.java:662)
2014-01-14 10:18:12,795 INFO  [ConfigurationManager.threadpool-1] (rhq.core.pc.configuration.ConfigurationCheckExecutor)- Configuration update check completed in 982ms
2014-01-14 10:18:39,733 INFO  [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Scan Starting: Tue Jan 14 10:18:39 CET 2014
2014-01-14 10:18:39,735 INFO  [InventoryManager.availability-1] (rhq.core.pc.inventory.AvailabilityExecutor)- Scan Ended   : Tue Jan 14 10:18:39 CET 2014 : Scan [startTime=1389691119733, endTime=1389691119735, runtime=2, isFull=false, isForced=false, numResources=179, numGetAvailabilityCalls=1, numScheduledRandomly=0, numPushedByInterval=0, numAvailabilityChanges=0, numDeferToParent=0]
2014-01-14 10:18:41,789 INFO  [MeasurementManager.sender-1] (rhq.core.pc.measurement.MeasurementSenderRunner)- Measurement collection for [9] metrics took 73ms - sending report to Server...

The Exception above occurs in every hour in the same minute.

And this is the servers log:

10:20:08,530 INFO  [org.rhq.enterprise.server.core.AgentManagerBean] (RHQScheduler_Worker-5) Have not heard from agent [amweb] since [Tue Jan 14 10:14:17 UTC 2014]. Will be backfilled since we suspect it is down

Any idea how to prevent such events in the future?


_______________________________________________
rhq-users mailing list
rhq-users@lists.fedorahosted.org
https://lists.fedorahosted.org/mailman/listinfo/rhq-users


_______________________________________________
rhq-users mailing list
rhq-users@lists.fedorahosted.org
https://lists.fedorahosted.org/mailman/listinfo/rhq-users