Summary report for 'RHQ Overnight Full Report'
Michael Foley
mfoley at redhat.com
Thu Jul 18 14:32:29 UTC 2013
Hi,
In the interest of transparency and communication, I am sharing the nightly RHQ test automation results from QE with the RHQ community in the report below.
Just so you know...
* we run these tests nightly on the RHQ master branch
* approx 2000 tests
* approx 50% code coverage
* we are working to make the QE automation available on github
* ultimately, we'd like the RHQ community to be able to execute...and contribute to ... these test suites
Regards,
Michael Foley
JBoss Operations Network
----- Original Message -----
From: noreply at redhat.com
To: jon-qa-list at redhat.com
Sent: Wednesday, July 17, 2013 9:00:03 AM
Subject: [jon-qa-list] Summary report for 'RHQ Overnight Full Report'
Report Engine - Email Report Hello, This is auto generated email from Report Engine. It's based on RHQ Overnight Full Report
Test Suite Name Total Passed Failed Skipped Build Start Time End Time Duration Import Resources 4 (0) 0 (0) 4 (0) 0 (0) - Jul 16 04:19:28 IST 2013 Jul 16 04:29:38 IST 2013 00:10:10
RHQ REST JAVA Client Test 40 (0) 20 (0) 20 (0) 0 (0) 4.9.0-SNAPSHOT (6867162) Jul 10 11:55:13 IST 2013 Jul 10 11:55:30 IST 2013 00:00:16
RHQ REST Groovy Client Test 8 (0) 8 (0) 0 (0) 0 (0) 4.9.0-SNAPSHOT (6867162) Jul 10 11:54:33 IST 2013 Jul 10 11:54:40 IST 2013 00:00:06
RHQ 4.x core UI Test 276 (+2) 216 (-51) 59 (+53) 1 (0) 4.9.0-SNAPSHOT (6867162) Jul 10 10:29:02 IST 2013 Jul 10 11:53:34 IST 2013 01:24:31
RHQ CLI JS/JAVA Test 92 (0) 54 (+1) 1 (-1) 37 (0) 4.9.0-SNAPSHOT (59fa894) Jun 30 22:12:46 IST 2013 Jun 30 22:56:26 IST 2013 00:43:39
RHQ_4.4_UI_AS7Plugin_Test 2 (-170) 1 (-2) 0 (0) 0 (-169) - Feb 11 11:50:14 IST 2013 - -
RHQ CLI EAP6 28 (-14) 0 (-3) 0 (-28) 28 (+17) rhq.build.version Feb 11 11:46:16 IST 2013 Feb 11 11:49:48 IST 2013 00:03:32
Fresh Installation of RHQ 1 (0) 0 (0) 1 (0) 0 (0) - Dec 24 23:45:58 IST 2012 Dec 24 23:47:26 IST 2012 00:01:28
Check Resource Configuration 1124 (-37) 1122 (-36) 1 (-1) 0 (0) - Aug 23 16:30:28 IST 2012 - - Summary: 1575 1421 86 66 02:23:44
Test Suite Detaild View:
Test Suite: Import Resources
Group Name Total Passed Failed Skipped GuiLoginTest 1 0 1 0
Version Information 1 0 1 0
GImportResourcesTest 1 0 1 0
GuiLogoutTest 1 0 1 0 Total: 4 0 4 0 Test Suite: RHQ REST JAVA Client Test
Group Name Total Passed Failed Skipped Login Test Negative 2 2 0 0
check New Rest Api 1 1 0 0
Login Test Positive 1 1 0 0
List Status 1 1 0 0
Visit Platforms 1 0 1 0
Visit Platforms By Id 1 0 1 0
get Resource By Platform Name 1 0 1 0
get Resource By Platform Name And Category 1 0 1 0
get Resource By Category 1 0 1 0
get Resource By Paging 1 0 1 0
get Platform Xml 1 1 0 0
Validate Children 1 0 1 0
get Alerts For Resources 1 0 1 0
get Schedules For Resources 1 0 1 0
get Availability For Resources 1 0 1 0
get Availability History For Resources 1 0 1 0
get Root URI 1 1 0 0
get Json PWrapper 1 1 0 0
verify AS Server Presence 1 0 1 0
Check Platform Operations 1 0 1 0
Validate Schedules 1 0 1 0
Validate Metric Data Default 1 0 1 0
Validate Metric Data 1 0 1 0
Visit Alerts 1 1 0 0
Redirect From Definition 1 1 0 0
Alert Definitions 1 1 0 0
Alert Count 1 1 0 0
AlertSender 1 1 0 0
AlertSender_DirectEmails 1 1 0 0
AlertSender_Mobicents 1 1 0 0
AlertSender_NotExisting 1 1 0 0
get Event Sources 1 0 1 0
get Event Definitions 1 0 1 0
get Group 1 1 0 0
get Group With Params 1 1 0 0
get Metrics Schedule 1 0 1 0
get Metrics Schedule By Id 1 0 1 0
get Favorite Resources 1 1 0 0
get Favorite Groups 1 1 0 0 Total: 40 20 20 0 Test Suite: RHQ REST Groovy Client Test
Group Name Total Passed Failed Skipped Status 2 2 0 0
Login 3 3 0 0
Resource 3 3 0 0 Total: 8 8 0 0 Test Suite: RHQ 4.x core UI Test
Group Name Total Passed Failed Skipped GuiLoginTest 1 1 0 0
Version Information 1 1 0 0
Metric Collection Schedules validation 39 39 0 0
AlertDefinitionCreationTest 13 0 13 0
InventoryTest 11 11 0 0
BundleTest 4 4 0 0
TopLevelMenusTest 12 12 0 0
ReportsTest 7 7 0 0
DashboardTest 12 12 0 0
ResourcesTest 5 5 0 0
AdministrationTest 6 6 0 0
HelpTest 10 10 0 0
RecentOperationsTest 5 3 1 1
FavouriteTest 4 4 0 0
PluginsTest 52 52 0 0
Individualconfig 4 4 0 0
Configuration History 2 2 0 0
Group Config 3 3 0 0
SubNavigationMenuTests 2 2 0 0
Administration JSP page validation 6 6 0 0
Drift management-Create-[add/change/remove]-Delete 5 5 0 0
AlertHistoryValidationTest 13 0 13 0
AlertHistoryDeletionTest 13 0 13 0
AlertDefinitionDeletionTest 13 0 13 0
Scheduling Groups 4 4 0 0
Search groups... 6 6 0 0
Permissions Test 7 6 1 0
Alert Definition Template 6 6 0 0
CheckAlertDefTempCreated 1 0 1 0
Drift Definition Template 3 3 0 0
StorageAutoInventoryTest 1 0 1 0
StorageNode 2 0 2 0
Setup LDAP 1 1 0 0
GuiLDAPUserLoginTest 1 0 1 0
GuiLogoutTest 1 1 0 0 Total: 276 216 59 1 Test Suite: RHQ CLI JS/JAVA Test
Group Name Total Passed Failed Skipped Import all Resources 2 2 0 0
Examples from jon documentation 22 21 0 1
bz reproduction test 3 1 0 2
Examples from rhq documentation 4 3 0 1
Samples from CLI client 3 3 0 0
operation scheduling test 3 3 0 0
manager test 6 6 0 0
permission test 15 0 0 15
role test 2 1 0 1
subject test 2 2 0 0
drift test 1 1 0 0
DynaGroup definitions test 7 5 0 2
Bundles 15 5 0 10
schedule_Management_For_RHQ_Agent 1 1 0 0
stress test 5 0 0 5
Uninventory-Platforms-End 1 0 1 0 Total: 92 54 1 37 Test Suite: RHQ_4.4_UI_AS7Plugin_Test
Group Name Total Passed Failed Skipped GuiLoginTest 1 1 0 0
Version Information 1 0 0 0 Total: 2 1 0 0 Test Suite: RHQ CLI EAP6
Group Name Total Passed Failed Skipped Standalone_Discovery_StartCommand_Parameters 1 0 0 1
Domain_Discovery_StartCommand_Parameters 4 0 0 4
Uninventory_EAP_Servers 1 0 0 1
Inventory_EAP_Servers 1 0 0 1
Detect_ServerVersion 1 0 0 1
Standalone_Deployment 5 0 0 5
Standalone_BundleDeployment 1 0 0 1
Standalone_NetworkInterfaces 1 0 0 1
Domain_Deployment 11 0 0 11
Domain_Host_NetworkInterfaces 1 0 0 1
Uninventory_EAP_Servers_again 1 0 0 1 Total: 28 0 0 28 Test Suite: Fresh Installation of RHQ
Group Name Total Passed Failed Skipped GuiInstallationTest 1 0 1 0 Total: 1 0 1 0 Test Suite: Check Resource Configuration
Group Name Total Passed Failed Skipped GuiLoginTest 1 1 0 0
Version Information 1 1 0 0
CheckResourceConfiguration 1122 1120 1 0 Total: 1124 1122 1 0 Report Engine URL: https://mercury.lab.eng.pnq.redhat.com:8443/re
Report Generated on: Jul 17 18:30:00 IST 2013
_______________________________________________
jon-qa-list mailing list
jon-qa-list at redhat.com
https://post-office.corp.redhat.com/mailman/listinfo/jon-qa-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.fedorahosted.org/pipermail/rhq-devel/attachments/20130718/0d61e4cf/attachment-0001.html>
More information about the rhq-devel
mailing list