Hi,

For transparency, I am sharing information about QE test automation for RHQ : 


Regards,

Michael Foley
QE Lead, JBoss Operations Network 


From: noreply@redhat.com
To: jon-qa-list@redhat.com
Sent: Monday, July 29, 2013 9:00:02 AM
Subject: [jon-qa-list] Summary report for 'RHQ Overnight Full Report'

Report Engine - Email ReportHello, This is auto generated email from Report Engine. It's based on RHQ Overnight Full Report
Test Suite Name Total Passed Failed Skipped Build Start Time End Time Duration
RHQ REST JAVA Client Test40 (0)20 (0)20 (0)0 (0)4.9.0-SNAPSHOT (9674555)Jul 28 23:38:08 IST 2013Jul 28 23:38:26 IST 201300:00:17
RHQ REST Groovy Client Test8 (0)8 (0)0 (0)0 (0)4.9.0-SNAPSHOT (9674555)Jul 28 23:37:29 IST 2013Jul 28 23:37:35 IST 201300:00:05
RHQ 4.x core UI Test276 (0)267 (-1)8 (+1)1 (0)4.9.0-SNAPSHOT (9674555)Jul 28 22:18:38 IST 2013Jul 28 23:36:40 IST 201301:18:01
Import Resources4 (0)4 (0)0 (0)0 (0)4.9.0-SNAPSHOT (9674555)Jul 28 22:16:47 IST 2013Jul 28 22:17:56 IST 201300:01:08
RHQ_4.4_UI_AS7Plugin_Test210 (0)134 (+14)35 (+7)41 (-21)4.9.0-SNAPSHOT (9674555) EAP 6.1.0.GAJul 28 15:46:17 IST 2013Jul 28 21:07:11 IST 201305:20:52
RHQ CLI EAP644 (0)39 (+5)5 (-1)0 (-4)4.9.0-SNAPSHOT (9674555) EAP 6.1.0.GAJul 28 13:58:39 IST 2013Jul 28 15:45:24 IST 201301:46:33
RHQ CLI JS/JAVA Test92 (0)54 (+1)1 (-1)37 (0)4.9.0-SNAPSHOT (59fa894)Jun 30 22:12:46 IST 2013Jun 30 22:56:26 IST 201300:43:39
Fresh Installation of RHQ1 (0)0 (0)1 (0)0 (0)-Dec 24 23:45:58 IST 2012Dec 24 23:47:26 IST 201200:01:28
Check Resource Configuration1161 (+5)1158 (+3)2 (+2)0 (0)-Aug 22 16:14:05 IST 2012--
Summary:18361684727909:12:07

Test Suite Detaild View:

Test Suite: RHQ REST JAVA Client Test
Group Name Total Passed Failed Skipped
Login Test Negative2200
check New Rest Api1100
Login Test Positive1100
List Status1100
Visit Platforms1010
Visit Platforms By Id1010
get Resource By Platform Name1010
get Resource By Platform Name And Category1010
get Resource By Category1010
get Resource By Paging1010
get Platform Xml1100
Validate Children1010
get Alerts For Resources1010
get Schedules For Resources1010
get Availability For Resources1010
get Availability History For Resources1010
get Root URI1100
get Json PWrapper1100
verify AS Server Presence1010
Check Platform Operations1010
Validate Schedules1010
Validate Metric Data Default1010
Validate Metric Data1010
Visit Alerts1100
Redirect From Definition1100
Alert Definitions1100
Alert Count1100
AlertSender1100
AlertSender_DirectEmails1100
AlertSender_Mobicents1100
AlertSender_NotExisting1100
get Event Sources1010
get Event Definitions1010
get Group1100
get Group With Params1100
get Metrics Schedule1010
get Metrics Schedule By Id1010
get Favorite Resources1100
get Favorite Groups1100
Total:4020200
Test Suite: RHQ REST Groovy Client Test
Group Name Total Passed Failed Skipped
Status2200
Login3300
Resource3300
Total:8800
Test Suite: RHQ 4.x core UI Test
Group Name Total Passed Failed Skipped
GuiLoginTest1100
Version Information1100
Metric Collection Schedules validation393900
AlertDefinitionCreationTest131210
InventoryTest111100
BundleTest4400
TopLevelMenusTest121200
ReportsTest7700
DashboardTest121200
ResourcesTest5500
AdministrationTest6600
HelpTest101000
RecentOperationsTest5311
FavouriteTest4400
PluginsTest525200
Individualconfig4400
Configuration History2200
Group Config3300
SubNavigationMenuTests2200
Administration JSP page validation6600
Drift management-Create-[add/change/remove]-Delete5500
AlertHistoryValidationTest131300
AlertHistoryDeletionTest131300
AlertDefinitionDeletionTest131300
Scheduling Groups4400
Search groups...6600
Permissions Test7610
Alert Definition Template6600
CheckAlertDefTempCreated1010
Drift Definition Template3300
StorageAutoInventoryTest1010
StorageNode2020
Setup LDAP1100
GuiLDAPUserLoginTest1010
GuiLogoutTest1100
Total:27626781
Test Suite: Import Resources
Group Name Total Passed Failed Skipped
GuiLoginTest1100
Version Information1100
GImportResourcesTest1100
GuiLogoutTest1100
Total:4400
Test Suite: RHQ_4.4_UI_AS7Plugin_Test
Group Name Total Passed Failed Skipped
GuiLoginTest1100
Version Information1100
Standalone_AutodetectConfiguration1100
DetectServerVersion1100
Standalone_SocketBindingGroups3300
Standalone_Logging_Subsystem16934
Standalone_SecuritySubsystem6420
Standalone_Naming_Subsystem1100
Standalone_SignalServerReload2110
Standalone_Mail_Subsystem13346
Standalone_InfinispanSubsystem9333
Standalone_Web_Subsystem7601
Standalone_ResourceCreation2200
Standalone_Monitoring3111
Standalone_Deployment201820
Standalone_JMSDestinations4400
Standalone_Datasources163211
Standalone_SystemProperties3300
Standalone_ResourceConfiguration5500
Standalone_OSGI_Child_Configuration_Test6006
Standalone_Transactions_Test1100
Standalone_JAXR_Test4310
Standalone_Operations4400
Standalone_ManualImport282251
Domain_AutodetectConfiguration1100
Domain_ResourceConfiguration3300
Domain_SystemProperties12723
Domain_ResourceCreation2200
Domain_Monitoring3120
Domain_JMSDestinations4211
Domain_Deployment6213
Domain_Operations4400
Domain_ManagedServersManagement7700
Domain_ServerGroupsManagement10451
GuiLogoutTest1100
Total:2101343541
Test Suite: RHQ CLI EAP6
Group Name Total Passed Failed Skipped
Standalone_Discovery_StartCommand_Parameters151500
Domain_Discovery_StartCommand_Parameters4400
Uninventory_EAP_Servers1100
Inventory_EAP_Servers1100
Detect_ServerVersion1100
Standalone_Deployment5410
Standalone_BundleDeployment1100
Standalone_NetworkInterfaces1010
Standalone_MailSubsystemTest1010
Standalone_BZ918677Test1100
DeployAndRestartSampleTest1100
Domain_Deployment111010
Domain_NetworkInterfaces1010
Total:443950
Test Suite: RHQ CLI JS/JAVA Test
Group Name Total Passed Failed Skipped
Import all Resources2200
Examples from jon documentation222101
bz reproduction test3102
Examples from rhq documentation4301
Samples from CLI client3300
operation scheduling test3300
manager test6600
permission test150015
role test2101
subject test2200
drift test1100
DynaGroup definitions test7502
Bundles155010
schedule_Management_For_RHQ_Agent1100
stress test5005
Uninventory-Platforms-End1010
Total:9254137
Test Suite: Fresh Installation of RHQ
Group Name Total Passed Failed Skipped
GuiInstallationTest1010
Total:1010
Test Suite: Check Resource Configuration
Group Name Total Passed Failed Skipped
GuiLoginTest1100
Version Information1100
CheckResourceConfiguration1159115620
Total:1161115820
Report Engine URL: https://mercury.lab.eng.pnq.redhat.com:8443/re
Report Generated on: Jul 29 18:30:00 IST 2013

_______________________________________________
jon-qa-list mailing list
jon-qa-list@redhat.com
https://post-office.corp.redhat.com/mailman/listinfo/jon-qa-list