On 10/09/2015 06:17 PM, Fedora compose checker wrote:
No missing expected images.
Images in this compose but not 23 Branched 20151008:
Cloud docker x86_64
Images in 23 Branched 20151008 but not this:
Workstation disk raw armhfp
Failed openQA tests: 48 of 52
ID: 5182 Test: i386 kde_live default_install ID: 5181 Test: x86_64 workstation_live default_install@uefi ID: 5180 Test: x86_64 workstation_live default_install ID: 5179 Test: i386 workstation_live default_install ID: 5178 Test: x86_64 kde_live default_install ID: 5177 Test: i386 generic_boot default_install ID: 5176 Test: x86_64 generic_boot default_install@uefi ID: 5175 Test: x86_64 generic_boot default_install ID: 5174 Test: i386 universal upgrade_desktop_32bit ID: 5173 Test: i386 universal server_lvmthin ID: 5172 Test: i386 universal server_ext3 ID: 5171 Test: i386 universal server_btrfs ID: 5170 Test: i386 universal server_software_raid ID: 5169 Test: i386 universal server_simple_encrypted ID: 5168 Test: i386 universal server_repository_http_graphical ID: 5167 Test: i386 universal server_scsi_updates_img ID: 5166 Test: i386 universal package_set_minimal ID: 5165 Test: x86_64 universal server_no_swap@uefi ID: 5164 Test: x86_64 universal server_lvmthin@uefi ID: 5163 Test: x86_64 universal server_ext3@uefi ID: 5162 Test: x86_64 universal server_btrfs@uefi ID: 5161 Test: x86_64 universal server_software_raid@uefi ID: 5160 Test: x86_64 universal server_multi_empty@uefi ID: 5159 Test: x86_64 universal server_simple_free_space@uefi ID: 5158 Test: x86_64 universal server_simple_encrypted@uefi ID: 5157 Test: x86_64 universal server_delete_partial@uefi ID: 5156 Test: x86_64 universal server_delete_pata@uefi ID: 5155 Test: x86_64 universal server_sata_multi@uefi ID: 5154 Test: x86_64 universal european_language_install ID: 5153 Test: x86_64 universal server_shrink_ntfs ID: 5152 Test: x86_64 universal server_shrink_ext4 ID: 5151 Test: x86_64 universal server_updates_img_local ID: 5147 Test: x86_64 universal server_no_swap ID: 5146 Test: x86_64 universal server_lvmthin ID: 5145 Test: x86_64 universal server_ext3 ID: 5144 Test: x86_64 universal server_btrfs ID: 5143 Test: x86_64 universal server_software_raid ID: 5142 Test: x86_64 universal server_multi_empty ID: 5141 Test: x86_64 universal server_simple_free_space ID: 5140 Test: x86_64 universal server_simple_encrypted ID: 5139 Test: x86_64 universal server_delete_partial ID: 5138 Test: x86_64 universal server_repository_http_variation ID: 5137 Test: x86_64 universal server_repository_http_graphical ID: 5136 Test: x86_64 universal server_mirrorlist_graphical ID: 5135 Test: x86_64 universal server_delete_pata ID: 5133 Test: x86_64 universal server_scsi_updates_img ID: 5132 Test: x86_64 universal server_sata_multi ID: 5131 Test: x86_64 universal package_set_minimal
These failed test IDs are all nice to see, but they don't say much to the uninitiated. :) These tests are comparing screenshots pixel by pixel, right? Are the screenshots and other test results publicly available somewhere?
How are the screenshots rebased? Is it all manual work?
Is there any way to link to the failed screenshots from the status mail so that I could just follow links and see what's changed?
Sorry for bombing you with all the questions. I think it's totally awesome that we have nightly testing, thanks for getting this set up!
Thanks, Kalev