Hi all,
I have some things to propose. We have some missing test cases and criteria. I'd like
to know your opinion on this, so please, let me know if you have some notes.
I propose these changes in test cases:
*
https://fedoraproject.org/wiki/QA:Testcase_Mediakit_ISO_Size is marked as alpha release
level. I propose to change it to beta. We have beta criterion "The network
installation image, DVD image, and live images for release-blocking desktops must meet
current size requirements" for this.
*
https://fedoraproject.org/wiki/QA:Testcase_Kickstart_Http_Server_Ks_Cfg is associated
with alpha release. I propose to change it to beta level, where is criterion: The
installer must be able to use all kickstart delivery methods.
I propose these new criteria:
* Final criterion: "There must be published correct checksum for each ISO media. Also
if there is embedded checksum on ISO media, it must be correct." - I think we should
check this. We have already test case. I propose to change release level for this test
case to final.
* Final criterion: "The installer must be able to run memory test." - again, we
have test case for this yet. I'd move it to final level.
* Beta criterion: "The installer must be able to install system with minimal usable
set of packages." - there is test case associated with alpha, I'd change it to
beta release level
* Alpha criterion: "The installer must be able to download and apply updates.img file
using a HTTP url and use it" - we have test cases for this, but no criterion. I think
it's pretty importing -> alpha
* Beta criterion: "The installer must be able to use updates.img obtained by any
supported way" - I think, that this should be at criteria too
* Final criterion: "The installer must be able to handle the failure and report the
issue. The installer must be also able to access debug mode." - we have test case for
this. It's useful to have this feature.
I propose to remove
https://fedoraproject.org/wiki/QA:Testcase_Boot_Methods_efidisk.img
test case as we don't need it anymore.
I propose to enhance alpha criterion "The installer must be able to report failures
to Bugzilla, with appropriate information included" to "The installer must be
able to report failures to Bugzilla, remote system and local disk, with appopriate
information included" - especially saving failures to disk is important for
installation without net access
And finaly, I propose these two test cases, both I'd like to have in final release
level:
*
https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Install_wi... -
this test case is related to final criterion - "The installed system must run
normally if the user chooses to install without SELinux" - I have one note on this.
There is used noselinux option, but it doesn't work now. I filled bug
https://bugzilla.redhat.com/show_bug.cgi?id=784828 there is another option with the same
effect - selinux=0 and this one works fine, but Anaconda have noselinux in documentation,
so it should work and they're working on it.
*
https://fedoraproject.org/wiki/User:Pschindl/Draft_QA_Testcase_Services_s... - this one
is related to final criterion "All services in a default install must start
properly"
Regard
Petr Schindler