#84: Define install matrix baseline
--------------------------+-------------------------------------------------
Reporter: jlaska | Owner:
Type: enhancement | Status: new
Priority: major | Milestone: Fedora 14
Component: Wiki | Version:
Resolution: | Keywords: retrospective
--------------------------+-------------------------------------------------
Comment (by rhe):
This was the scariest part for me in F13 validation tests.:o I often
hesitated whether some certain test results should be moved or not. Here
are some draft thoughts from me:
* 1. Release-eng(or the anaconda group) tells the detailed changes in
anaconda and packages (related to install and reboot such as plymouth. We
can also diff package changes) between versions. Only results from
unchanged tests can be moved.
* 2. Pass results in previous version can be moved, but once they failed
in pre-previous(or before) version in this candidate, they can't be moved.
* 3. At least keep one test in each test area to be tested without moving
result.
* 4. Tests grouped by five media can not moved.(Should they?)
* 5. Some "particular" cases like shrink, encrypted and ...(?) should not
be moved.
These are just some thoughts on my mind now. Feel free to correct and add.
And I think this part should be added in
[
https://fedoraproject.org/wiki/QA/SOP_Release_Validation_Test_Event
SOP_Release_Validation_Test_Event]
--
Ticket URL: <
https://fedorahosted.org/fedora-qa/ticket/84#comment:1>
Fedora QA <
http://fedorahosted.org/fedora-qa>
Fedora Quality Assurance