On Mon, 2010-03-01 at 17:34 -0500, Doug Ledford wrote:
One could argue that the current bodhi karma system is simply too
simplistic for real use cases. Maybe instead of just +1 -1, there
should be:
Fixes my problem
Works for me (someone testing that didn't necessarily have any of the
problem supposedly fixed by this update just noting that their system
still works ok with the update)
Doesn't fix my problem (but doesn't necessarily imply it's any worse
than before)
Causes new problems (which should, IMO, be an automatic veto of any push
to stable, requiring intervention to override)
I could see situations where you would want to push updates to stable if
say the update was supposed to solve multiple bugs, but turns out it
only solves a subset of those bugs and doesn't cause new ones, so you
would have some FMP, maybe some WFM, some DFMP, but no CNP. You'd
probably just need to leave it up to the maintainer to decided if the
bugs that are solved are important enough to push to stable before
respinning another attempt at the ones that weren't solved.
I've personally seen situations where this would be helpful with the
mdadm package when I had 5 or 6 bugs on a single update and only 4 of
them were actually solved. The update was still worth pushing while I
worked on the others again.
If you really wanted to get fancy, the FMP/DFMP options could be tied to
specific bugzillas reported against the update, and if you get a FMP for
each bugzilla listed in the update, plus at least 1 WFM, then you could
automatically push to stable. Would be much better than the 3 random
+1s you get now that don't indicate anything about test coverage or
anything like that. Also FMP/DFMP karma against a bug could be noted
both in the bodhi ticket as well as in the bug itself with a resultant
VERIFIED/FAILS_QA toggle to the bug status.
FMP + WFM
:)
--
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Fedora Talk: adamwill AT fedoraproject DOT org
http://www.happyassassin.net