#6383: Build a 'test' compose automatically when installer-related packages
change
-----------------------+-----------------------
Reporter: adamwill | Owner: rel-eng@…
Type: task | Status: new
Milestone: | Component: other
Resolution: | Keywords:
Blocked By: | Blocking:
-----------------------+-----------------------
Comment (by adamwill):
Once again, the problem I'm trying to solve here is testing at the
*distribution update* level, not at the *anaconda source commit* level.
Testing at the anaconda source commit level is much more up to the
anaconda team than something we should decide at the distribution level, I
think, though if we can build stuff that anaconda can consume for that
purpose, great. But the problem I'm trying to solve is not "how can we run
image tests when a commit lands in anaconda git", it's "how can we run
image tests when a Bodhi update appears". This is a *very important* level
of testing because it is what ultimately decides when new anaconda (or
other significant package) bits become part of 'Fedora' itself. And right
now we're not doing it well at all. Anaconda is *already* testing at the
source commit level themselves. QA is *already* testing at the level of
nightly and candidate composes. We're using different tests and blah, but
at least we're testing. Nobody is doing automated testing at the level of
distribution updates, and doing manual testing is very hard, yet it's a
really important level.
We already have fedmsgs for updates, that's not the bit we're missing. The
bits we're missing are:
* A bit which runs some kind of image compose in response to 'new update'
fedmsgs containing packages from some list
* (Possibly) bits for triggering the tests for those images (depending on
what tests we want to run and how we decide to build the images)
* A bit for somehow translating results from the tests that get run into
Bodhi-ese (whether that's a new form of karma, or filling out one of the
existing karma types, or something else) to achieve the 'influence whether
the package goes stable' decision
--
Ticket URL: <
https://fedorahosted.org/rel-eng/ticket/6383#comment:15>
Fedora Release Engineering <
http://fedorahosted.org/rel-eng>
Release Engineering for the Fedora Project