On Mon, 2014-10-13 at 23:59 -0700, Adam Williamson wrote:
21's Install/Installation results are a bit messy because of the
extensive changes to that page during Alpha and Beta (it was renamed
from Install to Installation, for a start...); tomorrow I'll spend a bit
of time modifying the pre-Beta TC2 pages to match the current format, so
relval's results look nicer. I *did* do some mental design on a sort of
pre-processor function which would try to handle changes to the page
layout, but it got very complex in a hurry and I figured it makes more
sense to just clean up the pages when this sort of thing happens.
So I had another idea for cleaning results at the pool today and
thought, what the hell, I'll write it. And it works!
testcase_stats.py now has a post_process() function which does some
crazy voodoo magic to clean up the results before they're fed into the
HTML renderer. It merges tests which moved around the page between
composes, and re-sorts the tests into sections, which cleans up the
cases where new tests and sections got added in later composes and
otherwise would wind up stuck on the bottom of the results page, with
duplicated sections.
There's a rather heroic docstring which explains all the magic. You can
also pass --nopostproc to turn the post-processor off (it's designed to
drop right out) and compare the results you get.
I've uploaded results for every release from 12 to 21 - with the
post-processor enabled - to
https://www.happyassassin.net/testcase_stats/ . They look pretty good to
me.
I really should stop twiddling with this now, and do some real work :)
(this code is just in git master for now, not released. it required
changes to both relval and wikitcms).
--
Adam Williamson
Fedora QA Community Monkey
IRC: adamw | Twitter: AdamW_Fedora | XMPP: adamw AT happyassassin . net
http://www.happyassassin.net