... Really what I have in mind here is stuff like "Video playback locks
up the machine", "OpenGL locks up the machine", "Second Life hangs
the X
server", "World of Warcraft crashes the X server", "This web site
crashes the X server", "Rosegarden crashes the X server". All of which
are entirely automateable, though the "hard locks the machine" cases
will require some sort of hardware watchdog arrangement...
https://bugzilla.redhat.com/show_bug.cgi?id=441665
https://bugzilla.redhat.com/show_bug.cgi?id=474973
https://bugzilla.redhat.com/show_bug.cgi?id=474977
https://bugzilla.redhat.com/show_bug.cgi?id=487432
At any rate, *some* testing is way better than none at all.
Sounds reasonable, but how do you turn SMOLT profiles into real test
machines? In the worst case you will end up building one test server for
every single bug. Without proper hardware virtualization (which we will
not see for the next 10-20 years) that testing thing would be more
expensive than just sending certified hardware to every user for free ;)