On 11.01.2016 11:03, Jan Chaloupka wrote:
Hi,
cockpit integration tests have proofed to be very useful for discovering
regression and bugs for kubernetes.
The current workflow of updating kubernetes is to rebase/rebuilt
kubernetes, run very basic tests and hope it will work.
The workflow did not show up to be much bulletproof.
Would it be possible to run kubernetes related cockpit integration tests
on each new build of kubernetes in rawhide?
Something like this?
$ cd cockpit/test
$ sudo ./vm-prep # needed the first time
$ koji download-build --arch=x86_64 --arch=noarch <kubernetes-build-id>
$ ./testsuite-prepare
$ ./vm-install kubernetes*.rpm
$ ./check-kubernetes -tvs
Did you try something like that. Some deps described in test/README need
to be installed.
There are also docker images that stage all this with the deps [1], but
they probably need some tweaking for this use case ... and you may want
to start simple as above.
[1]
https://github.com/cockpit-project/cockpituous/tree/master/verify
Once I tried to run the
tests and ended up with downloading a lot of images each over 1GB.
The above will download some unnecessary images. See where the
testsuite-prepare shell script calls vm-download... Only the $BUILD_OS
(default fedora-23) should be necessary in your case.
But for starters that shouldn't be a big problem right?
After you've tried this out and it works, there's obviously lots of room
for tweaking it and customizing the script you'll use.
How
hard it would be to write down a simple script that would expect
kubernetes build and distribution? As a result, it would set everything
up and run required tests (without user intervention). Or if possible to
use your system (possibly Jenkins?) and periodically run integration
tests (or with a suitable trigger).
See above for the beginnings of such a script. And ask Ari (CC'd) about
Jenkins. I believe his Jenkins instance could run such a script no?
Stef