#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: new Priority: major | Milestone: Automate installation test plan Component: core | Keywords: ----------------------+----------------------------------------------------- rats_install does not work after F14. after investigating in it, The following things should be updated:[[BR]] 1. install.img is compressed into initrd.img, remove the exist check 2. initrd.img is compressed as XZ compressed file instead of gzip compressed file, gzip in python has to be replaced
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: Automate installation test plan Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Changes (by hongqing):
* status: new => assigned
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: Automate installation test plan Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Comment (by kparal):
Hongqing, make sure you talk to anaconda team prior to spending too much time on this. There will be heavy changes in F17, it would be better to ask anaconda developers to give you a current boot.iso. Otherwise we might need to adjust rats_install again in a month or two.
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: Automate installation test plan Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Comment (by hongqing):
by searching, I found the #bug 736318. it seems it is difficult to compress the ks file into initrd.img which includes initramfs.img and install.img. [[BR]] I have contacted with anacodna team to see if F17 will keep the compressed format or not, and am still looking for an solution.
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: Automate installation test plan Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Comment (by kparal):
I have seen a blogpost some time ago from libvirt developers that virt- install is now able to inject a kickstart into existing initrd.img dynamically using a command line option. I don't know whether rats_install uses virt-install and I don't have the blogpost link ready, but I think it's worth the search if it could help.
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: Automate installation test plan Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Comment (by hongqing):
Replying to [comment:4 kparal]:
I have seen a blogpost some time ago from libvirt developers that virt-
install is now able to inject a kickstart into existing initrd.img dynamically using a command line option. I don't know whether rats_install uses virt-install and I don't have the blogpost link ready, but I think it's worth the search if it could help.
You are right. Stupid, I have forgot that, actually we are using it. rats_install now use the script minimon written by Will Woods, we have compressed it into initrd.img, if we change it to virtio, then we can avoid to touch the initrd.img, that why we choose virtio to replace minimon before. but virtio is a little complicated.
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: core | Resolution: Keywords: | ----------------------+----------------------------------------------------- Changes (by kparal):
* milestone: Automate installation test plan => 0.8.0
#390: update rats_install ----------------------+----------------------------------------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | ----------------------+----------------------------------------------------- Changes (by kparal):
* component: core => tests
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
Current rats_install code is now stuck with https://bugzilla.redhat.com/show_bug.cgi?id=785815 .
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I pushed the update as 7bd051d. Before closing this ticket we still need to:
1. solve bz 785815 2. solve problems with mangled characters in stage1/stage2.log 3. make sure compose_watcher correctly sends events for F17 composes (once F17 is branched) 4. add i386 and x86_64 bare metal machine to staging server to properly test out the new code
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
Problem #1 is fixed in origin/rats_install branch in commit 6ab6c4b (not tested).
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
ad 2) I found out that I can reproduce this problem when I run virt- install that automatically attaches to serial console and then display the serial console also in virt-manager. Two clients attached to a single serial console makes it send some characters to one console and some characters to the other console. Therefore text becomes garbage.
In our code we probably connect to the serial console multiple times. I didn't find the exact spot in the code though.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I tried today rats_install with F17 Alpha TC1 compose. It is broken. Unfortunately we can no longer use --initrd-inject. See https://bugzilla.redhat.com/show_bug.cgi?id=788141 .
The best shot here is to probably create a virt CDROM with kickstart file on it (see https://bugzilla.redhat.com/show_bug.cgi?id=788126 ).
Hongqing, can you try that out?
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
Initrd injection bug was resolved, we can use the original approach again.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
A few more bugs to take into account (sigh):
https://bugzilla.redhat.com/show_bug.cgi?id=790348
https://fedorahosted.org/fedora-infrastructure/ticket/3142
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
Another bug to work around:
https://bugzilla.redhat.com/show_bug.cgi?id=790594
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I have pushed a few workarounds and it seems to be working well now.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
To clarify, our test seems to be working well. Anaconda does not. It seems we currently end with failure because of https://bugzilla.redhat.com/show_bug.cgi?id=736993 . Since we fully depend on the serial console, this is currently a show-stopper for us.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I have executed this test many times and I haven't seen any problems with mangled characters with F17 composes. I think we will waive it for the moment and re-evaluate if it appears again.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I believe rats_install code is now working well. If there are no further changes you would like to do, Hongqing, I'll merge it to master tomorrow.
I'll leave this ticket open, we still need to handle items 3) and 4) from comment 9.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by hongqing):
Replying to [comment:19 kparal]:
I believe rats_install code is now working well. If there are no further
changes you would like to do, Hongqing, I'll merge it to master tomorrow.
I'll leave this ticket open, we still need to handle items 3) and 4)
from comment 9.
That is OK for me. Currently the rats_install kicked off by watching 'rawhide' at dl.fedoraproject.org/pub/alt/stage/, formerly the release eng team name it 'rawhide', but it seems they change it with F17 release, so I think we have to talk with the release eng team if we want to watch 'rawhide' at dl.fedoraproject.org/pub/alt/stage.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
Changes pushed to master as 4e5a17a.
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by kparal):
I have deployed the latest changes to our staging server. I moved two bare-metal machines from production to staging so that we can test it out. I have enabled the compose watcher on staging.
The compose watcher is firing events perfectly. It checks for new composes at download.fedoraproject.org/pub/fedora/linux/development/17/ . There is currently a problem in lorax for x86_64 compose, so it's not valid, but i386 compose was triggered fine. rats_install proceeded up to bootloader installation step, where it failed as expected due to anaconda bug.
Let's have it running there for a few days, but basically I believe we're all set. Now we need to convince anaconda team to fix their bugs.
The results are visible in @autoqa-results and also here: http://autoqa- stg.fedoraproject.org/resultsdb/frontend/search?type=Testcase&terms=rats_install
Mhmm, looking good!
#390: update rats_install ----------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-----------------------
Comment (by adamwill):
This is awesome stuff! Many thanks to both of you for your work on this.
#390: update rats_install --------------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: assigned Priority: major | Milestone: 0.8.0 Component: tests | Resolution: Keywords: missing_docs | Blocked By: Blocking: | --------------------------+----------------------- Changes (by kparal):
* keywords: => missing_docs
Comment:
This ticket is complete, but we are still missing some documentation. Hongqing, can you please create https://fedoraproject.org/wiki/AutoQA_tests/Rats_Install that would be similar to other pages in https://fedoraproject.org/wiki/Category:AutoQA_tests ? Thanks.
#390: update rats_install --------------------------+----------------------- Reporter: hongqing | Owner: hongqing Type: task | Status: closed Priority: major | Milestone: 0.8.0 Component: tests | Resolution: fixed Keywords: missing_docs | Blocked By: Blocking: | --------------------------+----------------------- Changes (by hongqing):
* status: assigned => closed * resolution: => fixed
Comment:
Replying to [comment:24 kparal]:
This ticket is complete, but we are still missing some documentation.
Hongqing, can you please create https://fedoraproject.org/wiki/AutoQA_tests/Rats_Install that would be similar to other pages in https://fedoraproject.org/wiki/Category:AutoQA_tests ? Thanks.
Please find the doc at [[https://fedoraproject.org/wiki/AutoQA_tests/Rats_Install]], and I will close the the ticket since everything is done.
autoqa-devel@lists.fedorahosted.org