I think I might have hit the timeout with 0.98.15.z3 of iwhd. See log below for details.
Is this a regression or was a patch/method never adopted?
[root@cldmgr01 ~]# rpm -qi iwhd
Name : iwhd Relocations: (not relocatable)
Version : 0.98.15.z3 Vendor: (none)
Release : 1.el6 Build Date: Tue 16 Aug 2011 02:08:09 PM EDT
Install Date: Tue 16 Aug 2011 02:42:47 PM EDT Build Host: simbelmyne.zaitcev.lan
Group : System Environment/Libraries Source RPM: iwhd-0.98.15.z3-1.el6.src.rpm
Size : 427672 License: GPLv3
Signature : (none)
URL :
http://git.fedorahosted.org/git/?p=iwhd.git
Summary : Image WareHouse Daemon
Description :
Deltacloud image-warehouse daemon
[root@cldmgr01 ~]# tail -f /var/log/imagefactory.log
<target dev="hdc"/>
</disk>
</devices>
</domain>
2011-10-18 05:06:59,255 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3600/3600
2011-10-18 05:07:09,282 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3590/3600
2011-10-18 05:07:19,305 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3580/3600
2011-10-18 05:07:29,329 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3570/3600
2011-10-18 05:07:39,353 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3560/3600
2011-10-18 05:07:49,376 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3550/3600
2011-10-18 05:07:59,401 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3540/3600
2011-10-18 05:08:09,428 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3530/3600
2011-10-18 05:08:19,451 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3520/3600
2011-10-18 05:08:29,475 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3510/3600
2011-10-18 05:08:39,499 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3500/3600
2011-10-18 05:08:49,526 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3490/3600
2011-10-18 05:08:59,550 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3480/3600
2011-10-18 05:09:09,578 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3470/3600
2011-10-18 05:09:19,603 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3460/3600
2011-10-18 05:09:29,629 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3450/3600
2011-10-18 05:09:39,655 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3440/3600
2011-10-18 05:09:49,675 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3430/3600
2011-10-18 05:09:59,694 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3420/3600
2011-10-18 05:10:09,719 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3410/3600
2011-10-18 05:10:19,743 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3400/3600
2011-10-18 05:10:29,763 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3390/3600
2011-10-18 05:10:39,785 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3380/3600
2011-10-18 05:10:49,815 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3370/3600
2011-10-18 05:10:59,840 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3360/3600
2011-10-18 05:11:09,861 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3350/3600
2011-10-18 05:11:19,887 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3340/3600
2011-10-18 05:11:29,914 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3330/3600
2011-10-18 05:11:39,945 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3320/3600
2011-10-18 05:11:49,974 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3310/3600
2011-10-18 05:11:59,999 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3300/3600
2011-10-18 05:12:10,030 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3290/3600
2011-10-18 05:12:20,056 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3280/3600
2011-10-18 05:12:30,083 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3270/3600
2011-10-18 05:12:40,111 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3260/3600
2011-10-18 05:12:50,140 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3250/3600
2011-10-18 05:13:00,164 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3240/3600
2011-10-18 05:13:10,198 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3230/3600
2011-10-18 05:13:20,224 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3220/3600
2011-10-18 05:13:30,251 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3210/3600
2011-10-18 05:13:40,280 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Waiting for
tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8 to finish installing, 3200/3600
2011-10-18 05:13:45,446 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3586)
Message: Exception caught in ImageFactory
2011-10-18 05:13:45,447 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3586)
Message: Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/imagefactory/builders/FedoraBuilder.py", line
172, in build_upload
libvirt_xml = self.guest.install(self.app_config["timeout"])
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1154, in install
return self.do_install(timeout, force, 0)
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1139, in do_install
self.wait_for_install_finish(dom, timeout)
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 451, in
wait_for_install_finish
raise oz.OzException.OzException("No disk activity in %d seconds, failing" %
(inactivity_timeout))
OzException: No disk activity in 300 seconds, failing
2011-10-18 05:13:45,447 INFO oz.Guest.FedoraGuest pid(3586) Message: Cleaning up guest
named tmpl1-36f6669e-7f0f-44b5-8ab3-41c66daddeb8
2011-10-18 05:13:45,944 DEBUG imagefactory.BuildJob.BuildAdaptor pid(3586) Message:
Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed
status from BUILDING to FAILED
2011-10-18 05:13:45,945 INFO oz.Guest.FedoraGuest pid(3586) Message: Cleaning up after
install
2011-10-18 05:13:45,945 DEBUG oz.Guest.FedoraGuest pid(3586) Message: Removing modified
ISO
2011-10-18 05:13:45,983 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3586)
Message: Exception caught in ImageFactory
2011-10-18 05:13:45,984 DEBUG imagefactory.builders.BaseBuilder.FedoraBuilder pid(3586)
Message: Traceback (most recent call last):
File
"/usr/lib/python2.6/site-packages/imagefactory/builders/FedoraBuilder.py", line
124, in build_image
self.build_upload(build_id)
File
"/usr/lib/python2.6/site-packages/imagefactory/builders/FedoraBuilder.py", line
172, in build_upload
libvirt_xml = self.guest.install(self.app_config["timeout"])
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1154, in install
return self.do_install(timeout, force, 0)
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 1139, in do_install
self.wait_for_install_finish(dom, timeout)
File "/usr/lib/python2.6/site-packages/oz/Guest.py", line 451, in
wait_for_install_finish
raise oz.OzException.OzException("No disk activity in %d seconds, failing" %
(inactivity_timeout))
OzException: No disk activity in 300 seconds, failing
2011-10-18 05:13:45,985 DEBUG imagefactory.BuildJob.BuildAdaptor pid(3586) Message:
Raising event with agent handler (<ImageFactoryAgent(Thread-1, initial)>), changed
status from FAILED to FAILED
----- Original Message -----
From: "Chris Lalancette" <clalance(a)redhat.com>
To: "Steven Dake" <sdake(a)redhat.com>
Cc: aeolus-devel(a)lists.fedorahosted.org, "Chris Lalancette"
<clalance(a)redhat.com>
Sent: Tuesday, June 14, 2011 10:58:23 AM
Subject: Re: [PATCH 2/3] Increase hard-coded 300 second timer to 1000 seconds.
On 06/10/11 - 01:11:12PM, Steven Dake wrote:
> > Yeah, OK. As we discussed on IRC, this is probably because you
> > are doing
> > a URL based install from a far-away location, and it is taking
> > more than
> > 5 minutes to fetch the second anaconda stage. The attached patch
> > monitors
> > the network for activity as well; can you give it a whirl?
> >
> > Thanks,
>
> No go on this patch - this version fails:
>
> oz.OzException.OzException: No disk or network activity in 300
> seconds,
> failing
All right. Instead of poking around in the dark, the attached patch
monitors
both the network and all disk devices, and also spews debug data
about activity
that we are seeing. Can you try this patch, and send me the output?
The
output will most likely be very large, so I suggest redirecting
stdout to a
file and then just mailing me the file directly.
Thanks
--
Chris Lalancette
_______________________________________________
aeolus-devel mailing list
aeolus-devel(a)lists.fedorahosted.org
https://fedorahosted.org/mailman/listinfo/aeolus-devel