#400: Watchers get stuck sometimes and hang for days ----------------------+------------------------- Reporter: kparal | Owner: Type: defect | Status: new Priority: major | Milestone: Hot issues Component: watchers | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-------------------------
Comment (by mkrizek):
So far, I have found out that if I set network delay to 2 minutes ([http://stackoverflow.com/questions/614795/simulate-delayed-and-dropped- packets-on-linux how]?) while koji-bodhi watcher is running, the communication between the watcher and koji stops (I see no packets via wireshark). I would expect the communication to be delayed. If I set the delay back to the previous state (no delay), the communication does not continue and the watcher still hangs - this is maybe what happened on the production server, koji got busy and the watcher hung.
Note: if I do the same with the delay of 30 seconds, the communication continues after unsetting the delay but resulting in xml.parsers.expat.ExpatError: unclosed token, which seems like delayed tokens were lost.
I am not sure if I am on the right path but I will investigate further if this is a problem in koji, xmlrpc or something else.