#400: Watchers get stuck sometimes and hang for days ----------------------+------------------------- Reporter: kparal | Owner: Type: defect | Status: new Priority: major | Milestone: Hot issues Component: watchers | Resolution: Keywords: | Blocked By: Blocking: | ----------------------+-------------------------
Comment (by kparal):
Replying to [comment:1 mkrizek]:
So far, I have found out that if I set network delay to 2 minutes
([http://stackoverflow.com/questions/614795/simulate-delayed-and-dropped- packets-on-linux how]?) while koji-bodhi watcher is running, the communication between the watcher and koji stops (I see no packets via wireshark). I would expect the communication to be delayed. If I set the delay back to the previous state (no delay), the communication does not continue and the watcher still hangs - this is maybe what happened on the production server, koji got busy and the watcher hung.
Great, that seems to be the same problem. The hung connection was "estabilished", but obviously no data flowed.
It's possible that the Koji library doesn't expect the remote side to completely stop responding over the XMLRPC connection and just waits for eternity. We have to find out how to set some timeouts.