Are you using the nvidia binary drivers? On my system at
work attempting to exit X (which logging out apparently
does) sometimes seems to crash my system (perhaps 10%
of the time). I stick with nvidia though because the
nouveau drivers crash in the middle of sessions, not waiting
for me to log out :-).