I also had this problem a few times, and now it's fine. When the mouse wasn't responding, I switched the shell and went back into window mode (ctrl alt F*). Then it started working.