I managed to fix the problem! I found a tip somewhere to remove .Xauthority file. After that everything worked flawlessly.