I experience the same symptoms with my mouse when I start X.
I have to move the mouse a lot to make it start.
I tried letting it set for a while after logon to see if it would start responding
on its own but no matter how long it sets idle, I sill must move the mouse
for at least 10 seconds before it will respond.

I thought I had set something wrong.
I'm sorry you guys are having a problem but I'm glad it's not just me.