I've made a nice LiveCD on Fat32. Works very nicely, but no persistence of course.
I think it's likely the LiveUSB may have to be on ext2 or ext3.
A GUI for making the LiveUSB is apparently in preparation right now.