yes there is a 2Gb sizelimt to some versions of fat32.
M$ has curtailed their own filesystem for some reason (it SHOULD be 4G -1b or in other words 2^32b).
use some linux filesystem for it that should work. ext2, ext3 or reiserfs would work, my preference would be ext3 folowed by reiserfs.