sure recompile the kernel and remove all floppysupport.
then remove all floppylines in /etc/fstab, now check the /etc/rcXXX files for revferences to floppy.
it should now be fairly clean from floppysupport
then apt-get remove
any apparent floppy software and it should be even more clean.