remove the icons, make a new icon or rename the working one to whatever you want (just leftklick and properties).
same with the directories.
you could move the mountpiont to /floppy if you wish, just edit in /etc/fstab (textfile).
the line should look something like this (from memory so...) if you want it mounted on /floppy (make the dir /floppy first as root)
Code:
/dev/fd0         /floppy      auto        noauto,owner     0   0
it might be reset on reboot as some variants of knopix installs do that, ask again