Right, the binaries are made specialy for your system.

But I don't mind a slightly slower peice of software if I can get it on apt-get.

Of course sometimes you have to compile, good thing is knoppix has alot of the most used and libaries so you can usually compile without any real problems.