Problem solved! It's complicated; the best explanation is here.

Basically, a GTK theme called Geramik was bossing Knoppix around and imposing its ugly view of what buttons should look like on applications built with GTK. (Check that link above if all of this is gibberish.)

So you can liberate Knoppix 3.3 from Geramik. Go look to find out how.