Coming from a XP/ME background, I know that I need to go through the control panel to properly remove an application on it.

Do I need to do the same in KNOPPIX/linux or I can just remove the directory containing the application ? How about the icons/links on the KDE desktop ? I see a lot of applications on the 'start menu' of KDE which I want to remove.