I can't speak for Live USB, but using Aptitude to upgrade packages on a harddrive install of Knoppix works just fine, though I must say the Knoppix installer leaves a lot to be desired(no way of...