But that would take an awful lot of time, plus, I don't remember all of the packages that have been installed
Is there a list somewhere on my system with all the packages I ever had maybe? Then I could write a script that compares that list with the packages that I have at the moment, and do a dpkg --purge if it's not there anymore..