I uninstall apps with apt-get remove usually, only sometimes with dpkg -r. So when I generate a size-sorted list of what's installed with dpkg, the things I removed with apt still show up. And I can no longer remove them with dpkg once they've been unistalled.

How can I get dpkg to know which apps I've removed with apt-get?