I've always heard that good practice is to compile as many things as you can as modules unless your sure you need to build it into the kernel. Realize that everything built into the kernel increases it's size and memory use. If there's some piece of hardware you very rarely use why not support it with a module rather than build it in the kernel?