when i had to make a kernel, i found that there was no kernel tree in linux-2.4.20-xfs, just the headers, etc.

i downloaded a fresh copy from kernel.org and started cutting down the zillions of modules, and unneeded stuff.

you are trying to compile what isn't there.

dave