I'm in somewhat the same boat here, using knoppix 3.4 with kernel 2.4.26 and trying to install the nvidia drivers. I didn't try the NVIDIA shell script from nvidia.com first, am trying to go "the debian way" and more or less follow the README in /usr/share/doc/nvidia-kernel-source. Since (#1 method) I couldn't find a matching kernel-headers package for 2.4.26 (from uname -r) but only 2.4.26-1, I'm going with a full kernel rebuild and reinstall I guess.
I apt-get installed "nvidia-kernel-source knvidia-kernel-common kernel-source-2.4.26". I installed and applied the 'debian-kernel-patch-2.4.26' and 'kernel-patch-preempt-2.4' pkgs, copied over the .config from /boot/config-2.4.26 to /usr/src/linux/.config (/usr/src/linux sym links to new kernel source). I ran 'make menuconfig' and am doing 'make-kpkg kernel_image' now and waiting... I'll let you know how it turns out.
Isn't there a better way to do this? Anyone else have better luck or ever try 'knx-live-inst' to install nvidia before an hdinstall?

GIGABYTE A520M DS3H AC AMD AM4 Motherboard mATX
$59.99
ASUS PRIME Z890-P WIFI Z890 LGA 1851 ATX motherboard, Intel® Core™ Ultra Series
$235.99
Corsair RMe RM850e 850W 80 Plus Gold Fully Modular Low Noise Certified Refurb
$58.99
Gigabyte GA-B85M-D3H Motherboard
$54.99
Asus Prime B660M-A AC D4 Motherboard Intel LGA 1700 14th 13th 12th Gen DDR4
$79.99
GIGABYTE B365 HD3 LGA1151 Intel 9th Gen motherboard
$59.99
Intel H81 Motherboard M.2 NVMe LGA 1150 mATX w/ IO Shield (Random Slot Color)
$29.90
MSI B550M PRO-VDH Micro-ATX Motherboard - AMD AM4, Ryzen 5000/4000/3000 Ready, P
$71.49
GIGABYTE - A620M S2H AM5 DDR5 M-ATX Motherboard
$65.00
MSI Pro B760-P ATX Motherboard, DDR4, LGA 1700, WiFi Intel
$125.00