I have finally managed to get Oracle 10g RDBMS to successfully install on Knoppix 3.4(including the relinking). I have put together a short installation guide that will help make the installation a breeze.

Here ya go:
PreRequsites
Trick oracle into thinking that we are installing oracle rdbms on a supported linux distribution:
echo "Red Hat Enterprise Linux AS release 3 (Taroon)" > /etc/redhat-release

Ensure you have swap space equal to at least twice the amount of memory.

Creating Oracle User Accounts
su - root
groupadd dba #group of users to be granted with SYSDBA privilege
groupadd oinstall # group owner of Oracle files
useradd -c "Oracle software owner" -g oinstall -G dba oracle
passwd -d /home/oracle -s /bin/bash oracle

Creating Oracle Directories
In this example, make sure that the /opt filesystem is large enough, see Oracle Disk Space for more information. If /opt is not on a separate filesystem, then make sure the root filesystem "/" has enough space.
su - root
mkdir /opt/oracle
mkdir /opt/oracle/product
mkdir /opt/oracle/product/10g
chown -R oracle.oinstall /opt/oracle

Downloading and Unpacking Oracle Software
gunzip ship.db.cpio.gz
cpio -idmv<ship.db.cpio
rm ship.db.cpio
chown -R oracle.oinstall Disk1 # cpio unzips the files into Disk1 directory

Changing System Parameters
Change kernel parameters by adding the following lines in /etc/sysctl.conf:
kernel.shmall = 2097152
kernel.shmmax = 2147483648
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
fs.file-max = 65536
net.ipv4.ip_local_port_range = 1024 65000

To make these above parameters persistent type:
sysctl -e -p /etc/sysctl.conf

Use the following commands to check the values:
/sbin/sysctl -a | grep sem
/sbin/sysctl -a | grep shm
/sbin/sysctl -a | grep file-max
/sbin/sysctl -a | grep ip_local_port_range

Add the following lines to /etc/security/limits.conf file:
* soft nproc 2047
* hard nproc 16384
* soft nofile 1024
* hard nofile 65536

Add the following line to the /etc/pam.d/login file, if it does not already exist:
session required /lib/security/pam_limits.so

Setting Oracle Environment
Set the following Oracle environment variables in oracle user ".bash_profile" script before you start runInstaller.
# Oracle Environment
export ORACLE_BASE=/opt/oracle
export ORACLE_HOME=/opt/oracle/product/10g
export ORACLE_SID=OraDb10g # Make sure you create a new Db with the same ORACLE_SID
export ORACLE_TERM=xterm
export DISPLAY=:0.0
# export TNS_ADMIN= Set if sqlnet.ora, tnsnames.ora, etc. are not in $ORACLE_HOME/network/admin
export NLS_LANG=AMERICAN;
export ORA_NLS33=$ORACLE_HOME/ocommon/nls/admin/data
LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib
LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib
export LD_LIBRARY_PATH
# Set shell search paths
export PATH=$PATH:$ORACLE_HOME/bin

Create Symbolic LInks
Run the following at the prompt:
su - root
cd /usr/lib
ln -s libstdc++-libc6.2-2.so.3 libstdc++-libc6.1-1.so.2

Setup other symbolic links by running the following at the prompt:
ln -s /usr/bin/basename /bin/basename
rm /usr/bin/gcc
ln -s /usr/bin/gcc-2.95 /usr/bin/gcc
ln -s /usr/bin/rpm /bin/rpm
ln -s /usr/bin/awk /bin/awk

Setup Display
Run the following at the prompt as the userID who is running xwindows:
xhost +

Then run the following at the prompt:
su – oracle
export DISPLAY=:0.0
cd Disk1 #Or whereever the oracle software source is located
runInstaller

A GUI installer should popup which allows you to configure the rest of the installation.

---------------------
Have fun with the installation and let me know if you encounter any problems.

Cheers
Rahul