I agree with Werner. I would not expect a home router to offer name services.

On a small home LAN the best way of address machines by name is to use /etc/hosts. See man hosts for more information.

You prepare this file in an editor. Only root has write access to this file so use either sudo nano from a terminal or leafpad from a root console.

You can (and should) propagate this file to all machines on your home LAN. That includes Windows machines. There is actually a hosts file on Windows machines but I'm not too sure of its exact location.

It may be that your Windows machines know of each others names through a broadcast system. You can get that under Linux by running a samba server but that is more trouble that it is worth. While samba knows about Linux, Linux doesn't know about samba so you'd end up with your Windows machines knowing the name of the Knoppix machine but not vice versa.