I'd delete the whole file and start ssh again as if it was the first time
that you ran it. I don't have a remote_hosts file but I can run
ssh 192.168.0.3 to connect to one of the computers on my lan and ssh
will create the file for me.