Silly me, I set the LAN gateway as my internet gateway. Deleted the default gateway and manually set the ISP gateway and everything works fine now.