In a default scenario the router becomes the DNS server itself.
You should check if DNS set to automatic, then the clients gets' it's address (the router's IP address as DNS server)
You should also check if the router itself can or cannot resolve a hostname. Like telnet/ssh to the router and 'ping google.com'.