Ok. I realize the title isn't very descriptive here. What I need to do is be able to setup some actual ipv6 dns servers on the router. In addition I also wish to have the router broadcast itself as an ipv6 dns server as well as an ipv4 one. Sixxs.net is providing ipv6 dns servers that are usable via the tunnel.

I have been able to add the required dns servers, at least temporarily, by adding them directly to the /etc/resolv.conf file. At that point both dig and host can get an ipv6 address for www.google.com (one doesn't exist on most ipv4 dns servers...). I just need to make it broadcast that it can do that so my computers will use them.