Your router's DNS is probably the slow part

Before blaming the ISP, time a lookup: dig example.com against the router, then against a public resolver. On two of three routers I tested, the built-in forwarder added 80–150 ms per uncached name.

Fix: hand out a resolver directly over DHCP, or turn the forwarder's cache up if the firmware allows it.