# The Wayback machine needs to be specifically targeted, because it will # retroactively remove paths from its archive if in the future they are ever # excluded by a wildcard, for instance. Future revisions of # newzealand.govt.nz should therefore retain a specific WBM entry in their robots.txt # to not block any URLs that would have been valid in any past versions of the site User-agent: ia_archiver Disallow: /search User-agent: * Disallow: / # This file is served (by rewrite) on non-newzealand.govt.nz domains # when robots.txt is accessed. Search engines should no longer attempt # to hit URLs on the legacy domains.