# The old WordPress site is gone. Every /wp-* path now returns 404, so we # deliberately allow crawlers to reach them — Google must fetch a URL to see # the 404 and drop it from the index. Blocking them in robots.txt would freeze # them in the index as "blocked by robots.txt" instead of deindexing them. User-agent: * Allow: / Disallow: /*?attachment_id= Disallow: /*?replytocom= Disallow: /*?lang= Disallow: /*?p= Disallow: /*?page_id= Disallow: /*?preview= Disallow: /*?share= Disallow: /*/trackback/ User-agent: Googlebot Allow: / Disallow: /*?attachment_id= Disallow: /*?replytocom= Disallow: /*?lang= User-agent: Bingbot Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / Sitemap: https://uofac.edu/sitemap.xml