I know in Google Webmaster Tools, under "search appearance" for any domain, there's an "HTML Improvements" section which only checks crawled URLs specifically for that domain. My website has subdomains. Is there a way I can find out whether two titles or meta descriptions are duplicate between any two URLs where the subdomain each URL belongs to is different? The only thing I can think of at this point is to programmatically access each and every url from every subdomain which takes tedious amounts of time since I have over a total of about 3 million URLs. On top of that, It will take bandwidth and/or server processing power which can be better spent for actual users.