New answers tagged


429 error fires if Instagram detects (or guess to detect) suspicial (automated) activities on account. I think your crawler tries to access Instagram pages through their external links. Try to exclude Instagram links from crawling. I would in any case nofollow them.

Top 50 recent answers are included