2

429 error fires if Instagram detects (or guess to detect) suspicial (automated) activities on account. I think your crawler tries to access Instagram pages through their external links. Try to exclude Instagram links from crawling. I would in any case nofollow them.


Only top voted, non community-wiki answers of a minimum length are eligible