So I have a blog post which is rendered on the server, so this should not be a problem. Now below the post there is a standard "Recommended Section" with related posts, but I fetch these posts only if they appear in the viewport of the browser so that I don't need the user to download extra data and I don't need to add extra reads for my database.

But will a crawler have problems with that occurring, and if so, what can I do to let it find these links?

  • What specifically do you mean by viewport is on a certain level (dimensions, and if so which)? Also, are you referring to Googlebot, or all crawlers, because they differ greatly. Googlebot uses a headless version of Chrome, which you can view the results of by using Fetch as Google. – dan Dec 19 '18 at 8:26
  • @dan Ah okay, I talk about the important search engines so basicly Google and maybe Bing too. Ok didnt know about such a tool. – Badgy Dec 19 '18 at 8:50
  • @dan Yes when the viewport is on a certain level but not hard coded, just when the Content is in the viewport, because a article can have a height of 100px or 2000px so it would be bad to hardcode the dimensions – Badgy Dec 19 '18 at 8:51
  • I suspect you mean it's responsive to the device viewing it? Can you edit the question to clarify that and be more specific to Google and Bing then, since it's really too broad as it is. Bing also has a similar tool: Fetch as Bingbot. – dan Dec 19 '18 at 9:31
  • 1
    I edited the question based on your comments, and to make it specific to just Google and Bing, since all search crawlers is really too broad.You can edit it further if I misunderstood something. You can view your pages with the Fetch as tools - if the "Recommended Section" doesn't appear in their results, you'll need to add some JavaScript to trigger it for smaller dimensions. – dan Dec 19 '18 at 9:56

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.