• About Us
  • Contributors
  • Guides
  • Speaking Engagements
  • Write for The SEM Post
  • Submit a tip or contact us!
  • Newsletters

The SEM Post

Latest News About SEO, SEM, PPC & Search Engines

  • Google
  • SEO
  • Mobile
  • Local
  • Bing
  • Pay Per Click
  • Facebook
  • Twitter
  • State of the Industry
You are here: Home / Google / Google Indexes and Ranks JavaScript Pages in Two Waves Days Apart

Google Indexes and Ranks JavaScript Pages in Two Waves Days Apart

May 11, 2018 at 4:04 am PST By Jennifer Slegg

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS

Tom Greenaway from Google spoke at Google I/O yesterday about how Google handles JavaScript pages, and he mentioned something pretty significant – Googlebot treats indexing and ranking of JavaScript pages much differently than non-Javascript rendered pages.

More specifically, when Googlebot crawls JavaScript sites, it does so in waves.  And the result is it will have an impact on the indexing and ranking of websites, especially new sites and new pages.  It can take days for Google to fully process a page that utilizing JavaScript.  Yes, days.

Googlebot includes its own renderer, which is able to run when it encounters pages with Javascript.   But rendering pages at the scale of the web requires a lot of time and computational resources.  And make no mistake, this is a serious challenge for search crawlers, Googlebot included.

And so we come to the important truth about Google search we would like to share with you today is that currently the rendering of JavaScript powered websites in Google search is actually deferred until Googlebot has the resources available to process that content.

Now you might be thinking, what does that really mean?  Well, I’ll show you.

In reality, Googlebot’s process looks a bit different.  We crawl a page, we fetch the server-side rendered content and then rerun some initial indexing on that document but rendering the JavaScript powered web pages takes processing power and memory and while Googlebot is very powerful, it doesn’t have infinite resources.

So if the page has JavaScript in it, the rendering is actually deferred until we have the resources ready to render the client-side content and then we index the content further.  So Googlebot might index a page before the rendering is complete and the final render can actually arrive several days later.  And when that final render does arrive, then we perform another wave of indexing on that client-side rendered content.

And this effectively means that if your site is using a heavy amount of client-side JavaScript for rendering, you could be tripped up at times when your content is being indexed due to the nature of this two phase indexing process.  And so ultimately, what I’m really trying to say is because Google’s Googlebot actually runs two waves of indexing across web content, it’s possible some details might be missed.

For any site with heavy Javascript, this can have a huge impact, especially if the pages are news oriented, where things can become outdated in the days between the two waves of indexing.  And if the initial view Googlebot sees doesn’t have enough content for indexing and ranking, those pages can not see any traffic for days, until Googlebot does its second wave of crawling the page to render the full JavaScript.

Mueller later stresses that new content “might take a while to be indexed.”

While designers love JavaScript, from an SEO point of view, it can definitely cause headaches, and this multi-day delay can cause even more issues.  The days delay means those pages may not get traffic from Google search, depending on what gets indexed in the initial pass by Googlebot, and with enough pages being added, this can result in a loss of potential traffic and revenue.

Mueller later stresses that new content “might take a while to be indexed.”

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS
The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Jennifer Slegg

Founder & Editor at The SEM Post
Jennifer Slegg is a longtime speaker and expert in search engine marketing, working in the industry for almost 20 years. When she isn't sitting at her desk writing and working, she can be found grabbing a latte at her local Starbucks or planning her next trip to Disneyland. She regularly speaks at Pubcon, SMX, State of Search, Brighton SEO and more, and has been presenting at conferences for over a decade.
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Latest posts by Jennifer Slegg (see all)

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates - August 1, 2022
  • Google Quality Rater Guidelines: The Low Quality 2021 Update - October 19, 2021
  • Rethinking Affiliate Sites With Google’s Product Review Update - April 23, 2021
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met - October 16, 2020
  • Google Updates Experiment Statistics for Quality Raters - October 6, 2020

Filed Under: Google, SEO

Sign up for our newsletter


Founder & Editor

Jennifer Slegg (2052)

Sign up for our daily news recap & weekly newsletter.


Follow us online

  • Facebook
  • Google+
  • Linkedin
  • Pinterest
  • Twitter

Latest News

2022 Update for Google Quality Rater Guidelines – Big YMYL Updates

We finally have the first Google Quality Rater Guidelines update of 2022, and like usual, it is … [Read More...]

Recent Posts

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates
  • Google Quality Rater Guidelines: The Low Quality 2021 Update
  • Rethinking Affiliate Sites With Google’s Product Review Update
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met
  • Google Updates Experiment Statistics for Quality Raters
  • Analyzing “How Google Search Works” Changes from Google
  • Google Quality Rater Guidelines Update: New Introduction, Rater Bias & Political Affiliations
  • Google Updates Quality Rater Guidelines: Reputation for News Sites; Video Content Updates; Quality for Information Sites
  • Google Makes Major Changes to NoFollow, Adds Sponsored & UGC Tags
  • Google Updates Quality Rater Guidelines Targeting E-A-T, Page Quality & Interstitials

Categories

  • Affiliate Marketing
  • Amazon
  • Apple
  • Bing
  • Branding
  • Browsers
  • Chrome
  • Content Marketing
  • Design
  • Domains
  • DuckDuckGo
  • Email
  • Facebook
  • Firefox
  • Foursquare
  • Google
    • Analytics
    • Google RankBrain
    • Quality Rater's Guidelines
  • History of Search
  • Industry Spotlight
  • Instagram
  • Internet Explorer
  • Links
  • Local
  • Mobile
  • Native Advertising
  • Other Search Engines
  • Pay Per Click
  • Pinterest
  • Publishers
  • Security
  • SEO
  • Snapchat
  • Social Media
  • State of the Industry
  • The SEM Post
  • Tools
  • Twitter
  • Uncategorized
  • User Experience
  • Video Marketing
  • Week in Review
  • Whitepapers
  • Wordpress
  • Yahoo
  • Yelp
  • YouTube
March 2023
MTWTFSS
« Aug  
 12345
6789101112
13141516171819
20212223242526
2728293031 

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org

Copyright © 2023 · News Pro Theme On Genesis Framework · WordPress · Log in