• About Us
  • Contributors
  • Guides
  • Speaking Engagements
  • Write for The SEM Post
  • Submit a tip or contact us!
  • Newsletters

The SEM Post

Latest News About SEO, SEM, PPC & Search Engines

  • Google
  • SEO
  • Mobile
  • Local
  • Bing
  • Pay Per Click
  • Facebook
  • Twitter
  • State of the Industry
You are here: Home / Google / Higher Site Crawl Rates Do Not Equal Higher Rankings in Google

Higher Site Crawl Rates Do Not Equal Higher Rankings in Google

March 1, 2016 at 5:00 am PST By Jennifer Slegg

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS

crawl rates higher rankingsWhen it comes to crawl frequency, everyone wants their pages crawled multiple times per day, even if nothing changes on the page, under the assumption that more is better.  But do higher crawl rates translate into better rankings?  The answer is no.

John Mueller commented in another recent hangout that individual pages can have very different crawl rates.  But this question was more specific to crawl frequency of a site overall.

Here is what John said in response to a question about whether Google crawling 5,000 pages per day on a site with 30,000 pages was a good thing or a bad thing.

What is worth keeping in mind with the crawl rate of a website is we’re not crawling random URLs from the website, like random 5,000 URLs or lining all the URLs up and going through those 5,000,  we are crawling some pages a lot more frequently and other pages a little less frequently.  So within those 5,000, you’ll probably have a lot of pages that get crawled maybe daily, and a bunch of pages that get crawled maybe once a week, and then a bunch of other pages that get crawled maybe a lot less frequently.

So it’s kind of a mix there, you can’t say well 5,000 a day and 30,000 total therefore it’ll take, i don’t know, 6 days for the whole website to be crawled, well that’s not how it works. 1,000 a day for a website of that size is a good thing.

Another thing to maybe keep in mind with the crawl rate is crawling more doesn’t necessarily mean that your website will be seen as more relevant or rank higher.  So there is no need to artificially push a higher crawl rate if we’re already picking up all of the content you are providing.

That said, you don’t want to throttle Googlebot either, unless it is crawling too much and causing server performance issues.  But if Google is successfully crawling all your content and indexing it correctly, there is no reason to try and push a higher crawl rate strictly from a ranking perspective.

Of course, there are always exceptions, such as pages that change frequently, although Google is pretty good about crawling those pages more frequently than ones that seldom change.  Also a change of the site, such as a change to HTTPS, will trigger Googlebot to recrawl a site faster to process the new secure URLs.

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS
The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Jennifer Slegg

Founder & Editor at The SEM Post
Jennifer Slegg is a longtime speaker and expert in search engine marketing, working in the industry for almost 20 years. When she isn't sitting at her desk writing and working, she can be found grabbing a latte at her local Starbucks or planning her next trip to Disneyland. She regularly speaks at Pubcon, SMX, State of Search, Brighton SEO and more, and has been presenting at conferences for over a decade.
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Latest posts by Jennifer Slegg (see all)

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates - August 1, 2022
  • Google Quality Rater Guidelines: The Low Quality 2021 Update - October 19, 2021
  • Rethinking Affiliate Sites With Google’s Product Review Update - April 23, 2021
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met - October 16, 2020
  • Google Updates Experiment Statistics for Quality Raters - October 6, 2020

Filed Under: Google, SEO

Sign up for our newsletter


Trackbacks

  1. SearchCap: Bing Solar System, Google AdWords Editor Update & AP Elections says:
    March 1, 2016 at 1:00 pm

    […] Higher Site Crawl Rates Do Not Equal Higher Rankings in Google, thesempost.com […]

Founder & Editor

Jennifer Slegg (2052)

Sign up for our daily news recap & weekly newsletter.


Follow us online

  • Facebook
  • Google+
  • Linkedin
  • Pinterest
  • Twitter

Latest News

2022 Update for Google Quality Rater Guidelines – Big YMYL Updates

We finally have the first Google Quality Rater Guidelines update of 2022, and like usual, it is … [Read More...]

Recent Posts

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates
  • Google Quality Rater Guidelines: The Low Quality 2021 Update
  • Rethinking Affiliate Sites With Google’s Product Review Update
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met
  • Google Updates Experiment Statistics for Quality Raters
  • Analyzing “How Google Search Works” Changes from Google
  • Google Quality Rater Guidelines Update: New Introduction, Rater Bias & Political Affiliations
  • Google Updates Quality Rater Guidelines: Reputation for News Sites; Video Content Updates; Quality for Information Sites
  • Google Makes Major Changes to NoFollow, Adds Sponsored & UGC Tags
  • Google Updates Quality Rater Guidelines Targeting E-A-T, Page Quality & Interstitials

Categories

  • Affiliate Marketing
  • Amazon
  • Apple
  • Bing
  • Branding
  • Browsers
  • Chrome
  • Content Marketing
  • Design
  • Domains
  • DuckDuckGo
  • Email
  • Facebook
  • Firefox
  • Foursquare
  • Google
    • Analytics
    • Google RankBrain
    • Quality Rater's Guidelines
  • History of Search
  • Industry Spotlight
  • Instagram
  • Internet Explorer
  • Links
  • Local
  • Mobile
  • Native Advertising
  • Other Search Engines
  • Pay Per Click
  • Pinterest
  • Publishers
  • Security
  • SEO
  • Snapchat
  • Social Media
  • State of the Industry
  • The SEM Post
  • Tools
  • Twitter
  • Uncategorized
  • User Experience
  • Video Marketing
  • Week in Review
  • Whitepapers
  • Wordpress
  • Yahoo
  • Yelp
  • YouTube
October 2023
MTWTFSS
« Aug  
 1
2345678
9101112131415
16171819202122
23242526272829
3031 

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org

Copyright © 2023 · News Pro Theme On Genesis Framework · WordPress · Log in