• About Us
  • Contributors
  • Guides
  • Speaking Engagements
  • Write for The SEM Post
  • Submit a tip or contact us!
  • Newsletters

The SEM Post

Latest News About SEO, SEM, PPC & Search Engines

  • Google
  • SEO
  • Mobile
  • Local
  • Bing
  • Pay Per Click
  • Facebook
  • Twitter
  • State of the Industry
You are here: Home / Google / Google Does Not Use Quality Raters for Machine Learning Algos

Google Does Not Use Quality Raters for Machine Learning Algos

August 6, 2018 at 3:00 am PST By Jennifer Slegg

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS

Whenever there is a new quality raters guidelines released by Google, there is always lots of speculation about what Google does with the data from those ratings.  And does that include machine learning?

Google confirmed that they use quality raters to evaluate potential changes to the search algos. They push out a change and then use quality raters to evaluate the quality of the search results and the pages that the raters see. If Google sees the result of those ratings that the potential algo change improves the search results, then it is much more likely that the particular change will be pushed to the live search results. But if the raters rate the results as lower quality, then Google will try to adjust whatever change it was and possibly try a new version of it with the raters, or not use it at all.

It is important to note that the ratings themselves don’t have any impact on the live search results. So if a rater rates your site low, it won’t affect your rankings. However, if your site has characteristics of a low rating site, then as algos are tweaked to target those lower quality signals, your rankings can go down.  The rater guidelines are basically a handbook on the types of sites Google wants to see rank well and not rank well, so site owners should really strive to be as high quality as possible.

There was speculation by a few different SEOs that Google might possibly be using results from quality raters for machine learning training. My response was that sample size of just using raters would be very small, too small for a very good dataset for training purposes.

I posed the question to Google on twitter and Danny Sullivan responded and commented that no, they do not use the quality ratings for machine learning.

We don't use it that way.

— Danny Sullivan (@dannysullivan) August 5, 2018

This doesn’t surprise me. Data sets used for machine learning tend to be pretty large, and while there are a fair number of quality raters, it wouldn’t be close to the numbers that would be needed to effectively train for machine learning purposes.  Not only that, Google tests many different algo changes with the raters, and some of those algos could be pretty extreme in their targeting, which again would make the raters results a poor set to use for machine learning.  Then of course, biases can seem much larger in a smaller group, which again would affect any use of machine learning from these results.

We do know that Google is using machine learning in many applications across many areas at the company.  This includes RankBrain, which is part of the search algo and helps Google rank results for the 15% of daily queries that Google has never seen before.  But they are not using the quality raters ratings for machine learning purposes.

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS
The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Jennifer Slegg

Founder & Editor at The SEM Post
Jennifer Slegg is a longtime speaker and expert in search engine marketing, working in the industry for almost 20 years. When she isn't sitting at her desk writing and working, she can be found grabbing a latte at her local Starbucks or planning her next trip to Disneyland. She regularly speaks at Pubcon, SMX, State of Search, Brighton SEO and more, and has been presenting at conferences for over a decade.
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Latest posts by Jennifer Slegg (see all)

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates - August 1, 2022
  • Google Quality Rater Guidelines: The Low Quality 2021 Update - October 19, 2021
  • Rethinking Affiliate Sites With Google’s Product Review Update - April 23, 2021
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met - October 16, 2020
  • Google Updates Experiment Statistics for Quality Raters - October 6, 2020

Filed Under: Google, SEO

Sign up for our newsletter


Founder & Editor

Jennifer Slegg (2052)

Sign up for our daily news recap & weekly newsletter.


Follow us online

  • Facebook
  • Google+
  • Linkedin
  • Pinterest
  • Twitter

Latest News

2022 Update for Google Quality Rater Guidelines – Big YMYL Updates

We finally have the first Google Quality Rater Guidelines update of 2022, and like usual, it is … [Read More...]

Recent Posts

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates
  • Google Quality Rater Guidelines: The Low Quality 2021 Update
  • Rethinking Affiliate Sites With Google’s Product Review Update
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met
  • Google Updates Experiment Statistics for Quality Raters
  • Analyzing “How Google Search Works” Changes from Google
  • Google Quality Rater Guidelines Update: New Introduction, Rater Bias & Political Affiliations
  • Google Updates Quality Rater Guidelines: Reputation for News Sites; Video Content Updates; Quality for Information Sites
  • Google Makes Major Changes to NoFollow, Adds Sponsored & UGC Tags
  • Google Updates Quality Rater Guidelines Targeting E-A-T, Page Quality & Interstitials

Categories

  • Affiliate Marketing
  • Amazon
  • Apple
  • Bing
  • Branding
  • Browsers
  • Chrome
  • Content Marketing
  • Design
  • Domains
  • DuckDuckGo
  • Email
  • Facebook
  • Firefox
  • Foursquare
  • Google
    • Analytics
    • Google RankBrain
    • Quality Rater's Guidelines
  • History of Search
  • Industry Spotlight
  • Instagram
  • Internet Explorer
  • Links
  • Local
  • Mobile
  • Native Advertising
  • Other Search Engines
  • Pay Per Click
  • Pinterest
  • Publishers
  • Security
  • SEO
  • Snapchat
  • Social Media
  • State of the Industry
  • The SEM Post
  • Tools
  • Twitter
  • Uncategorized
  • User Experience
  • Video Marketing
  • Week in Review
  • Whitepapers
  • Wordpress
  • Yahoo
  • Yelp
  • YouTube
March 2023
MTWTFSS
« Aug  
 12345
6789101112
13141516171819
20212223242526
2728293031 

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org

Copyright © 2023 · News Pro Theme On Genesis Framework · WordPress · Log in