• About Us
  • Contributors
  • Guides
  • Speaking Engagements
  • Write for The SEM Post
  • Submit a tip or contact us!
  • Newsletters

The SEM Post

Latest News About SEO, SEM, PPC & Search Engines

  • Google
  • SEO
  • Mobile
  • Local
  • Bing
  • Pay Per Click
  • Facebook
  • Twitter
  • State of the Industry
You are here: Home / Google / Google’s Algo Removes Some Site’s Search Results Pages from Index

Google’s Algo Removes Some Site’s Search Results Pages from Index

March 27, 2017 at 4:27 am PST By Jennifer Slegg

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS

Gary Illyes from Google revealed some interesting insights into site’s search results pages and the Google search results – Google’s algos can automatically detect some search result pages from a site’s own internal search engine and automatically remove them from Google’s search results.

Getting a site’s internal search results pages indexed into Google’s search results is an interesting thing.  Google’s webmaster guidelines states that these types of pages should not be indexed.  But for some site owners, they are sure these results pages are useful and want them indexed.  But Google could be thwarting those attempts.

“We generally frown on getting search pages indexed,” Illyes said.  “Generally, they are not that useful for the users.  And we do have some algorithms which try to get rid of them, essentially not getting crawled, but sometimes that fails.  And in those cases, we either need to manually intervene and create new search rules for those pages.”

Mariya Moeva also added that site owners can also use the URL parameter tool in these cases where it follows a pattern.

Not all types of these search results that are indexed are useless. But with so many of them delivering either a poor experience (landing on a page showing only similar products) or a non-existent one (no products found) it is not surprising that Google does this algorithmically.  And for many sites, these types of internal search results pages are served just as well, if not better, through use of categories.

These types of pages can also waste crawl budget, and for larger sites, that crawl budget can usually be put to better use crawling actual pages instead.

And lastly, Googlebot can sometimes end up in an infinite loop, crawling more and more search results pages, which are often empty, through the use of “did you mean” or “suggested searches” which lead to more empty result pages.  This will often trigger an alert in Google Search Console if it recogninzes it seems to be an error.

As for which types of site’s internal search results Google is able to algorithmically detect and remove, it is likely the ones triggered by the most popular CMS and ecommerce plaforms.

So if you are attempting to get some of your interal search results pages indexed – despite Google’s guidelines recommending that you do not index them – without any luck, it could be that Google’s algos are detecting those search results and removing them.

Google tries to not index search pages and they make new rules when they see it happening. @methode #smx

— Jennifer Slegg (@jenstar) March 23, 2017

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS
The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Jennifer Slegg

Founder & Editor at The SEM Post
Jennifer Slegg is a longtime speaker and expert in search engine marketing, working in the industry for almost 20 years. When she isn't sitting at her desk writing and working, she can be found grabbing a latte at her local Starbucks or planning her next trip to Disneyland. She regularly speaks at Pubcon, SMX, State of Search, Brighton SEO and more, and has been presenting at conferences for over a decade.
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Latest posts by Jennifer Slegg (see all)

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates - August 1, 2022
  • Google Quality Rater Guidelines: The Low Quality 2021 Update - October 19, 2021
  • Rethinking Affiliate Sites With Google’s Product Review Update - April 23, 2021
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met - October 16, 2020
  • Google Updates Experiment Statistics for Quality Raters - October 6, 2020

Filed Under: Google, SEO

Sign up for our newsletter


Founder & Editor

Jennifer Slegg (2052)

Sign up for our daily news recap & weekly newsletter.


Follow us online

  • Facebook
  • Google+
  • Linkedin
  • Pinterest
  • Twitter

Latest News

2022 Update for Google Quality Rater Guidelines – Big YMYL Updates

We finally have the first Google Quality Rater Guidelines update of 2022, and like usual, it is … [Read More...]

Recent Posts

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates
  • Google Quality Rater Guidelines: The Low Quality 2021 Update
  • Rethinking Affiliate Sites With Google’s Product Review Update
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met
  • Google Updates Experiment Statistics for Quality Raters
  • Analyzing “How Google Search Works” Changes from Google
  • Google Quality Rater Guidelines Update: New Introduction, Rater Bias & Political Affiliations
  • Google Updates Quality Rater Guidelines: Reputation for News Sites; Video Content Updates; Quality for Information Sites
  • Google Makes Major Changes to NoFollow, Adds Sponsored & UGC Tags
  • Google Updates Quality Rater Guidelines Targeting E-A-T, Page Quality & Interstitials

Categories

  • Affiliate Marketing
  • Amazon
  • Apple
  • Bing
  • Branding
  • Browsers
  • Chrome
  • Content Marketing
  • Design
  • Domains
  • DuckDuckGo
  • Email
  • Facebook
  • Firefox
  • Foursquare
  • Google
    • Analytics
    • Google RankBrain
    • Quality Rater's Guidelines
  • History of Search
  • Industry Spotlight
  • Instagram
  • Internet Explorer
  • Links
  • Local
  • Mobile
  • Native Advertising
  • Other Search Engines
  • Pay Per Click
  • Pinterest
  • Publishers
  • Security
  • SEO
  • Snapchat
  • Social Media
  • State of the Industry
  • The SEM Post
  • Tools
  • Twitter
  • Uncategorized
  • User Experience
  • Video Marketing
  • Week in Review
  • Whitepapers
  • Wordpress
  • Yahoo
  • Yelp
  • YouTube
February 2023
MTWTFSS
« Aug  
 12345
6789101112
13141516171819
20212223242526
2728 

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org

Copyright © 2023 · News Pro Theme On Genesis Framework · WordPress · Log in