• About Us
  • Contributors
  • Guides
  • Speaking Engagements
  • Write for The SEM Post
  • Submit a tip or contact us!
  • Newsletters

The SEM Post

Latest News About SEO, SEM, PPC & Search Engines

  • Google
  • SEO
  • Mobile
  • Local
  • Bing
  • Pay Per Click
  • Facebook
  • Twitter
  • State of the Industry
You are here: Home / Google / Large Disavow File? Google Can Take 3-9 Months To Process Completely

Large Disavow File? Google Can Take 3-9 Months To Process Completely

November 19, 2014 at 8:53 am PST By Jennifer Slegg

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS

googlegreenWhen disavowing links, many webmasters go and disavow every link they have that could possibly be considered an invalid link in the eyes of Google.  For sites that have been the target of massive negative SEO campaigns or the victim of over-zealous link builders, lists can get pretty huge.  But now it seems that you might want to keep that list shorter.

In a Google Webmaster Office Hours, the question was raised about how long it takes for links in a disavow to be processed and reflected in an update or refresh.  And the answer probably wasn’t what many want to hear, especially those who are attempting to clean up a huge number of links.

Yes, definitely.  So this is something where depending on the URL sometimes we crawl them daily, sometimes we crawl them every couple of months. So if you submit a large disavow file or a disavow file that includes a lot of domain entries or just generally includes a lot of different URLs, then that is something that’s going to take quite a bit of time to kind of recrawl all of those URLs naturally and reprocess all of that information.

So I wouldn’t be surprised if you are looking at a time frame of maybe 3 to 6 to 9 months even for disavow files to be completely taken into account.

And that is not something that happens from one day to the next, this is a granular process that happens step by step.  So as individual URLs are recrawled and we see them in the disavow file, that will be taken into account.  So it’s not that you have to wait this long for them to be reflected, it’s just that for everything to be recrawled and reprocessed it can take a significant amount of time.

Of course, this does raise the question of where is the happy medium between disavowing enough links to lift the penalty (or prevent one) versus having a large enough file that it could take many months to complete.  While getting the links removed is always the best route to go, many webmasters don’t respond to removal requests or don’t want to pay the “removal fee” to get it removed.

It also reconfirms that Google doesn’t explicitly recrawl links that are included in a disavow file – something that has concerned webmasters whose sites might be included in a list – but rather simply continue crawling those sites on their own schedule.

Hat tip Glenn Gabe.

  • Facebook
  • Twitter
  • Google+
  • Pinterest
  • LinkedIn
  • Email
  • WhatsApp
  • Evernote
  • SMS
The following two tabs change content below.
  • Bio
  • Latest Posts
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Jennifer Slegg

Founder & Editor at The SEM Post
Jennifer Slegg is a longtime speaker and expert in search engine marketing, working in the industry for almost 20 years. When she isn't sitting at her desk writing and working, she can be found grabbing a latte at her local Starbucks or planning her next trip to Disneyland. She regularly speaks at Pubcon, SMX, State of Search, Brighton SEO and more, and has been presenting at conferences for over a decade.
My Twitter profileMy Facebook profileMy Google+ profileMy LinkedIn profile

Latest posts by Jennifer Slegg (see all)

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates - August 1, 2022
  • Google Quality Rater Guidelines: The Low Quality 2021 Update - October 19, 2021
  • Rethinking Affiliate Sites With Google’s Product Review Update - April 23, 2021
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met - October 16, 2020
  • Google Updates Experiment Statistics for Quality Raters - October 6, 2020

Filed Under: Google, Links, SEO

Sign up for our newsletter


Comments

  1. Jonah Stein says

    November 19, 2014 at 5:10 pm

    I think you are missing the point here. Just because Google doesn’t finish completely taking the disavow into account doesn’t mean that the value of the disavow is ignored until all the pages are crawled. Nor does it suggest that making the disavow smaller will speed up the benefits.

    The only thing it does imply is that you may be better off disavowing domains instead of URLs, since they may be counted faster.

    • Jennifer Slegg says

      November 19, 2014 at 5:28 pm

      There will be a difference between disavow files with 50 URLs and/or domains versus ones with 20,000…. and some disavow files are larger than that. But it definitely raises the question about whether people should slog through attempting to get the links removed (which is ideal) versus those who simply do disavows (which is what many only do now).

  2. Donna says

    November 21, 2014 at 7:29 am

    I probably shouldn’t comment when I haven’t even had my coffee yet, but what the heck. So…why exactly does Google even need to crawl the links in the disavow file? (Not asking you specifically for the answer, just thinking out loud). I mean, it just doesn’t make sense to my caffeine-less brain that a crawl would be necessary. Where’s the logic? Bot looks at disavow file. Bot sees link. Bot says ok, this link will not count. Bot has to crawl the link anyway…why? Sounds like they are doing this the opposite way around. The bot isn’t actually looking at the disavow file until after it crawls a link during a normal crawl. Bot crawls link. Bot checks to see if the link is on the disavow file. Bot says ok, this link doesn’t count. I guess in that scenario it makes sense, but only if the calculation is happening every second of every day, every time a link is crawled. And maybe that’s exactly the way it works. I used to pay more attention to how the algo got calculated, but I stopped worrying about that a few years ago. Too many algos, too much to keep up with. In any case, seems odd that it would work that way. But I’ve probably gotten it all wrong from start to finish of my thought process. Ah well, my brain needs coffee now. Feel sorry for anyone waiting on disavow results, I guess. What a mess.

  3. MKCheck says

    November 25, 2014 at 9:38 am

    I sent a file with 543 URLs over a month ago and no response

Trackbacks

  1. SearchCap: Google Knowledge Graph Gets Social, Scrollable Google Answers & Google News Suggested Stories says:
    November 19, 2014 at 2:00 pm

    […] Large Disavow File? Google Can Take 3-9 Months To Process Completely, The SEM Post […]

  2. 2015 Predictions: Google In The Year Of The Goat says:
    December 22, 2014 at 3:40 pm

    […] John Mueller has noted that it can take as long as nine months for Google to fully process a disavow file submitted by […]

Founder & Editor

Jennifer Slegg (2052)

Sign up for our daily news recap & weekly newsletter.


Follow us online

  • Facebook
  • Google+
  • Linkedin
  • Pinterest
  • Twitter

Latest News

2022 Update for Google Quality Rater Guidelines – Big YMYL Updates

We finally have the first Google Quality Rater Guidelines update of 2022, and like usual, it is … [Read More...]

Recent Posts

  • 2022 Update for Google Quality Rater Guidelines – Big YMYL Updates
  • Google Quality Rater Guidelines: The Low Quality 2021 Update
  • Rethinking Affiliate Sites With Google’s Product Review Update
  • New Google Quality Rater Guidelines, Update Adds Emphasis on Needs Met
  • Google Updates Experiment Statistics for Quality Raters
  • Analyzing “How Google Search Works” Changes from Google
  • Google Quality Rater Guidelines Update: New Introduction, Rater Bias & Political Affiliations
  • Google Updates Quality Rater Guidelines: Reputation for News Sites; Video Content Updates; Quality for Information Sites
  • Google Makes Major Changes to NoFollow, Adds Sponsored & UGC Tags
  • Google Updates Quality Rater Guidelines Targeting E-A-T, Page Quality & Interstitials

Categories

  • Affiliate Marketing
  • Amazon
  • Apple
  • Bing
  • Branding
  • Browsers
  • Chrome
  • Content Marketing
  • Design
  • Domains
  • DuckDuckGo
  • Email
  • Facebook
  • Firefox
  • Foursquare
  • Google
    • Analytics
    • Google RankBrain
    • Quality Rater's Guidelines
  • History of Search
  • Industry Spotlight
  • Instagram
  • Internet Explorer
  • Links
  • Local
  • Mobile
  • Native Advertising
  • Other Search Engines
  • Pay Per Click
  • Pinterest
  • Publishers
  • Security
  • SEO
  • Snapchat
  • Social Media
  • State of the Industry
  • The SEM Post
  • Tools
  • Twitter
  • Uncategorized
  • User Experience
  • Video Marketing
  • Week in Review
  • Whitepapers
  • Wordpress
  • Yahoo
  • Yelp
  • YouTube
March 2023
MTWTFSS
« Aug  
 12345
6789101112
13141516171819
20212223242526
2728293031 

Meta

  • Log in
  • Entries RSS
  • Comments RSS
  • WordPress.org

Copyright © 2023 · News Pro Theme On Genesis Framework · WordPress · Log in