Skip to main content

Google is trying to crawl excluded and blocked pages, more than 16 million

My colleagues sent me a very interesting situation:

  1. Google started crawling a very large volume of blocked pages, already found 16 million)) Blocked URL in the robots.txt, meta noindex, and then added X-Robots-Tag noindex
  2. in the server has increased load, almost 1000 times
  3. there are no 503 errors, the server can withstand loading
  4. an XML sitemap, everything is clean
  5. the site is 1 year old
  6. clicks and impressions are growing in Google Search Console, but for now
  7. very strange, but google does not go so far on the pages... and here 27 slashes (/.../.../.../.../... etc) in the link +/- 25 clicks from the main page
  8. in the log file is really a lot of Googlebot - 500 thousand per day
  9. the backlinks are also clean, no spam

P.S. Screenshots in comments

What do you think?

submitted by /u/Andrew-Chornyy
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://ift.tt/3f00ylh
Labels:

Comments

Post a Comment

Popular posts from this blog

Local seo vs. natiowide seo?

I've done SEO for local businesses but I recently got my first client that sells an item nation wide. ​ Any suggestions for doing nationwide SEO? ​ I am used to making geopages for local towns. I was going to do the same with some input from the client about what cities or towns he would like to show up in? submitted by /u/Letmeinterviewyou [link] [comments] from Search Engine Optimization: The Latest SEO News http://bit.ly/2JHy0k0
Post a Comment
Read more

GMB territory inching with service company

Seeking advice on extending our service area, while our main GMB profile states SD County, we only rank in our neighborhood but we have the team to service much more jobs. The boss wants us to get addresses in these hot territories within the county and use call rail numbers to validate the GMB profile. Question: Does this still work? Will it catch up with us? OR is there a better way to rank in a territory for a service. We are 4.9 stars with 120+ reviews submitted by /u/SoCal619TradesPro [link] [comments] from Search Engine Optimization: The Latest SEO News https://ift.tt/9RWmh6i
Post a Comment
Read more