7 Tips for Making Google Crawl Your Blog More Often

66 Flares Twitter 0 Facebook 0 Google+ 38 LinkedIn 28 Email -- Buffer 0 66 Flares ×

Google Crawl Your BlogThere are literally thousands upon thousands of blogs on the internet. There are blogs about every niche imaginable.  As such, there is a great deal of competition out there.  Bloggers all have a variety of techniques they use to obtain traffic.  However, most people agree that nothing beats organic, natural, search engine traffic.

Blogs and web pages are picked up regularly by Google and ranked in order of relevance.  Google crawls some blogs more quickly than others, depending on relevance, backlinks, etc.  The pages that are indexed quickly referred to as “authority” pages.  If you want your blog to be indexed quickly, you need to increase its relevancy and value.

Here are a few tips for optimizing your blog so that Google will crawl it more often:

  • Publish new unique blog posts as aften as possible. At least twice a week. Web pages with duplicate content are indexed very slowly, if at all.  The content should be informative, beneficial to your reader, have some targeted keywords (a keyword ratio of under 2%), and consist of no “fluff” or “padding”.

 

 

  • Make sure your posts are internally interlinked  (i.e. link from one blog post to another). The Insights plugin makes this task easier. And ensure you use the correct anchor text to link from one blog post to another.

 

  • Turn on the trackback and pingback options for every single post. Many people don’t realize the importance of this, especially in regards to a Google crawler.  With these options on, you will be directing a Googlebot to crawl and find your new posts. Use the MaxBlog Ping Optimizer plugin.
    You can see exactly how to set up the plugin here: Increase blog traffic

 

  • Try getting as many quality backlinks from relevant sites as possible. Two ways to do this is via commenting and publishing guest posts on relevant sites

 

  • Keep your URLs simple, yet effective. Long, complicated URLs take longer to find and index.  You need to make them easy to remember and to the point.

 

    • There is some dispute as to whether black hat SEO methods are worthwhile. While using such methods probably will get your blog indexed quickly, they’re extremely risky and your blog can end up being banned.  It’s therefore safer to use white hat methods (mentioned above), as they will ensure that your blog will be indexed more quickly over time.

     

    In summary, you can get Google to crawl your blog more quickly by making it as search engine friendly as possible.  This means all of your URLs need to be organized, your content needs to be unique, the keywords need to fit in naturally and not overstuffed, etc.  Google loves authority websites, so try to make yours as relevant as possible.

    What tips do you have to make Google crawl your blog more often? Share them in the comments below.

    _______________________________________________________________________________________

    Related Posts Plugin for WordPress, Blogger...
    66 Flares Twitter 0 Facebook 0 Google+ 38 LinkedIn 28 Email -- Buffer 0 66 Flares ×

    , , ,

    235 Responses to 7 Tips for Making Google Crawl Your Blog More Often

    1. Nick August 19, 2012 at 12:41 pm #

      Thanks! Im going to be using these tips from now on

    2. Hussain Saifi September 16, 2012 at 5:55 am #

      best described nice post and informative post
      can anyone tell write in robot.txt
      Disallow:/tag/
      Disallow:/category/
      can block my site for crawling by google

    3. Anurag October 27, 2012 at 6:20 pm #

      Thank you for these tips. I have updated the meta tags on my blog and waiting for the crawler to re-index it again. I will surely try to implement your methods.

    4. shakil October 31, 2012 at 10:37 am #

      I use google webmaster tool to make search engine index my latest post. It is like, fetch your latest post as googlebot and request to index it.

    5. Taran January 4, 2013 at 12:02 pm #

      Great info in this post! I agree that quality baclinks together with quality content posted in regular basis gets you content ranked!

    6. Akash Tiwary March 16, 2013 at 8:42 pm #

      Thanks for the post. I was worried because my site is being crawled less often. However, now I realize that instead of focusing on crawl rate, I should rather focus on creating good content.

    7. Abhijit Guha March 21, 2013 at 10:32 pm #

      I’m having a problem, pls help me..
      I use wordpress cms & from starting day it work very well..
      all my blog post was getting indexed in google with in 12 hours & sometimes with in 5 to 10 mins.

      But now I noticed that my last 3 post didn’t got indexed in google , it have been 5 days. I m waiting for that post to get indexed, but no success…

      I resubmitted sitemap , still no use…

      Plz help…

      • Andrew from Need a blog
        Twitter:
        March 22, 2013 at 10:04 am #

        Abhijit

        Have you followed all the ideas in this post?

        Andrew
        Andrew recently posted..8 Reasons Why You Need A BlogMy Profile

        • Abhijit Guha March 22, 2013 at 10:41 pm #

          yes I did still no use…

          then I tried one more thing that is google url fetch & it worked..

          so if you want, then edit your awesome post & add that google fetch method tooo..

          it will help other fellas like me. 🙂

    8. Tom Nardone April 17, 2013 at 8:44 pm #

      Nice dude. Thanks that really clears a lot of things up my page has been ranked zero forever.

    9. Gary May 9, 2013 at 7:49 am #

      Thanks for posting this. The article and subsequent conversation via the comments is awesome.

      I’m curious about a piece of this. I’ve recently been doing some SEO clean up on my posts using a WordPress plug in and it’s really helped me if nothing else to be aware of simple key things that often get missed. There’s a problem though. Since I changed titles, slugs, added pictures, etc… my posts are not showing up in Google. For example, if I copy the new URL that is on my site for a given article into Google search, the article doesn’t come up. What am I doing wrong? Or is this just a matter of Google catching up. I did the latest round of tweaks about a day ago. Will this eventually update or do I have something jacked up in some setting somewhere?

      Thanks!

    10. chris May 13, 2013 at 5:25 pm #

      I used to get my posts appear on Google within 10 mins of writing them, I stopped working on my site for a bit and now Google hardly crawls my site. It takes days for my new posts to show up in Google nowadays.

      Desperate to get Google to crawl my site the way they used to. Maybe these tips will help.

    11. Custom Rom May 28, 2013 at 11:45 pm #

      Hi,
      Andrew

      All the points you mentioned are totaly awesome. I read most of the above comment & found that not only me, many others facing this google indexing problem.

      So can you please tell me which is the best google sitemap plugin ???

    12. Mark Ford
      Twitter:
      October 31, 2013 at 12:32 am #

      Hi Andrew.

      I believe posting via Google Plus and other social media sites gets your site indexed quicker.

      Admittedly I don’t check often, but when I do I find the articles I feature on my blog appear in search the same day they are published.

      Social media is the centre of my marketing strategy so reasonable to assume that is a reason?
      Mark Ford recently posted..5 Awesome Web Design Tips to Increase ConversionsMy Profile

    13. Steve from Weight Loss Hypnosis
      Twitter:
      October 31, 2013 at 6:20 am #

      I am so pleased there are technical experts out there Andrew. I love running my business and I enjoy blogging lots. As for the technical elements I pass my ball to you!

      Thanks for all the useful tips!
      Steve Miller
      Steve recently posted..How Weight Loss Hypnosis Can Help You Lose WeightMy Profile

    14. Justin
      Twitter:
      November 2, 2013 at 5:30 am #

      Great article! I am definitely going to use these tips on my blog.
      Justin recently posted..Photo Essay: The Truly Captivating Bay of Kotor, MontenegroMy Profile

    15. Arbaz K
      Twitter:
      November 3, 2013 at 6:15 am #

      These are some great tips to make Google crawl your site often.
      I normally make sure that I publish a post at least twice a week so that it looks fresh all the time. But sometimes it takes me weeks to publish the one post.
      Thanks for sharing all these tips with us 🙂
      Arbaz K recently posted..Selling Old DVDs to Make Some Space in Your HouseMy Profile

    16. Robert Simons November 5, 2013 at 3:38 am #

      A little Bible for any blog! 🙂 Going to print it and place on the wall! Thanks for reminding simple but not evident things! 🙂

    17. Andrew from SEO Advice
      Twitter:
      November 5, 2013 at 5:45 am #

      Thanks, Robert…glad it helps.

      I think sometimes we forget the simple things!

      Andrew
      Andrew recently posted..How To Format Links for Improved Search Engine OptimizationMy Profile

    18. yathav November 17, 2013 at 7:55 am #

      i believe presence of “stop words” such as (a , an , the) in the permalink also affects crawl rate. also whenever i post a fresh content say an article the crawl rate doesn’t significantly improving. But some times it will be exceptionally high and i don’t know why.Also i’m following the above said things in my blogs and i get a crawl rate of 85/day. please any one say are there any miscellaneous things to increase crawl rate. ALSO don’t forget to mention what is the optimum crawl rate for a site??

    19. Ahtisham November 20, 2013 at 12:47 pm #

      As far as i concern i understand many thing from your single post. thank you . I use blogspot and try to focus on quality not quantity but still not in good list of google . try to work hard to crawl google but it left . i thought i had unique posting but they did not work for me . well it was nice to read the good article . Try to gether my energy again and focus what you taught .

    20. Anurag November 23, 2013 at 3:09 am #

      Posting quality content, frequently is the sure shot way to get more love from Google and making the Google crawler crawl your website frequently.

      Any other “shady” Blackhat SEO tip is not worth taking the risk for all the hard work you are willing to do on your blog/website.

    21. Ajay
      Twitter:
      November 23, 2013 at 10:51 pm #

      Awesome tips!
      Writing unique and quality content everyday makes Google crawl our blog frequently. Link building and internal linking lets Google bot crawl our blog further more frequently.
      Ajay recently posted..Create Infographics In Minutes Using Pre-Designed Vectors And LayersMy Profile

    22. Arun Kallarackal November 24, 2013 at 1:28 am #

      Hi Andrew,

      First of all, let me tell you that it was a well written and useful article. I’ve been implementing some of the suggestions you provided above. But some are new to me. Will start making use of them soon.

    23. Sohail Ahmed December 14, 2013 at 5:19 am #

      Above in the backlinks section you have mentioned that can get backlinks by commenting blogs, but those links always give backlinks with nofollow? Is nofollow backlinks are good for search engines?
      Sohail Ahmed recently posted..23 Best Commentluv Enabled Blogs to Get High PR BacklinksMy Profile

    24. Sagar
      Twitter:
      February 10, 2014 at 2:10 am #

      Hi

      I too agree that “nothing beats organic, natural, search engine traffic”.

      Well as far as I know having a regular unique content posting and having quality back-links are the two important practices if done then Google would crawl your blog more often .

      Nice post . Thank you for sharing .
      Sagar recently posted..5 Types of People Who Can Never Enjoy LifeMy Profile

    25. Sagar
      Twitter:
      March 5, 2014 at 4:52 am #

      Nice and informative post

      The best way for Google to index your blog is using proper and basic SEO techniques in a better way. SEO techniques means only white hat SEO methods. Some of them are discussed on the above article like having unique content and posting them on daily basis. Having better internal linking with in the blog.
      Having back links from good sites rather than weak sites. All these methods automatically makes your blog indexed by search engines.Another important thing is use of images in blog posts and optimization of those images .

      One thing you should remember is never use black hat SEo methods never do over optimization as it could lead to spam.

      Thank you for sharing.
      Sagar recently posted..10 steps to negotiating a higher salaryMy Profile

    26. Sudipto April 21, 2014 at 2:22 am #

      Hey Andrew,
      Nice post and thanks for sharing these effective tips with us. Yes, publishing post consistently is very important and these days image also plays very important role. Interlinking helps in decreasing bounce rate. These tips really gonna help all the newbies.
      Sudipto recently posted..Best Android Phone Under 5000My Profile

    27. Samir May 6, 2014 at 9:34 pm #

      Well it’s essential to build backlinks and also submit the posts at search engines for easy crawling of blogs. You’ve shared some really informative tips.

      Thank

    28. David December 2, 2014 at 8:41 am #

      I think the best way to rank well on google is to write good content

    29. abhay January 20, 2015 at 10:12 am #

      Great info in this post! I agree that quality back links together with quality content posted in regular basis gets you content high ranked !
      thanks for sharing this wonderful knowledge.

    30. Abrar Ahmed April 29, 2015 at 9:44 pm #

      Thanks andrew for such a great insight on web page crawling. I have a blog too and my hosting provider provides me the service to ping every blog post to major search engines and you mentioned this thing too. Thanks so much for this sir.

    Leave a Reply

    CommentLuv badge
    Please note: Here at WeBuildYourBlog.com, we welcome your comments...supportive, critical or otherwise. However, we censor and delete all comments if they contain the following: Off-topic statements, links to sales pages or services, abusive content, vulgarity, personal attacks, spam or simply saying 'nice post...keep it up!'. Those who violate this policy will be blocked from commenting.
    66 Flares Twitter 0 Facebook 0 Google+ 38 LinkedIn 28 Email -- Buffer 0 66 Flares ×