Tips for Making Google Crawl Your Blog More Often

Tips for Making Google Crawl Your Blog More OftenThere are literally thousands upon thousands of blogs on the internet. There are blogs about every niche imaginable.  As such, there is a great deal of competition out there.  Bloggers all have a variety of techniques they use to obtain traffic.  However, most people agree that nothing beats organic, natural, search engine traffic.

Blogs and web pages are picked up regularly by Google and ranked in order of relevance.  Google crawls some blogs more quickly than others, depending on relevance, backlinks, etc.  The pages that are indexed quickly referred to as “authority” pages.  If you want your blog to be indexed quickly, you need to increase its relevancy and value.

Here are a few tips for optimizing your blog so that Google will crawl it more often:

  • If you can, update your blog every single day with unique content. Web pages with duplicate content are indexed very slowly, if at all.  The content should be informative, have some targeted keywords (a keyword ratio of under 2%), and consist of no “fluff” or “padding”.

  • Optimize even the images on your blog. Don’t just label them as “pic1.jpg” or “pic2.gif”, describe what they are.  You could also name each image as an important keyword.  Use the WordPress plugin, SEO Friendly Images

  • Make sure your posts are internally interlinked professionally (i.e. link from one blog post to another), and that your blog is easy to navigate through.  The more posts your blog has, the better.  However, don’t compromise on the quality.  It’s better to have ten informative, well-written, and unique posts than twenty bad ones.

  • Turn on the trackback and pingback options for every single post. Many people don’t realize the importance of this, especially in regards to a Google crawler.  With these options on, you will be directing a Googlebot to crawl and find your new posts. Use the MaxBlog Ping Optimizer plugin.
    You can see exactly how to set up the plugin here: Increase blog traffic

  • Try getting as many quality backlinks from relevant sites as possible. One way you can do this is publish some good articles in article directories and add your link to the “resource box”.  Some directories will let you add two links, and some even three.  These sites get ranked very high by Google, so your articles (with the links) will be indexed rather quickly.

  • Keep your URLs simple, yet effective. Long, complicated URLs take longer to find and index.  You need to make them easy to remember and to the point.  And, as mentioned above, all of the URLs within your blog need to be organized, easy to find, and directly linked to the relevant content.  All of your old posts need to be linked to all of your new posts. Use the Clean Slugs plugin. You do have to join Yoast’s newsletter to get this plugin but it’s well worth it.

  • There is some dispute as to whether black hat SEO methods are worthwhile. While using such methods probably will get your blog indexed quickly, they’re extremely risky and your blog can end up being banned.  It’s therefore safer to use white hat methods, as they will ensure that your blog will be indexed more quickly over time.

In summary, you can get Google to crawl your blog more quickly by making it as search engine friendly as possible.  This means all of your URLs need to be organized, your content needs to be unique, the keywords need to fit in naturally and not overstuffed, etc.  Google loves authority websites, so try to make yours as relevant as possible.

What tips do you have to make Google crawl your blog more often? Share them in the comments below.

_______________________________________________________________________________________




If you enjoyed this post, please consider leaving a comment or subscribing to the RSS feed to have future articles delivered to your feed reader. My Google+: Google+
161 Responses to Tips for Making Google Crawl Your Blog More Often
  1. Carl

    I can attest to the effectiveness of your tip #2 on images as I have a static site getting regular traffic from Google image search. I never heard until now about your tip on turning on trackbacks, I didn’t know it has SEO benefits. Thanks for that.
    Carl recently posted..Graco Car Seat CoverMy Profile

  2. Hey..thnkxx i m learning a lot from here which I will apply on my blogs..
    best seo optimzed posts have
    H1, h2, h3 keyword
    pics alternate text
    atleast 200 words with keyword bold..
    Tags that are more appropiate,, better research google adword..
    Android Mobiles and Tablets recently posted..Motorola MOTO XT882 Dual sim CDMA/GSM, Dual Core Android Mobile | Review, specs and priceMy Profile

  3. Never tried optimizer plugin. Is it really necessary ? I always try my best to reduce the use of plugins.
    Nasif recently posted..Will Facebook’s Drop in Users Lead to a Drop in Crime?My Profile

  4. You show many ways, it’s a good tips, Thanks! Usually I just use the “lazy-way”, that is making a few quality backlink or just dropped comments on a good site/blog
    Ron Smith recently posted..Vital Exercise to Reduce Your Man BoobsMy Profile

  5. Getting your blog crawled or indexed by Google quickly isn’t that complicated, I think. One just needs to find out how Google crawls and indexes different websites. Then go where Google is likely to be indexing.

    • Kevin,

      Not easy?

      You make it sound hard.

      How do you find out how Google crawls and indexes different websites?

      And how do you know where to go where Google is likely to be indexing?

      Andrew
      Andrew recently posted..50 Thoughts On Creating The Best Blog Content…Ever!My Profile

      • Ramcel

        My thoughts exactly! Nobody knows how the algorithm of Google works when they crawl and index sites. It’s their trade secret. There may be products out there that promises you to rank to the top of Google overnight but that’s totally baloney. Nothing beats organic search engine traffic.

        Great practical tips you got here Andrew and I hope you don’t mind. I want to include this awesome post in my blog carnival for my readers to see. I will tweet you once I got it published on my blog.
        Ramcel recently posted..Why Your Blog Just Screams and BegsMy Profile

        • Ramcel

          Please incude in your blog carnival – would be great.

          I’ll also add your blgo carnival to my weekly submissions.

          Thanks.

          Andrew
          Andrew recently posted..How Many Man Drawers Do You Have?My Profile

          • Ramcel

            Hi Andrew,

            Its gone Live and I’ve tweeted you! You can check the blog carnival at this link:

            Bunch O’ Blogs

            Thank you and please do include my blog on your weekly submissions.

  6. Hello Andrew,

    Can you give us some information on how to do interlinking internal post? is this something to do with HTML configuration or can you do this off wordpress directly?

    Thanks
    irene recently posted..dating for menMy Profile

  7. Rancell

    This is very true. Google have a very good set of criteria in their search engine to index the relevance of blogs according to searches. If your blog is having a lot of traffic and page rank, it opens up into a business opportunity.
    Rancell recently posted..angry birds androidMy Profile

  8. you also can resubmit your sitemap to Google , Google will crawl again if they found something new on your website or blog.
    You may download seo powersuite to ping Google.
    The more frequent you update your content , the more frequent google will crawl your website

  9. Joshua Squires

    Thanks for the tips. Unfortunately, I’ve done most of these already. I guess it’s time I go through my blog and eliminate less relevant posts.

  10. My blog has not been crawl for over a month now an i have quality contents on it. I don’t know what the problem might be.
    You made mention of quality backlink? Please do you recommend any website for this?

  11. I am presently using a blogspot.com domain and want to switch over to a custom domain, should i go ahead adding backlinks on my present blog?

  12. Thanks, for these tips…I think Google will now start crwaling my blog more often and starting indexing my articles.

  13. Shah Alam

    What a brilliant post. You should do a series! :) I did a sort of blogging for dummies over
    on one of the craft forums and I thought it was too simple for them, but the amount of
    emails I got asking questions just like what you addressed was unbelievable. As young
    people today we have grown up with computers, but it’s easy to forget that even people just a few years older have not! Really good post! :)
    Shah Alam recently posted..printable birthday cards for momMy Profile

  14. Regularly adding new content and optimizing images are useful strategies as is on page SEO (internal linking). The latter is something many bloggers are obviously unaware of given the number of articles I read on sites that have no internal linking at all.
    Jonathon recently posted..Discreet Shopping OnlineMy Profile

  15. rey

    Yeah, i think the more you get backlinks, the more you’ll rank in google..but I really don’t know for sure..it’s really confusing for me sometimes ..maybe it also depends on the keywords you use so people would visit your site..
    rey recently posted..How to Deal with Someone Who Ignore YouMy Profile

  16. Hi Andrew,
    Thanks for all the help. Great site :0)
    I wondered if you could help me… I’ve just started a site where I give away freebies. But I’ve been putting Amazon ads at the end of each post, as part of the post. Do you think this prohibits a Google crawl? I’ve been adding two to three posts per day for just under a month and I’ve not been crawled yet. I submitted my blog address to Google about a week ago. I’ve linked from my regular blog and from my partner’s blog. And I’m getting a few visitors from Twitter, but only 20 or so per day. Is it just early days? Or should I take the Amazon html away from the posts?
    Petra Brown recently posted..Meadow Brushes for PhotoshopMy Profile

  17. Sagar from Android Apps
    Twitter:

    Google loves fresh content and hence it is the 1st search engine to crawl content on my blog within a few minutes of publishing also Google loves backlinks which contribute to a higher PageRank which is crawled often. Thanks for sharing the tips Andrew. :)
    Sagar recently posted..Blogger Redirecting Visitors to Country Specific URLsMy Profile

  18. thanks for sharing this information >From several days my website postings is going too late to crawl for your valuable tips i will try to decrease that length of taking time
    thanks for u r suggestions that will helped me a lot
    once again THANKS FOR SHARING THIS INFORMATIOn
    Eamcet recently posted..How to Pay Eamcet 2012 Online Application fees Payment APonline or E-seva Counters OnlineMy Profile

  19. Hi Mr. Andrew,
    Nice post/Blog, I’m on learn SEO/IM, your blog give so many tips to support SEO/IM, thanks for sharing.Thanks ya, Erni
    Erni recently posted..Diet ProgramsMy Profile

  20. To get indexed quicker, use Google friendly code and keep a well structured HTML.

    Also ping your posts each time they are published
    How to Fall Asleep Easier recently posted..Alcohol and Sleep DeprivationMy Profile

  21. WayneBrown from CellphoneDiary
    Twitter:

    Just writing fresh relevant content 3 to 5 times a week should be enough in my opinion. But as a newbie blogger, try to at least add new RELEVANT content no less than 5 days for the week….worst case scenario do it every other day. And remember good grammar. No gibberish!
    WayneBrown recently posted..Some ‘funny’ GOOGLE STREET picsMy Profile

  22. I agree with this tip “Keep your URLs simple, yet effective”. Thank you for sharing I’ve got a lot of ideas from the post as well as from the comments.
    Phoebe Sayers recently posted..Thermogenic Fat Loss SystemMy Profile

  23. pretty neat tips for a blogger like me . the content is the most importantly to be updated daily without fail, i plan to interlink posts !! from now on. thanks!!1

  24. Kristen

    By adding a Sitemap, you are simply helping Google to Crawl your Posts/Images Better. But keep in mind that Google will add and display only those results in it’s Search Engine which it feels suitable, though it will crawl all the available URLs.
    Kristen recently posted..WoW Leveling GuideMy Profile

  25. Great article helps me to unerstand a lot better what can bring back Google bots more regular. I have recently learnt that using the header editor in wordpress an bold/italic font can increase optimisation of your blog. Hope that is helpful!
    Gary Higham recently posted..SEO techniques to use on-site for bloggersMy Profile

  26. Keep your URLs simple, yet effective i think this is best way to avoid Penalty from Google in this time of PANDA :)
    ashvin recently posted..STAR News would be called ABP NewsMy Profile

  27. Hey, my blog is taking too much of time to update in google search after changing the domain, any idea for faster crawling mechanism
    quicknol recently posted..Online Application Karnataka High school teacher job post April 2012.My Profile

  28. Setting up an RSS feed button on your blog makes it easy for your loyal readers to not just read your blog but also know when you publish new content.
    jack recently posted..How Many Pinterest Users Can You Follow Daily?My Profile

  29. 1. Make your blog use Search Engine Friendly component
    2. Use Dedicated IP
    Rudy P recently posted..The benefits of having an ergonomically-correct work environmentMy Profile

  30. Wow, nice article here. SEO Friendly images? I never think of it. Thanks Andrew, I like to try it in my wordpress. :)
    Okto recently posted..Motor matic injeksi irit harga murah – Yamaha Mio JMy Profile

  31. Thanks a lot. I am very happy, i followed all your tips and they worked for me.
    I have also changed from blogspot.com to a custom domain and moved to wordpress too just as i stated in my previous comments.

  32. Daily updation of content on your site is very very important and if the site have inbound links than it is very beneficial for the site.
    AjayKumar recently posted..10 Of The Best Street Foods In MumbaiMy Profile

  33. Great information you have given in your this post thanks for sharing because i think crawling is very necessary part of any website or blog. Google crawl our website and give it rank or where it stand current time. Very good advice you have given how we can improve our website for better crawling or Google friendly.

    Thanks again
    shashi kumar recently posted..Microsoft hopes to lure Googlers with new Bing designMy Profile

We encourage you to comment on this blog. But please follow the guidelines below.

We reserve the right to make editorial decisions regarding submitted comments, including but not limited to the removal of comments.

If this is your first comment, it will have to be approved before being published.

Please add no comments that are:

  • just saying 'nice post, thanks' type comments
  • off-topic
  • defamatory
  • obscene
  • harmful to minors
  • offensive
  • violative of copyright or other third-party rights
  • otherwise inappropriate
  • with links to promotional type pages

Please use your real name and then @ your keywords - otherwise the comment will NOT be approved.

Leave a Reply

CommentLuv badge

This blog uses premium CommentLuv which allows you to put your keywords with your name if you have had 3 approved comments. Use your real name and then @ your keywords (maximum of 5)