_20100901165816.jpg)
Welcome Back! This is a DoFollow blog using both KeyWordLuv and CommentLuv, so please leave a comment and get a link-back to your blog.
There are literally thousands upon thousands of blogs on the internet. There are blogs about every niche imaginable. As such, there is a great deal of competition out there. Bloggers all have a variety of techniques they use to obtain traffic. However, most people agree that nothing beats organic, natural, search engine traffic.
Blogs and web pages are picked up regularly by Google and ranked in order of relevance. Google crawls some blogs more quickly than others, depending on relevance, backlinks, etc. The pages that are indexed quickly referred to as “authority” pages. If you want your blog to be indexed quickly, you need to increase its relevancy and value.
Here are a few tips for optimizing your blog so that Google will crawl it more often:
- If you can, update your blog every single day with unique content. Web pages with duplicate content are indexed very slowly, if at all. The content should be informative, have some targeted keywords (a keyword ratio of under 2%), and consist of no “fluff” or “padding”.
- Optimize even the images on your blog. Don’t just label them as “pic1.jpg” or “pic2.gif”, describe what they are. You could also name each image as an important keyword. Use the WordPress plugin, SEO Friendly Images
- Make sure your posts are internally interlinked professionally (i.e. link from one blog post to another), and that your blog is easy to navigate through. The more posts your blog has, the better. However, don’t compromise on the quality. It’s better to have ten informative, well-written, and unique posts than twenty bad ones.
- Turn on the trackback and pingback options for every single post. Many people don’t realize the importance of this, especially in regards to a Google crawler. With these options on, you will be directing a Googlebot to crawl and find your new posts. Use the MaxBlog Ping Optimizer plugin.
You can see exactly how to set up the plugin here: Increase blog traffic
- Try getting as many quality backlinks from relevant sites as possible. One way you can do this is publish some good articles in article directories and add your link to the “resource box”. Some directories will let you add two links, and some even three. These sites get ranked very high by Google, so your articles (with the links) will be indexed rather quickly.
- Keep your URLs simple, yet effective. Long, complicated URLs take longer to find and index. You need to make them easy to remember and to the point. And, as mentioned above, all of the URLs within your blog need to be organized, easy to find, and directly linked to the relevant content. All of your old posts need to be linked to all of your new posts. Use the Clean Slugs plugin. You do have to join Yoast’s newsletter to get this plugin but it’s well worth it.
- There is some dispute as to whether black hat SEO methods are worthwhile. While using such methods probably will get your blog indexed quickly, they’re extremely risky and your blog can end up being banned. It’s therefore safer to use white hat methods, as they will ensure that your blog will be indexed more quickly over time.
In summary, you can get Google to crawl your blog more quickly by making it as search engine friendly as possible. This means all of your URLs need to be organized, your content needs to be unique, the keywords need to fit in naturally and not overstuffed, etc. Google loves authority websites, so try to make yours as relevant as possible.
What tips do you have to make Google crawl your blog more often? Share them in the comments below.
_______________________________________________________________________________________
I was impressed with the excellent service. The entire job was performed with total customer focus. Nothing was too much work and all requests were delivered with minimum fuss.
65 Comments
December 18th, 2009 at 3:39 am
Twitter: JayceOoi
I set crawl rate in Google Webmaster Central. So far so good.
[Reply]
December 18th, 2009 at 5:06 am
I try to update everyday and submit to different social bookmarking sites and all are good then
[Reply]
December 18th, 2009 at 6:18 am
Just post fresh content daily and Google bot will visit every day.
[Reply]
December 18th, 2009 at 6:33 am
Twitter: moonheart85
Like to read the post. Well I want to elaborate my opinion here.
My each blog post index within few minutes after published. My blog niche is work at home, As far as I know that google rank a page according to the number of quality backlinks, but I have seen some huge difference on backlinks and search engine ranking. Some sites only getting a few hundred backlinks are top ten on google for keyword “work at home” and some other getting thousand backlink not top ten rank on google.
What other people think about it?
[Reply]
Andrew Rondeau Reply:
December 19th, 2009 at 8:03 am
Twitter: andrewrondeau
Chandan,
As you say it’s about the QUALITY of the backlink. Thousands of backlinks from pages with PR of 0 are not as good as 100 backlinks from pages with PR3+…but only Google have the real answer!
Andrew
[Reply]
chandan Reply:
December 21st, 2009 at 6:35 am
Twitter: moonheart85
Ok, but I have analyzed some of the scam sites that top ten on google for keyword “work at home”, most of backlink they are getting by posting on free classified sites and spam on forum. I do not think that link from free classified sites are quality link. I already discussed about it DP forum but no can can explain about it.
[Reply]
December 18th, 2009 at 11:17 am
Twitter: http://www.bloggingwithchris.com/
Amazing technique Andrew Rondeau, I am absolutely agreed with you. If we want to make Google Crawl then quality back link and updating unique content is most necessary. Another process is adding Google site map and submitting in all major search engines after posting content in Blog.
[Reply]
Andrew Rondeau Reply:
December 19th, 2009 at 8:00 am
Twitter: andrewrondeau
Chris,
You are right about adding a Google site map – definitely worth doing. Use the plugin ‘Google XML Sitemaps‘.
Andrew
[Reply]
December 18th, 2009 at 3:42 pm
Twitter: danalingga
My tips is activated the pingomatic.
Btw, keep your URL simple seems a great advice. I will try to optimize my URL from now on. Hope it will give better result according search engine.
[Reply]
Andrew Rondeau Reply:
December 19th, 2009 at 7:58 am
Twitter: andrewrondeau
Dana
I hope you have added all the ‘ping’ sites to your settings!
Easiest way to optimize your URL is to use the plugin ‘Clean Slugs’ as mentioned in the post.
Andrew
[Reply]
December 18th, 2009 at 8:26 pm
In summery,there are three important roles 1)write quality content 2)update reguraly 3)increasing backlinks in quality sites
But one thing I’m not sure,could you tell me Andrew?Does the backlinks in comments count?
[Reply]
Andrew Rondeau Reply:
December 19th, 2009 at 7:55 am
Twitter: andrewrondeau
Darni,
Re: comments.
Depends upon the site where you are commenting. Some do, some don’t. It depends upon whether they have the ‘dofollow’ function set up. My site does, so you do get a backlink when you comment here.
Thanks.
Andrew
[Reply]
December 20th, 2009 at 1:51 pm
In my own experience the fastest way to get indexed is to have a lot of backlinks. Not even the quality is that big of a deal there, just have someone link to your new content and you the indexing will be guaranteed.
You can do this by, commenting a lot on other blogs that have commentluv plugin installed. It will make your new stuff indexed in a few hours.
[Reply]
December 20th, 2009 at 8:03 pm
Well, I am using blogger, and although it IS very limited platform (NOW I see it, heh) I am satisfied with the frequency of how often Google crawls my site.
I check that very often, and since I write 1 post every 2-3 days, Google also crawls me every 2-3 days. I don’t even search for more at the moment
[Reply]
December 20th, 2009 at 11:26 pm
Twitter: cks1988
Yes! You are right! I try to update my blog on daily basis and Google will indexed my blog everyday. I think this is the best way to make Google crawl our blog regularly.
[Reply]
December 21st, 2009 at 2:38 am
[...] income presents Tips for Making Google Crawl Your Blog More Often posted at blog income. saying, If you want your blog to be indexed quickly, you need to increase [...]
December 21st, 2009 at 2:43 am
Thanks for your submission to the Seventy Third edition of the Blog Carnival: Blogging. Your post has been accepted and its live:
http://thatsblog.com/blog-carnival-blogging/blog-carnival-blogging-seventy-third-edition
-ThatsBlog.com
[Reply]
December 21st, 2009 at 6:50 pm
Twitter: element321
Hi, great post. I recently started a new blog. I found that posting regulary and commenting on sites is the best way to get indexed. Just in the few weeks its been up, I have already seen more traffic to the site.
I try and find sites that allow dofollows and commentluv. Even if they do not allow those services, I still tend to comment on those sites I find of value. Even without these services, you can still get new readers and get backlinks that way. – Yes I know it won’t be much. But if you can provide additional information to that blogging community it is always worth it in my opinion.
[Reply]
Andrew Rondeau Reply:
December 22nd, 2009 at 9:26 am
Twitter: andrewrondeau
Element321
People think there is a silver bullet to get truckloads of traffic and there isn’t. It just common sense networking via constructive comments, guest posting, social bookmarking…
Thanks for dropping by and hope to see you again, soon.
Andrew
[Reply]
December 25th, 2009 at 4:51 pm
[...] presents Tips for Making Google Crawl Your Blog More Often posted at We Build Your Blog, saying, “If you want your blog to be indexed quickly, you need [...]
December 29th, 2009 at 10:28 pm
Twitter: gerlainetalk
I am using most of these tips and notice that I get crawled very often. I check my crawling status in the webmaster tool in google as well as in the adsense back office.
Thanks for these wonderful tips. Gotta tweet it!
[Reply]
Andrew Rondeau Reply:
December 30th, 2009 at 8:58 am
Twitter: andrewrondeau
Gerlaine,
Thanks for the Tweet – really appreciate it.
Andrew
[Reply]
December 31st, 2009 at 3:27 am
I think Google is already pretty quick at crawling blogs, but thanks for the great tips. Hopefully if I follow them Google’s quickness will continue.
[Reply]
January 5th, 2010 at 2:40 pm
google is crazy. with its alternative protocol SPDY to http.
now they gonna to pay attention to site opening speed.
new revolution ii SEO is on way
[Reply]
January 7th, 2010 at 12:22 am
[...] ) Tips for Making Google Crawl Your Blog More Often – WeBuildYourBlog There are literally thousands upon thousands of blogs on the internet. [...]
January 15th, 2010 at 5:07 pm
Twitter: seobloreexpert
Getting blog Google crawl is difficult. But all tips help to easy crawl. Just one word I can say creating unique content and submit to search engine will help to Google easily crawl.
[Reply]
Andrew Rondeau Reply:
January 15th, 2010 at 7:04 pm
Twitter: andrewrondeau
Pravakar
It’s creating that great unique content that’s te hardest, isn’t it?
Andrew
[Reply]
February 26th, 2010 at 8:08 pm
Twitter: sonlinebiz
Eye opener. I always thought adding alt and title tags to images was the only SEO needed for images. I never knew that the actual name of the image mattered.
Now my problem might just be that I have my robots.txt blocking google from accessing my wp-content folder. Is that a good thing for people looking to gain traffic via image searches?
Udegbunam Chukwudi@Earn Online Nigeria´s last blog ..StrictlyOnlineBiz’s Top Blog Posts Of The Week 8
[Reply]
Andrew Rondeau Reply:
February 27th, 2010 at 8:15 am
Twitter: andrewrondeau
Udegbunam
Great question!
For what we know, the GoogleImage bot tracks down images from the posts where the images where inserted.
If so, you can still block your wp-content folder from being accessed.
Andrew
[Reply]
March 23rd, 2010 at 8:49 pm
I think White hat methods are a long term investment, while black hat methods are like matches: they burn with a nice flame, but they consume very fast.
Thanks for saying that clear again in your post.
Neguletu Octavian´s last blog ..KEYWORD ELITE 2.0 Review
[Reply]
Andrew from Blogging Guide Reply:
March 24th, 2010 at 9:18 am
Twitter: andrewrondeau
Neguletu
What you say is true…unfortunately so many want quick results and fall into the trap of black hat methods.
Andrew
Andrew @ Blogging Guide´s last blog ..Product Reviews
[Reply]
April 19th, 2010 at 6:04 pm
I totally agree with all the tips but I’ve got a question with the very first one.
I really want more proof it it’s really true that duplicate content will make the indexing slower? I just wonder because most article directories get dup contents – does that mean they get their pages indexed much slower even if they are considered authority sites already, meaning with high page rank..
[Reply]
Koi Reply:
April 21st, 2010 at 7:33 am
I don’t know what I have to contribute as far as getting google to crawl more, but I have been frustrated lately with figuring out how long it takes for google to crawl!
Everyone KNOWS it takes a different amount of time depending on the site, but nobody seems to be able to tell you what the difference in time is.
Since google has crawled my site, it has grown immensely. I now have a page with a site map, I have unique buttons that I have created myself to help guide users (and I will be taking advantage of your ALT suggestion). And I’ve got a variety of pages.
I’m sure google will be impressed with my blog when it comes back, but until then, I will be checking obsessively everyday like a child waiting for a new toy in the mail until google finally crawls my site again.
Lastly, besides searching for the site on google, is there any other way to find out when the last time you got crawled is?
Thank you!
Koi´s last blog ..I was going to yell at my kid…..but then I got high!
[Reply]
Andrew from Blogging Guide Reply:
April 21st, 2010 at 12:48 pm
Twitter: andrewrondeau
KOI,
Have you submitted a site map to the Google Webmasters tools?
Have you installed the XML Google sitemap plugin?
Have you verified your site via the Google webmaster tools?
You can find out the last time via the Google Webmaster tools.
Andrew
Andrew @ Blogging Guide´s last blog ..Blogging Guide: Increase Your Traffic and Google Crawl Rate
[Reply]
koi Reply:
April 21st, 2010 at 4:15 pm
I have done all that except submitting a sitemap. I use blogger, and apparently, blogger (as part of google) creates its own sitemap, and so it’s not necessary, or so others say.
I’ve tried to find a place to add my own sitemaps, but that’s just not possible with blogger, and the sitemap it has is pretty comprehensive.
However, I have just now told google to use the feed as a sitemap as per an option I found in Google Webmaster.
I’ve already verified it (with the meta link) and it says it has 9 pages indexed, but no matter how I try to tweak the search allinurl: site: et cetera, it only comes up with 4 pages, and it says it crawled it just today.
I looked at my crawl statistics, too, and they seem to be doing fairly well (considering I don’t have many pages).
koi´s last blog ..I was going to yell at my kid…..but then I got high!
[Reply]
Andrew from Blogging Guide Reply:
April 22nd, 2010 at 11:03 am
Twitter: andrewrondeau
Kio,
Just keep submitting great new unique content as often as you can and eventually Google will index more pages. There is often a difference between pages on your site and pages indexed by Google.
Andrew
Andrew @ Blogging Guide´s last blog ..Blogging Guide: Increase Your Traffic and Google Crawl Rate
[Reply]
May 1st, 2010 at 2:03 pm
I am new to internet marketing but agree that natural or organic SEO is the most powerful and effective. Regularly updating the content on your blog has worked so far for me although it can be alot of work if you have multiple sites.
Paul @ Lobster Costume´s last blog ..Disclaimer
[Reply]
Koi Reply:
May 2nd, 2010 at 9:38 pm
Yea, I have multiple sites (all linked back to my main site through a separate page).
Google has a whole bunch of my pages indexed now, but none of my sites are ranked! I looked at google page rank history, and they only update it like 3-4 times a year. D=
I’m too impatient to wait that long…
Koi´s last blog ..End of The Semester
[Reply]
Andrew from Blogging Guide Reply:
May 5th, 2010 at 9:48 am
Twitter: andrewrondeau
Being successful at blogging is all about being patient.
Andrew
Andrew @ Blogging Guide´s last blog ..Win The Latest 8G iPod Nano: Enter The Simple IncomeBloggingGuide.com Contest
[Reply]
May 11th, 2010 at 1:39 pm
Twitter: mothersland
Thanks for sharing this tips, it is very useful. I dont know that Wordpress have a plgin for image optimization, till I read this article. I have down SEO friendly images and I active it for my blog. Image in post is another good way to enable Google crawl your post fast and rank it well in search engines
[Reply]
Andrew from Blogging Guide Reply:
May 13th, 2010 at 12:53 pm
Twitter: andrewrondeau
I’m glad the log post helped, Luqman.
Andrew
Andrew @ Blogging Guide´s last blog ..Make A Blog Income Without Working Hard
[Reply]
May 12th, 2010 at 5:35 am
Twitter: babor_7uiu
But how does a bot know if a site is updated if they don’t crawl it first? It sounds a bit strange to hear, sounds reverse somehow.
[Reply]
Andrew from Blogging Guide Reply:
May 13th, 2010 at 12:56 pm
Twitter: andrewrondeau
Babor,
By pinging other sites when you do publish something new – Google crawls those sites first and sees you have published something new…so crawls yours.
Hope that makes sense.
Andrew
Andrew @ Blogging Guide´s last blog ..Make A Blog Income Without Working Hard
[Reply]
May 15th, 2010 at 7:28 pm
Twitter: shilohstreet
I’ve been wondering if the images in my posts were important to Google. Wasn’t quite sure how to optimize them or if they even needed to be. I’m going to check out that plugin you suggested.
Thanks again Andrew,
Jason
Jason@Real Estate Lead Generation´s last blog ..Internet Leads for Agents – Big Scam or Goldmine?
[Reply]
Andrew from Blogging Guide Reply:
May 17th, 2010 at 4:09 pm
Twitter: andrewrondeau
Jason,
Images can make a huge difference to your search engine results. That plugin can help.
Andrew
Andrew @ Blogging Guide´s last blog ..Working From Home: The Pros and Cons
[Reply]
June 24th, 2010 at 7:45 pm
Twitter: makeitmp3
The mystery of google. Thank you for putting out this onfo. I will integrate it into my list of things to help with the indexing process.
James´s last blog ..Youtube to Mp3
[Reply]
Andrew from Blogging Guide Reply:
June 25th, 2010 at 9:20 am
Twitter: andrewrondeau
James
I hope they help!
Andrew
Andrew @ Blogging Guide´s last blog ..Blogging Guide: More FeedBack On Our Free Guide
[Reply]
James Reply:
June 25th, 2010 at 2:00 pm
Twitter: makeitmp3
In your opinion must a new website/page have at least one incoming link in order to be indexed by google?
James´s last blog ..
[Reply]
Andrew from Blogging Guide Reply:
June 26th, 2010 at 2:05 pm
Twitter: andrewrondeau
James
Not it’s not a MUST but it helps speed up the indexing.
New websites can take several weeks.
Andrew
Andrew @ Blogging Guide´s last blog ..Blogging Guide- More FeedBack On Our Free Guide
[Reply]
June 28th, 2010 at 6:46 am
Twitter: insidehacks
Great! You have mentioned each and every strategy to get backlinks. I am already optimizing images, working on internal links and high PR backlinks to get my site index. But one of my blogging friend has told me that in Google webmaster tool, you have the option to change the crawl rate upto 5000%. What do you say about it ?
Alex @ InsideHacks´s last blog ..FIFA World Cup-An Interesting Fact
[Reply]
Andrew from Blogging Guide Reply:
June 28th, 2010 at 5:59 pm
Twitter: andrewrondeau
Alex,
I’m not sure what that means: “you have the option to change the crawl rate up to 5000%”.
I know you can tell Google to crawl your site daily via the webmaster tools but it doesn’t mean they index all pages and posts. You still need the backlinks.
Andrew
Andrew @ Blogging Guide´s last blog ..Am I being Scammed Again
[Reply]
Alex from InsideHacks Reply:
June 29th, 2010 at 4:22 am
Twitter: insidehacks
He goto Google Webmaster tool -> Site configuration -> Settings
There you will see Crawl Rate. The tags to its slider are:-
Slower: May reduce freshness and number of crawled pages
Faster: May increase Googlebot traffic on your server
Check it out
Alex @ InsideHacks´s last blog ..FIFA World Cup-An Interesting Fact
[Reply]
July 15th, 2010 at 7:28 pm
Twitter: JohnAguiar
Great tips.. getting crawled frequently is the best way to get seen.. more content, more crawling
John Paul Aguiar´s last blog ..Shoemoney System Weapons Of Marketing Blueprint
[Reply]
Andrew from Blogging Guide Reply:
July 18th, 2010 at 7:49 am
Twitter: andrewrondeau
Thanks, John.
Nice to see you here – how’s things?
Andrew
Andrew @ Blogging Guide´s last blog ..A Thank You Goes A Long Way
[Reply]
John Paul Aguiar Reply:
July 18th, 2010 at 2:44 pm
Twitter: JohnAguiar
Glad to be here
Things are good…have a new site coming out.. I’ll be contacting you soon
How things with u?
John Paul Aguiar´s last blog ..Shoemoney System Weapons Of Marketing Blueprint
[Reply]
Andrew from Blogging Guide Reply:
July 19th, 2010 at 10:45 am
Twitter: andrewrondeau
Yeah – let me know about your new site, when ready.
I’m busy – quite a few more clients which is great. Plus promoting our blogging course.
All good stuff!
Andrew
Andrew @ Blogging Guide´s last blog ..BackupBuddy Now Supports Amazon S3
[Reply]
John Paul Aguiar Reply:
July 19th, 2010 at 12:07 pm
Twitter: JohnAguiar
I will let you know.
Congrats on the blogging guide and new clients
John Paul Aguiar´s last blog ..Shoemoney System Weapons Of Marketing Blueprint
[Reply]
July 31st, 2010 at 3:04 am
Twitter: JulieBMack
Thanks for these tips. I have noticed more traffic since I started posting almost every day. I also noticed an increase when I moved to the Thesis theme – not sure why that is. The bottom line I think is still quality content, to get people coming back.
Julie´s last blog ..Marketing Your Book Online to Promote your Offline Book
[Reply]
Andrew from Blogging Guide Reply:
July 31st, 2010 at 7:42 am
Twitter: andrewrondeau
Julie
Quality content and, of course, promotion…will always work.
Andrew
Andrew @ Blogging Guide´s last blog ..173 Tips For A Quality Life While Working From Home
[Reply]
August 1st, 2010 at 11:23 am
Twitter: oisidore
I really appreciate this post Andrew because it has really good suggestions to improve crawls. My first goal is to post every day as mentioned. Something else that I discovered that can get more Google,Yahoo, or MSN crawls is by simply updating your email profile page(ex. yahoo,gmail,msn) with comments and leaving your personal link after the comment. I have noticed that Google crawls my page within 24-48 hours of doing this and got one of post indexed already. I will bookmark your site.
omowali isidore´s last blog ..Yahoo Backlinks – How to get backlinks from Yahoo in 7 days
[Reply]
Andrew from Blogging Guide Reply:
August 2nd, 2010 at 9:42 am
Twitter: andrewrondeau
Omowali
Thanks for the idea and pleased your posts are getting index pretty fast!
Andrew
Andrew @ Blogging Guide´s last blog ..Take The Stress Out Of Blogging
[Reply]
August 11th, 2010 at 2:39 am
Twitter: GardeningFun
PageRank will set the level of how deep Google will crawl and as to how many pages will be indexed.
Whitney Segura´s last blog ..Tips for Building Back Links to Blogs with Comment Kahuna
[Reply]
Andrew from Blogging Guide Reply:
August 12th, 2010 at 9:27 am
Twitter: andrewrondeau
Whitney,
Really?
Are you saying the higher your Page Rank is, the more Google will crawl and index your pages?
Andrew
Andrew @ Blogging Guide´s last blog ..Do NOT Buy Rapid Video Blogging Course
[Reply]
August 14th, 2010 at 12:31 pm
Twitter: insidehacks
There is an option in Google webmaster tool by which you can increase the speed of google crawling. Its in the Settings..check it out
Akif@InsideHacks´s last blog ..SAMAA TV Channel
[Reply]
Andrew from Blogging Guide Reply:
August 16th, 2010 at 5:37 pm
Twitter: andrewrondeau
Akif,
Why would you want to increase the speed?
Andrew
Andrew @ Blogging Guide´s last blog ..Link Building Campaign- Why Is It Important
[Reply]