About this site...

I can't get rich online and neither can you. Topics include why you won't get rich with your blog, ideas you wish you had thought of, and other Internet phenomena.

Don't kid yourself...

You want to get rich with your blog? Maybe you think Adsense will let you retire? Sorry, it's not going to happen.

You Can’t Get Rich if You Fail at SEO

Hello, my name is Geoff, and I’m an SEO failure.

Hi, Geoff.

I realize that SEO is an incredibly important part of driving traffic to a site. I use plugins designed to make this blog search engine friendly like XML Sitemap Generator and Optimal Title, but I’m just not getting traffic from search engines. Day after day, I wondered why I was getting 0 hits from everything except Google. Then I realized the problem.

robots.txt

My robots.txt was blocking everything except the googlebot. Doh. While searching for a way to fix this problem, I found a site that will generate a robots.txt file automatically! You can even specify which bots you want to allow. Problem solved.

In case you’re wondering, a functional robots.txt looks like this:

User-agent: *

Disallow:

Disallow: /cgi-bin/

Sitemap: http://www.yoursitehere.com/sitemap.xml

That’s pretty bare-bones, but it gets the job done. Basically, it allows all search engine bots, tells them to stay out of my cgi-bin folder, and tells them where to find my sitemap. If you didn’t write it yourself, I’d recommend checking your robots.txt file (usually found at the root directory of your site).

If you enjoyed this post, make sure you subscribe to my RSS feed!

Leave a Reply

Recent Readers. These are the awesome people that read my blog! Recent Readers