Comments on: Better Check Your Robots.txt says Adsense

By: Fitz

Fitz — Fri, 13 Jun 2008 01:31:11 +0000

Thanks for the tips Dex.

Fitzs last blog post..The Relationship Of Obsolescence And Frugality Part 1

By: Dexter

Dexter — Thu, 12 Jun 2008 07:18:48 +0000

@ Fitz,

Generally I believe your robots.txt is fine, One thing I have seen is your robots.txt file does not restrict your page Page..Since your page ie.. http://fitzvillafuerte.com/page/2 is in excerpt it might also be considered as duplicate pages. Fo my site i have restricted it using as follows :

Disallow: /page/*/

Your Category page is also in excerpt mode.. you can also add

Disallow: /category/*/

this is to restrict access to your category page.

Above mentioned suggestion is only applicable if you don’t want your category and “page” page to be indexed but if not your robots.txt is fine

Dexters last blog post..Better Check Your Robots.txt says Adsense

By: Hussein

Hussein — Thu, 12 Jun 2008 04:11:58 +0000

I have added that line in my robot.txt Thanks for the great tip. I hope my adsense earning will be greater.

Husseins last blog post..What Motivates You To Blog?

By: Fitz

Fitz — Wed, 11 Jun 2008 16:40:25 +0000

I read this over at Inside Adsense blog just a while ago, I was wondering if I should do it because I usually see relevant ads for my pages. But you did it, so I would too. Shempre, idol kita sa SEO eh. Hehehe. If you have time, can you check my robot.txt file and see if it’s okay. Thank Dex.

Fitzs last blog post..Things To Do When Dealing With Frustration