User-agent: zombies
Disallow: /brains

User-agent: *
Allow: /searchhistory/
Disallow: /news?output=xhtml&
Allow: /news?output=xhtml
Disallow: /search
Disallow: /groups
Disallow: /images
Disallow: /catalogs
Disallow: /catalogues
Disallow: /news
Disallow: /nwshp
Allow: /news?btcid=
Disallow: /news?btcid=*&
Allow: /news?btaid=
Disallow: /news?btaid=*&
Disallow: /setnewsprefs?
Disallow: /index.html?
Disallow: /?
Disallow: /addurl/image?
Disallow: /pagead/
Disallow: /relpage/
Disallow: /relcontent
Disallow: /sorry/
Disallow: /imgres
Disallow: /keyword/
Disallow: /u/
Disallow: /univ/
Disallow: /cobrand
Disallow: /custom
Disallow: /advanced_group_search
Disallow: /googlesite
Disallow: /preferences
Disallow: /setprefs
Disallow: /swr
Disallow: /url
Disallow: /default
Disallow: /m?
Disallow: /m/?
Disallow: /m/ig
Disallow: /m/lcb
Disallow: /m/news?
Disallow: /m/setnewsprefs?
Disallow: /m/search?
Disallow: /m/trends
Disallow: /wml?
Disallow: /wml/?
Disallow: /wml/search?
Disallow: /xhtml?
Disallow: /xhtml/?
Disallow: /xhtml/search?
Disallow: /xml?
Disallow: /imode?
Disallow: /imode/?
Disallow: /imode/search?
Disallow: /jsky?
Disallow: /jsky/?
Disallow: /jsky/search?
Disallow: /pda?
Disallow: /pda/?
Disallow: /pda/search?
Disallow: /sprint_xhtml
Disallow: /sprint_wml
Disallow: /pqa
Disallow: /palm
Disallow: /gwt/
Disallow: /purchases
Disallow: /hws
Disallow: /bsd?
Disallow: /linux?
Disallow: /mac?
Disallow: /microsoft?
Disallow: /unclesam?
Disallow: /answers/search?q=
Disallow: /local?
Disallow: /local_url
Disallow: /froogle?
Disallow: /products?
Disallow: /froogle_
Disallow: /product_
Disallow: /products_
Disallow: /print
Disallow: /books
Allow: /booksrightsholders
Disallow: /patents?
Disallow: /scholar?
Disallow: /complete
Disallow: /sponsoredlinks
Disallow: /videosearch?
Disallow: /videopreview?
Disallow: /videoprograminfo?
Disallow: /maps?
Disallow: /mapstt?
Disallow: /mapslt?
Disallow: /maps/stk/
Disallow: /maps/br?
Disallow: /mapabcpoi?
Disallow: /center
Disallow: /ie?
Disallow: /sms/demo?
Disallow: /katrina?
Disallow: /blogsearch?
Disallow: /blogsearch/
Disallow: /blogsearch_feeds
Disallow: /advanced_blog_search
Disallow: /reader/
Disallow: /uds/
Disallow: /chart?
Disallow: /transit?
Disallow: /mbd?
Disallow: /extern_js/
Disallow: /calendar/feeds/
Disallow: /calendar/ical/
Disallow: /cl2/feeds/
Disallow: /cl2/ical/
Disallow: /coop/directory
Disallow: /coop/manage
Disallow: /trends?
Disallow: /trends/music?
Disallow: /notebook/search?
Disallow: /music
Disallow: /musica
Disallow: /musicad
Disallow: /musicas
Disallow: /musicl
Disallow: /musics
Disallow: /musicsearch
Disallow: /musicsp
Disallow: /musiclp
Disallow: /browsersync
Disallow: /call
Disallow: /archivesearch?
Disallow: /archivesearch/url
Disallow: /archivesearch/advanced_search
Disallow: /base/search?
Disallow: /base/reportbadoffer
Disallow: /base/s2
Disallow: /urchin_test/
Disallow: /movies?
Disallow: /codesearch?
Disallow: /codesearch/feeds/search?
Disallow: /wapsearch?
Disallow: /safebrowsing
Disallow: /reviews/search?
Disallow: /orkut/albums
Disallow: /jsapi
Disallow: /views?
Disallow: /c/
Disallow: /cbk
Disallow: /recharge/dashboard/car
Disallow: /recharge/dashboard/static/
Disallow: /translate_c
Disallow: /translate_suggestion
Disallow: /s2/profiles/me
Allow: /s2/profiles
Disallow: /s2
Disallow: /transconsole/portal/
Disallow: /gcc/
Disallow: /aclk
Disallow: /cse?
Disallow: /tbproxy/
Disallow: /MerchantSearchBeta/
Disallow: /ime/
Disallow: /websites?
Disallow: /shenghuo/search?
Disallow: /support/forum/search?
Disallow: /reviews/polls/
Disallow: /hosted/images/
Disallow: /hosted/life/
Disallow: /newspapers?
Disallow: /search2001/search?
Disallow: /ppob/?
Disallow: /ppob?
Sitemap: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml

Try to learn on how Google is making their Robots.txt and you may way to implement it also in your site. I have made a tutorial for Robots.txt just check it out form the link. Just want to share what I found today while browsing the net.

I just like to share you guys what are experts have to say about the Link Values. This opinion are based from 17 SEO Professionals and Link Builders in the Industry. I suggest you to read articles and their suggestion. It might help you a lot when you try to optimized.

Here are the summation of their findings :

Top 10 Most important factors

1. Robots.txt excluded page (DF) – 4.75

2. Anchor text – 4.56

3. Link is on penalized page (DF) – 4.50

4. Page authority (in inbound links) – 4.38

5. Domain authority (in quality of backlinks) – 4.38

6. Amount of outbound links on page – 4.25

7. Total amount of links on page – 4.06

8. Age of domain – 4.06

9. Relevant authority (in rankings on relevant keywords) – 3.94

10. Javascript link (DF) – 3.88

Top 5 Most agreed factors

1. Alexa ranking

2. Robots.txt excluded page (DF)

3. Domain authority (in quality of backlinks)

4. Page relevance (words only)

5. Number of links

Top 5 Most controversial factors

1. TLD (.com, .edu, etc.) -based on TLD alone

2. Type of link (image, text)

3. Domain authority (in PageRank)

4. Domain authority (in rankings on irrelevant keywords)

5. Target page (where the link points to) location

Note : Banner where captured from their site, here is the site [ Link Value Factors ]

User-agent: Mediapartners-Google*
Disallow:

This only means that you are allowing crawl from Google Media Partners. This will also possibly increase relevant ads for your blog.

BTW I have added mine. You can check my Robots.txt file here don’t forget to check my Adsense Tips before, It still help me a lot to get a relevant ads. And I am sure that michigan SEO Consultants will agree with my findings.

This is another experiment in this blog. I know that by doing this I can direct the Search Engine Crawler directly to the post and not only part of the post. There is also a possibility of having an increase of post page views that will also increase of possibility of having Targeted Visitors. It will also prevent the issue of duplicate content since it will not show any content in Category Pages , Search Pages and Tag Pages.

I have also modified my robot.txt during implementation of this experiment and remove restriction in my Category pages and tag Pages. [ Disallow: /category/ & Disallow: /tag/ ].

I have strong feelings that this will succeed. It will increase an index page of my site without having problem with duplicate content. This will have a good effect on my SEO Campaign for this blog.

I hope this will result better navigation of my site.

This site gives some Tips and Tricks regarding Search Engine Optimization, Blogging , Tech Related Stuffs, Money Matters , Problogging , Reviews and some information regarding Philippines. You can also find some post in here that will teach on how to earn money from blogging.

You may find some other details of the site thru my about page.

Here are some of the post that you might find interesting and which might help you.

SEO Tips

Effective Linking With Your Old Post in 10 Steps

Robots.txt How important it is?

How To Insert Links to Your RSS Feeds

How did I got # 1 from Google SERP in Manny VS Barrera fight result

Lesson Learn from Marhgil Macuha SEO Contest

Blogging Tips

10 Tips of Commenting in a Blog, A good style of Link Bait

5 Informative Observation from my StumbleUpon Experience

How To Make Sure That Your post shows will show up in Trackback links ?

Do Follow blogs ? or No Follow Blogs? Let me Explain it

I Have Learn My Lesson on How to Earn from linking to Other Site

Money and Adsense Related Topics

Adsense for Mobile, Increasing Ways of Online Income

PayPal Philippines can now be used To Send and Received Funds

Transferring of Money from PayPal to Xoom Reviewed

A Filipino Blogger who earns Php 204,311 last September 2007

AdSense Earnings Analysis : I Am Now a 4 Figure Blogger

Microsoft Office Tips

Excel Tip : What If You forget your Excel Sheet Password ?

Excel Trick : What is the use of $ sign ?

Another Excel Control Hot Key

Microsoft Excel and Microsoft Word Hot Keys

How to join Excel data in Cell

Happy Blogging To All of You

Do you like this blog ?

Subscribe to my RSS or Subscribe to me via email for the latest information from this blog.

Incoming search terms:

• pacquiao marquez paypal

If you don’t know the answer you better continue to read this post because this will teach on how to Check your Google Stats.

Well basically what I am going to blog today is about Google Webmaster Tools. Google Webmaster Tools aims to gives information about

• Overview
• Diagnostics
• Statistics
• Links
• Sitemaps
• Tools

You just have to Register at their site and put the authorization code that they will give. if you will be having some problems just comment and we will try to resolve it here.

Getting Google’s view of your site, and diagnosing potential problems
The first step to increasing your site’s visibility on Google is learning how our robots crawl and index your site.

• Crawl info: You can make sure that Google have access your site, and see when Googlebot last visited. You can also view URLs that we’ve had trouble crawling and why we couldn’t crawl them. This way, you can fix any problems preventing us from indexing all of your pages.
• Robots.txt file validation: See if we’re having trouble with your file, and test out changes to that file before you change it on your server. You can input your robots.txt and it will give you reply if it is ok or not.
• Website content: View top content from your site and see the words that other sites use to link to your site.

Seeing how your site performs
A second step is learning what drives traffic to your site.

• Top queries: Find the top queries that drive traffic to your site and where your site is included in the top search results. This will let you learn how users are finding your site. ( With this report you could always use a redirect method in order to have a continues crawl at your site. You have to remember that crawler stops if it encounter Error 404. And therefore it is not healthy for your blog. )
• Indexing information: See how your site is indexed and which of your pages are included in the index. If we find violations in your site, we’ll give you the opportunity to fix the problems and request re-inclusion of your site.

One of the useful tool of Google Webmaster Tools is telling you the numbers of site being indexed by Google vs the number of links that your sitemap is reporting. So this can give you an idea on how you can improve your site navigation.

Normally a crawler will stop as long as there are any broken links that is it being encountered. So why would you let the crawl stop ? You have to redirect it.

Knowing how your site perform behind the scene will help you focus in areas where you need to increase your SEO Experiment. I hope that this SEO tip will be of help to you.

I might have another post regarding this tools my experience and tips. I can only blog for my experience and not how the system work like what Matt Cutts is doing. But I do believe that it can help for future SEO player. I am not an expert but I am willing to do experiments and share result. and By the way I am also earning from those experiment.

I just found out that the excerpt is great SEO Tool, since this is what will appear if incase somebody search your blog archives. If you do not use this before in the post editor’s optional excerpt field, the first 55 words of the post’s content are used by WordPress that leads to a duplicate content in the blog not unless you disallow crawler to indexed your archives like what I do by changing the robots.txt

The optional Post excerpt could be found at the lower part of your WordPress Write Dashboard. Juts press the ” + ” sign and add your excerpt in the box. And if you are using Windows Live Writer it can be seen by pressing ” F2 ” .

So to avoid duplicate content for archives I would suggest to use these excerpt feature of WordPress. You can write a 2 sentence telling the brief description of your post. So after about 386 post in the archives it is only now that I will implement this in my future blog post.

WordPress Excerpt should be eye catching that will give your reader an idea of what you are talking about. So are you using Post excerpt before ? any additional Tips ?

If you want your site to be popular or have an additional visitors that may be converted to a regular visitors I believed reading this links is essential.

Well I just want to inform you the Google has given the 7 must-read Webmaster Central blog posts, I believe this post will really helps a lot on your campaign not only for SEO but also for higher Google Ranking.

1. Googlebot can’t access my website – I believe the first thing you have to do with this one is to check your robots.txt maybe it is preventing Google from crawling your site.
2. URL blocked by robots.txt – I have also made a post regarding the robots.txt , and all I can say is, The experiment was a success .
3. Why was my URL removal request denied?
4. Flash best practices
5. The supplemental index – I have made a post before regarding checking your Supplemental Index percentage that you might want to check.
6. Duplicate content – My post on removing duplicate content that was indexed by google was a suuccess.
7. Sitemaps FAQs – I have used a plug in to be able to produce one.

I do hope that above clarification of Google will help you to understand how Big G is looking at our post. I have post before an SEO Tool that can help you analyze your site.

BTW This is the first time I will insert the BuzzFuze, and I don’t have idea on how will this help boost my blog. Do you have any insights about this ?

What are the Different Types of Visitors ?

1) Regular Visitors

A regular visitors are those visitor who is continually checking your site everyday looking for some fresh contents. Since this type of visitors believe that they can get good quality from your blog.

2) Referred Visitors

Those are visitors referred by other site who links to you

3) Social Media Visitors

Those are visitors referred by Social Media Site such as DIGG, Reddit, Stumble Upon, Delicious etc.

4) Search Engine Visitors

This visitor is the result of any search engine optimization that you are conducting in order to drive visitors to your site

5) Visitors via Ads

Those are the visitors that comes from you Ad campaign, such as Adwords or from Adbrite

6) Forum Visitors

Those are visitors that come from the links in the forums that you have made. While making conversation to othe forum members.

7) Entrecard Visitors

Those are visitors that come from Entrecard.

Below are some question which explain my opinion about those type of visitors.

Who Should be First Pleased ?

Among those listed type of visitors above, A question arise on whom should You pleased first ? Some may say Social Media Visitors, Some may say the other type of visitors. For me I think You should work out first for the Regular Visitors. Since those visitor are the one who will make your blog alive and kicking. They will be the one who will create conversation in the comments section in which one of an indication that a blog is growing.

It is not worth putting up a blog which don’t have any commenter. This is just like talking to the air where in nobody is listening. Al though regular visitors will seldom press any ads on your blog. Still they are the most important visitors in my blog. I believe that without them my site will not be a better place to stay in the web.

How to Retain Visitors and Make Them a Regular one ?

My own trick is to answer almost all your commenter’s question or opinion. You may agree or disagree, but it is very important for you to reply. To let them think that you value them match. Try to go to their Website and try to find in those category of a subject that you know and then comment.

You will see you feed counts will rise. I came from almost nothing and within a month from the day that this blog has been resurrected now it has 76 Feeds subscriber and about 8,000 unique visits this month. So I can conclude that I am on a right path.

Does my Regular Visitors annoyed with ADs ?

If they do, They can always add a Firefox plugin called adblock. This plugin aim to blocks all ads at this site let my Regular visitors enjoy the real objective in coming to my blog and that is to read my article.

To Whom Should be Your Next Focus ?

If you have already a number of regular visitors perhaps about 50. This information is available from your stat. I am using Google Analytics for that matter. I believe the next in line should be the Referred Visitors. This visitor are the result from a click to a link from other Website who is linked to yours.

Links comes usually comes from regular visitors who have blogs. They are trying to send some readers at your site tipping them on what you are writing. Stats also shows that those referred visitor are more likely to be converted to regular visitors of your blog.

To retain the referred visitors your blog should have a great navigation system in which your visitor can easily see what they want to see.

If am new to a site I usually look for the Top Post, to give me the idea on what kind of niche does a certain blog portray.

Actually when doing your next step to gain links from other blog to have a referred visitor, you are now also doing an optimization to attract visitor from Social Media Site. Since if your referred and regular visitor has an account in Social Media. the tendency is they are going to send your article if they found it great. And after they enter it on the system there is now a chance to get visitors from Social Media Sites.

The Next Should be Search Engine Visitors

This is the part wherein your SEO Skills will be tested. What is the use of a great or tasty food if nobody could find this. This is same thing with blog, If you want your blog to be noticed by those looking for some information. It is really very important that your post will be Search Engine Friendly to gain Search Engine Visitors.

Do we gain from Search engine Visitor?

Definitely Yes, Among all other visitors aside from Visitor via ads, The Search Engine Visitor has high percentage of clicking your ads, because usually those type of visitors are searching for information. And if they found that your ads is giving some good information. For sure they will click it.

With regards to this visitors you will have to prepare your blog for their arrival, such as doing some modification with our AdSense colors, location etc. if you are using AdSense. Some says that you have a very good convertion if you 6% of your visitors clicks your ads.

Then Visitors via ADS

I have read a lot regarding this, but I have not yet tried it. Meaning to say, I need to study how things goes with this one. Not all have succeed in playing with Adwords. But most of the players here are saying that when somebody tries to click and ads you make, there is also a great chance that your visitor will also click the ads that you have on your landing page. But the question on if you can retain them as reader, is I believe a question.

What About Forum & Entrecard Visitors

These visitors are likely to stay since those visitors knows you from the forum. Or they came to your site since they want to know more about you. Another possible RSS Subscriber.

You can see my comments about the Entrecards at my archives.

As a final note I do believe that without those visitors a blog could not have a higher rank or community visibility

Question to all of YOU who happen to completely read this post :

1) So what kind of visitors are you ?

2) Do you have any disagreement on any points that I mention ?

So why don’t you leave your comment and discuss about it. You may also want to subscribe via E-mail for more sharing from this blog.

Incoming search terms:

• what are the types of visitors??

This post will aim to educate readers on how to implement robots.txt for SEO purpose.

What is Robots.txt Google Says

How do I use a robots.txt file to control access to my site?

A robots.txt file provides restrictions to search engine robots (known as “bots”) that crawl the web. These bots are automated, and before they access pages of a site, they check to see if a robots.txt file exists that prevents them from accessing certain pages.

You need a robots.txt file only if your site includes content that you don’t want search engines to index. If you want search engines to index everything in your site, you don’t need a robots.txt file (not even an empty one).

So this is it, robots.txt is used to restrict bot’s in indexing once site. If you are a regular reader here, You know that I am having some problem with those Unusual string showing at my Google Search Engine Results and this is the reason why I studied this matter, and later I found out that this is a must to do for SEO purpose.

How is my robots.txt made, I just change this yesterday and just 4 hrs ago it was crawled by Google smoothly.

Sitemap: http://techathand.net/sitemap.xml.gz

User-agent: *
Disallow: /wp-content/
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-
Disallow: /page/*/
Disallow: /feed/
Disallow: /?wpcf7=json*
Disallow: /*/feed/rss/
Disallow: /*/feed/
Disallow: /trackback/
Disallow: /*/trackback/
Disallow: /category/
Disallow: /2007/*/
Disallow: /2008/*/
Disallow: /cgi-bin/
Allow: /wp-content/uploads/

Explanation :

Update : I have remove Disallow: /2007/*/ & Disallow: /2008/*/ thanks to Marhgil.

User-agent: * means that all search engine

Above shown robots.txt informs bot not to index all WordPress files and documents, Pages, Feed, ?wpcf7, track backs ( URL only ), category, 2007 & 2008 archives and allows indexing of my uploads.

In SEO good for a certain page to be unique upon visitation of the search engine bot. Duplicates came from scrapers, Copier, and even from your own domain.

You may ask why did I restrict feed, page, Trackbacks, category, 2007 & 2008, This is because they are all archives and seen by bot as duplicate pages.

Ultimate Tip

Go to your favorite blog check their Robots.txt and you will see how experts in the field is doing or commanding the bot. No wonder they are always on top.

But How…. Use this syntax [ Domain name/robots.txt ] ex.. http://www.abc.com/robots.txt

I saw lots of variation yesterday. and You will see lots of it also.

Combine their strategy and make your own that is applicable for your blog. You cannot access it if they are using .htaccess

The Reality

If you want that your site be a Search Engine Friendly you have to direct them on what part of your blog needs to be visited. By doing this you’re not making any duplicate content in the web that makes your post in the supplemental index of Google. This is a must to do specially if your monetize your site.And so if your thinking in moving to Self hosted blog check how to do it in SEO friendly way.

Hope you like it and you subscribe to my Email or feeds for future SEO Tips and Tricks. Just don’t forget to verify your email subscription.