Comments on: Use Robots.txt To Escape Supplemental Hell http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/ Opportunities, Opinions, Optimize Fri, 21 Nov 2008 03:16:01 +0000 http://wordpress.org/?v=2.6.3 By: Blue Screen of Death, Spiderman style « goldcoaster http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-4622 Blue Screen of Death, Spiderman style « goldcoaster Thu, 02 Aug 2007 05:05:26 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-4622 [...] to Schanul and Richard Knight , Benedict , Homemom , Goldy , Chris for all the comments on previous [...] [...] to Schanul and Richard Knight , Benedict , Homemom , Goldy , Chris for all the comments on previous [...]

]]> By: Robots.txt & The Google Supplemental Index-Update » Blog-Op http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-4169 Robots.txt & The Google Supplemental Index-Update » Blog-Op Sat, 23 Jun 2007 20:17:18 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-4169 [...] been about a month since I posted about Robots.txt and how it can help you escape supplemental hell, so I thought it was time for a quick [...] [...] been about a month since I posted about Robots.txt and how it can help you escape supplemental hell, so I thought it was time for a quick [...]

]]> By: Chris Lodge http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3770 Chris Lodge Sun, 27 May 2007 15:59:11 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3770 No problem RT, it's up. I hope someone will have a brainwave about what you can do-I know you don't want to pay twice, but I see Dotster take Paypal-is that an option? (I seem to remember you saying you had access now?) No problem RT, it’s up.

I hope someone will have a brainwave about what you can do-I know you don’t want to pay twice, but I see Dotster take Paypal-is that an option? (I seem to remember you saying you had access now?)

]]> By: RT Cunningham http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3768 RT Cunningham Sun, 27 May 2007 13:36:22 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3768 Chris, please put the word out. My website is gone until Host9 gets my domain back online. It expired at the old registrar and is gone. The transfer, that I ordered, paid for, and confirmed, did not take place as I had thought. Chris, please put the word out. My website is gone until Host9 gets my domain back online. It expired at the old registrar and is gone. The transfer, that I ordered, paid for, and confirmed, did not take place as I had thought.

]]> By: Chris Lodge http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3766 Chris Lodge Sun, 27 May 2007 13:30:32 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3766 Hey RT, as long as this experiment doesn't make me Pr0 I'll keep it up for a few months ;-) The 301 should work Scott: If you run the 2 versions of your address through a pagerank predictor, you may find two wildly different predictions: The 301 should cure this in time. When I first found out about this, www.blog-op was PR2, while blog-op was PR4. Hey RT, as long as this experiment doesn’t make me Pr0 I’ll keep it up for a few months ;-)

The 301 should work Scott: If you run the 2 versions of your address through a pagerank predictor, you may find two wildly different predictions: The 301 should cure this in time.

When I first found out about this, http://www.blog-op was PR2, while blog-op was PR4.

]]> By: Scott http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3762 Scott Sun, 27 May 2007 09:05:56 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3762 Whoops, I may have been mistaken about that plugin. I had 182 supplemental results yesterday, now i'm up to 186. So it might not be doing all I had hoped. Let me know how the robots.txt file works, if it works better I'll implement that. I just edited my non-www site to 301 redirect to my www site, so hopefully that has a positive effect on my search engine rankings Whoops, I may have been mistaken about that plugin.

I had 182 supplemental results yesterday, now i’m up to 186. So it might not be doing all I had hoped. Let me know how the robots.txt file works, if it works better I’ll implement that.

I just edited my non-www site to 301 redirect to my www site, so hopefully that has a positive effect on my search engine rankings

]]> By: RT Cunningham http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3760 RT Cunningham Sun, 27 May 2007 06:31:46 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3760 I was just going through my cached, site, and link for with and without the www as the prefix. A lot of the supplemental is duplicate as the www for the same page as without the www. I think it takes a while for a lot of them to disappear after you use the .htaccess 301 Permanent Redirect. 30 days doesn't appear to be long enough. Maybe 6 months? I was just going through my cached, site, and link for with and without the www as the prefix. A lot of the supplemental is duplicate as the www for the same page as without the http://www. I think it takes a while for a lot of them to disappear after you use the .htaccess 301 Permanent Redirect. 30 days doesn’t appear to be long enough. Maybe 6 months?

]]> By: Chris Lodge http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3745 Chris Lodge Sat, 26 May 2007 16:06:16 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3745 Doesn't sound great Jason ;-) Thanks Andy, I think I'll just run this as an experiment, keep a close eye on it and see what happens. Expect a tearful post in a months time that Google doesn't love me anymore. I've only just kicked this off Scott, so I'll let you know how Robots.txt works for me. Plugin sounds useful though. You could well be right David-it's not going to kill you for now to leave as is, and see how things run. It may benefit (or at least not hurt) to have a simple robots files just excluding your WP engine files and other stuff on your server, leaves the robots free to concentrate on the content. Doesn’t sound great Jason ;-)

Thanks Andy, I think I’ll just run this as an experiment, keep a close eye on it and see what happens. Expect a tearful post in a months time that Google doesn’t love me anymore.

I’ve only just kicked this off Scott, so I’ll let you know how Robots.txt works for me. Plugin sounds useful though.

You could well be right David-it’s not going to kill you for now to leave as is, and see how things run. It may benefit (or at least not hurt) to have a simple robots files just excluding your WP engine files and other stuff on your server, leaves the robots free to concentrate on the content.

]]> By: Blog Op Goes Gangbusters http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3740 Blog Op Goes Gangbusters Sat, 26 May 2007 14:34:01 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3740 [...]  Supplemental Results Hell - Are your pages appearing on Google’s main search results?  Or are they getting return as supplemental results that people won’t see unless they click “Similar Pages?”  See how you can find out if you are in supplemental results hell, and what you can do about it. [...] [...]  Supplemental Results Hell - Are your pages appearing on Google’s main search results?  Or are they getting return as supplemental results that people won’t see unless they click “Similar Pages?”  See how you can find out if you are in supplemental results hell, and what you can do about it. [...]

]]> By: Scott http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3738 Scott Sat, 26 May 2007 04:42:03 +0000 http://blog-op.com/use-robotstxt-to-escape-supplemental-hell/#comment-3738 Wow that is a great way of finding your supplemental. I hadn't heard of that until now. I have 293 cached with 182 supplemental. Need to better that a little bit However I noticed one thing. I started using the wordpress plugin all in one SEO pack about a week ago, and I couldn't find any of the posts I've made since then in the supplemental results Link - http://wp.uberdose.com/2007/03/24/all-in-one-seo-pack/ To be fair it isn't a large sample size, but the plugin does have an option to turn off indexing for categories and archives, so that seems to be working. Any of you guys experience something similar? Wow that is a great way of finding your supplemental. I hadn’t heard of that until now.

I have 293 cached with 182 supplemental. Need to better that a little bit

However I noticed one thing. I started using the wordpress plugin all in one SEO pack about a week ago, and I couldn’t find any of the posts I’ve made since then in the supplemental results

Link - http://wp.uberdose.com/2007/03/24/all-in-one-seo-pack/

To be fair it isn’t a large sample size, but the plugin does have an option to turn off indexing for categories and archives, so that seems to be working.

Any of you guys experience something similar?

]]>