About "URL restricted by robots.txt " - If we using wordpress with owned web hosting, the duplicate content problems are easily solved by changing robots.txt file or use so many wordpress plugins, such as SEO Meta Tags, etc..., But we use blogger/blogspot with default robots.txt file : http://seoblog7.blogspot.com/robots.txt
But actually, the restriction URL by google robots is not a serious problem, This restriction is done by default on blogspot*com (and domains that use blogger like yours, of course) and does not need to be resolved in any way, it's not an error...read more my old post here : Block duplicate content and use rel='canonical' again , or here : http://googlewebmastercentral.blogspot.com/2008/03/speaking-language-of-robots.html
If you've got warning at your Google Webmaster Tools, it's doesn't mean that you have duplicate contents , Restriction URL and Duplicate contents are diferent. Restriction URL means, your URL has been indexed by google's robots, but restricted by robots.txt file, and Google Webmaster Tools give you a warning messages. And the duplicate contents means , robot has indexed that your urls is a duplicate and the penalty will kill your url on google search-engines or throw your url, into the Google Jail that's Google Sandbox .
Ok, anyway, if you are still worried with those duplicate contents on your blogspot blogs, try this tips:
First, as an example I use Simple SEO Friendly Blogger Template .
Look into the <head> section, you will see as below codes...
<b:if cond='data:blog.pageType == "item"'>
<title> <data:blog.pageName/> </title>
<b:else/>
<title> <data:blog.title/> </title>
</b:if>
<b:if cond='data:blog.url == data:blog.homepageUrl'>
<meta content='YOUR DESCRIPTION' name='description'/>
<meta content='KEYWORD1,KEYWORD2,KEYWORD3' name='keywords'/>
</b:if>
<meta content='global' name='target'/>
<meta content='Index,follow' name='Robots'/>
<meta content='ALL' name='SPIDERS'/>
<meta content='ALL' name='WEBCRAWLERS'/>
<meta content='general' name='rating'/>
<meta content='YOUR NAME' name='author'/>
<meta content='100' name='alexa'/>
<link expr:href='data:blog.url' rel='canonical'/>
And you can change the favicon image with yours
<link href='http://us.i1.yimg.com/us.yimg.com/i/mesg/emoticons7/1.gif' rel='shortcut icon' type='image/x-icon'/>
Add the following codes,
<b:if cond='data:blog.pageType == "archive"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<b:if cond='data:blog.url == "/search"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
So it will look like the following :
<b:if cond='data:blog.pageType == "item"'>
<title> <data:blog.pageName/> </title>
<b:else/>
<title> <data:blog.title/> </title>
</b:if>
<b:if cond='data:blog.url == data:blog.homepageUrl'>
<meta content='YOUR DESCRIPTION' name='description'/>
<meta content='KEYWORD1,KEYWORD2,KEYWORD3' name='keywords'/>
</b:if>
<b:if cond='data:blog.pageType == "archive"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<b:if cond='data:blog.url == "/search"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<meta content='global' name='target'/>
<meta content='Index,follow' name='Robots'/>
<meta content='ALL' name='SPIDERS'/>
<meta content='ALL' name='WEBCRAWLERS'/>
<meta content='general' name='rating'/>
<meta content='YOUR NAME' name='author'/>
<meta content='100' name='alexa'/>
<link expr:href='data:blog.url' rel='canonical'/>
And you can change the favicon image with yours
<link href='http://us.i1.yimg.com/us.yimg.com/i/mesg/emoticons7/1.gif' rel='shortcut icon' type='image/x-icon'/>
From the above code we tried to make the "archive" not being indexed? , yes the blog archives are very bad in SEO , they have displayed our post titles in doubles and indiscriminate and I think that good enough to disabling your Archiving Page throught your Dashboard : "Settings - Archiving - Archive Frequency" menu and select No Archive, show the labels only, and to display your latest posts you can use feeds (Design - Add a Gadget - Feed , then type :http://YOUR-BLOG.blogspot.com/atom.xml), It's really SEO Friendly Bloggger Configuration
And "noindex" for "/search" to shouting more loudly, once again to google's robots , "Google,.. don't index my search/label pages, and don't give me a warning about it...Please!"
But actually, the restriction URL by google robots is not a serious problem, This restriction is done by default on blogspot*com (and domains that use blogger like yours, of course) and does not need to be resolved in any way, it's not an error...read more my old post here : Block duplicate content and use rel='canonical' again , or here : http://googlewebmastercentral.blogspot.com/2008/03/speaking-language-of-robots.html
If you've got warning at your Google Webmaster Tools, it's doesn't mean that you have duplicate contents , Restriction URL and Duplicate contents are diferent. Restriction URL means, your URL has been indexed by google's robots, but restricted by robots.txt file, and Google Webmaster Tools give you a warning messages. And the duplicate contents means , robot has indexed that your urls is a duplicate and the penalty will kill your url on google search-engines or throw your url, into the Google Jail that's Google Sandbox .
Ok, anyway, if you are still worried with those duplicate contents on your blogspot blogs, try this tips:
First, as an example I use Simple SEO Friendly Blogger Template .
Look into the <head> section, you will see as below codes...
<b:if cond='data:blog.pageType == "item"'>
<title> <data:blog.pageName/> </title>
<b:else/>
<title> <data:blog.title/> </title>
</b:if>
<b:if cond='data:blog.url == data:blog.homepageUrl'>
<meta content='YOUR DESCRIPTION' name='description'/>
<meta content='KEYWORD1,KEYWORD2,KEYWORD3' name='keywords'/>
</b:if>
<meta content='global' name='target'/>
<meta content='Index,follow' name='Robots'/>
<meta content='ALL' name='SPIDERS'/>
<meta content='ALL' name='WEBCRAWLERS'/>
<meta content='general' name='rating'/>
<meta content='YOUR NAME' name='author'/>
<meta content='100' name='alexa'/>
<link expr:href='data:blog.url' rel='canonical'/>
And you can change the favicon image with yours
<link href='http://us.i1.yimg.com/us.yimg.com/i/mesg/emoticons7/1.gif' rel='shortcut icon' type='image/x-icon'/>
Add the following codes,
<b:if cond='data:blog.pageType == "archive"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<b:if cond='data:blog.url == "/search"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
So it will look like the following :
<b:if cond='data:blog.pageType == "item"'>
<title> <data:blog.pageName/> </title>
<b:else/>
<title> <data:blog.title/> </title>
</b:if>
<b:if cond='data:blog.url == data:blog.homepageUrl'>
<meta content='YOUR DESCRIPTION' name='description'/>
<meta content='KEYWORD1,KEYWORD2,KEYWORD3' name='keywords'/>
</b:if>
<b:if cond='data:blog.pageType == "archive"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<b:if cond='data:blog.url == "/search"'>
<meta content='noindex,follow' name='robots'/>
</b:if>
<meta content='global' name='target'/>
<meta content='Index,follow' name='Robots'/>
<meta content='ALL' name='SPIDERS'/>
<meta content='ALL' name='WEBCRAWLERS'/>
<meta content='general' name='rating'/>
<meta content='YOUR NAME' name='author'/>
<meta content='100' name='alexa'/>
<link expr:href='data:blog.url' rel='canonical'/>
And you can change the favicon image with yours
<link href='http://us.i1.yimg.com/us.yimg.com/i/mesg/emoticons7/1.gif' rel='shortcut icon' type='image/x-icon'/>
From the above code we tried to make the "archive" not being indexed? , yes the blog archives are very bad in SEO , they have displayed our post titles in doubles and indiscriminate and I think that good enough to disabling your Archiving Page throught your Dashboard : "Settings - Archiving - Archive Frequency" menu and select No Archive, show the labels only, and to display your latest posts you can use feeds (Design - Add a Gadget - Feed , then type :http://YOUR-BLOG.blogspot.com/atom.xml), It's really SEO Friendly Bloggger Configuration
And "noindex" for "/search" to shouting more loudly, once again to google's robots , "Google,.. don't index my search/label pages, and don't give me a warning about it...Please!"
24 comments:
hello,
First of all i realy appriciat your effort for this blog, and second is i have also face this robot txt prob.i read your post care fully but i could not understand where i add robot meta tag
my meta tad description is following
kindly help me where is add my meta tags
Regards
Christiana.Kathy
Good Job ! I enjoyed enough reading your latest article to read it again and again! It was so helpful. I am Waiting for your next entry.
I certainly enjoyed the way you explore your experience and knowledge of the subject! Keep up on it. Thank u.
Personally I think, that this entry is really great and informative indeed. I have to admit that it was quite interesting to read this your post.
search engine optimization in los angeles ca
Thank you very much for this nice writing. I was searching for such type of blog as yours. Keep it updated. Great Job!
Touche. Outstanding arguments. Keep up the good effort.
Take a look at my web blog ... kohls-printable-coupons.net
A very helpful post also you can visit http://activecracks.blogspot.com for free downloads and giveaways...
Its like you read my mind! You seem to know so much about this, like you wrote the book in it or something.
I think that you could do with some pics to drive the message home a bit, but other than that,
this is magnificent blog. An excellent read.
I will certainly be back.
Here is my web site; Michael Kors Bags
Hey there! Do you use Twitter? I'd like to follow you if that would be ok. I'm absolutely
enjoying your blog and look forward to new posts.
Take a look at my homepage Cheap Jerseys
Ahaa, its pleasant conversation regarding this article here at this blog,
I have read all that, so at this time me also commenting here.
my blog: Cheap Louis Vuitton Bags
Truly no matter if someone doesn't know after that its up to other users that they will help, so here it takes place.
My web blog - Michael Kors Canada
Wow, this piece of writing is pleasant, my sister is analyzing these
things, therefore I am going to convey her.
My web page :: http://www.earlylearningpreschool.com/louisvuittonhandbags.html
Excellent site you've got here.. It's difficult to find
excellent writing like yours these days. I seriously appreciate
people like you! Take care!!
Feel free to visit my site Wsmisports.Com
Thank you for sharing your thoughts. I really appreciate your efforts and I am waiting for your
next post thank you once again.
Here is my webpage Air Max
Heya! I'm at work browsing your blog from my new iphone! Just wanted to say I love reading through your blog and look forward to all your posts! Keep up the outstanding work!
Here is my blog; Check This Out
At this moment I am going to do my breakfast, after having my breakfast coming over again to read other news.
My web page Louis Vuitton Bags
Excellent post. I was checking continuously this blog and I'm impressed! Extremely useful info specially the last part :) I care for such information much. I was seeking this certain information for a very long time. Thank you and best of luck.
my site :: Louis Vuitton Outlet
It's not my first time to visit this site, i am browsing this website dailly and obtain good information from here daily.
Here is my homepage: Air Jordan
This is very informative. Before I just used meta tags placed after the opening head tag. I never thought that using conditional tag, we can avoid any issues in SEO in blogger. Thank you for this. I already applied this to my tech blog, Gadgets Philippine Prices
Also visit my weblog - facebookofsex
Great post! I am actually getting ready to go across, this post is very informative. By the way, Get Happy Mother's Day
Happy Mothers Day 2016
Happy Mother's Day 2016
funny happy fathers day pictures
memorial day photos free
printable father's day cards
Implementing this code now!
thanks!
-D
Seo firepower
seo firepower
seo firepower pasadena
Post a Comment