How To Add a Robots.Txt File In Blogger

Have you every listen about robots.txt file ? Let me tell you something about this. Usually all websites use to add a robots.txt  file in their root directory. This file helps to struct the search engine's crawler robots. In blogger, We don't have control panel but blogger team has recently added a new option in Search Preferences page, where we can add that file easily. Now according to search engine optimization we have to struct the search engine's crawler that some parts of our blog won't need indexation in search engine. So, we have to tell the search engine's crawler that search results, labels link and archive pages don't be indexed by them. Let's add an SEO friendly robots.txt file in blogger.

Add Robots.Txt File In Blogger

• Go To Blogger >> Settings >> Search Preferences
• In The Crawlers and Indexing Section, Look For The Custom Robots.Txt
• Click Yes and a Box will appear like the image below

• Now a text box will appear where you have to write your robots.txt file and here I'm giving you an seo friendly robots.txt file just copy the code below and paste it in that box.

User-agent: Mediapartners-Google
 User-agent: *
 Disallow: /search?q=*
 Disallow: /*?updated-max=*
 Allow: /
 Sitemap: http://www.yoursite.com/feeds/posts/default?orderby=updated

• Replace www.yoursite.com with your site's link
• User-agent:Mediapartners-Google :  This code is for Google AdSense, If you have Google AdSense ads on your site then remain this same and if you don't have then remove this.
• Disallow: /search?q=* : This code tells the search engine's crawlers to don't index the search results pages which are not important for the indexation.
• Disallow: /*?updated-max=* : This code prohibits the search engine's crawler to index the navigation pages which are also not important for indexation.
• Sitemap : Now in the last, Sitemap tells the search engine's crawler to index the updated posts of the blog which helps you to index your posts easily.

So friends, This was our Robots.Txt file. Stay connected for more tutorials and also join this site as well. If you are facing any problem then leave a comment below and let us face your problem. Good Bye.

About The Author

MOHAMMED YAQOOB HISBANI

Mohammed is a 15 years old young blogger who is currently running is his blog which is My Tech Cafe and studying in the first year class. Mohammed is from Pakistan, Sindh, TharuShah and knows four languages. Mohammed loves to write articles, exploring new things on internet and earning money online.