Adding Custom Robot.txt In Blogger

Robot.txt In Blogger

 

If you're looking to add Robot.txt to your blog at Blogger, this article will guide you through the process and show you the correct text to add to your robot.txt. There's several different ways to optimize your blog in Blogger. Having a correct robot.txt file is an important element. I'm going to walk you through the entire process right now.

 

First, what is a robot.txt file and why do I need one to optimize my blog in Blogger? Your robot.txt file is important because it is a guide for the search engines. Your robot.txt file is going to tell the search bot what you want read and what you don't want included. The robot.txt file will help search engines read through your blog and index your blog. It's very important and every website should have a robot.txt file stored.

 

Now, the very first thing you want to do is go to your blog list and choose the appropriate blog title to add the robot.txt file. Let's do this now.

 

 

After you choose the correct blog that you want to add the robot.txt file to, you want to scroll down on your left menu to settings. You'll see a list of options under settings, you want to go to "search preferences." Click on the link.

 

 

After you follow the link to search preferences, you'll be brought up to a page that controls all search related inquires. It's important to note that if you don't have your meta description filled out, you should add it since you're already here. You'll need to turn this feature on. This will also turn on the description feature for each individual blog post. You'll now have the ability to add meta descriptions to all your post in Blogger. If you do to post a blog, if you look at the right side menu, you'll see a search option now. This is where you add your meta description in Blogger. Very important.

 

Ok. Next, you want to scroll down to the second to last option. You'll see an option field for custom robot.txt. This is exactly what you're are looking for. This is where you add your robot.txt to Blogger.

 

 

If you refer to the picture above, you can see that I've added a my code to my robot.txt file. I know the picture is a little hard to read. If you look below, you'll see the same exact code that you need to add to your robot.txt file. The ONLY text you're going to change is where it says yoururl.blogspot.com  You need to add your own unique Blogger URL to this field. Everything else will remain the same. Copy and paste the code below, change the URL to your own and you will now have the correct code for your robot.txt file in Blogger. This will help you search results and you can now add your meta descriptions to your blog post if you chose to add your meta description at the top of the page. Below, you'll see the code that you need for your robot.txt file.

 

The code below will read up to 500 post. If you have more then 500 blog post, you will need to post another robot.txt file and change the 500 to 1000. You continue to increase the number by 500.

 

Robot.txt Code

 

User-agent: *
Disallow: /search
Allow: /
Sitemap: http://yoururl.blogspot.com/atom.xml?redirect=false&start-index=1&max-results=500

 

 

 

A robot.txt file is important to every website, just in case you found this article by error. The search engines will now know what to search on your blog and this will help with your rankings and traffic. Hale Associations offers several different SEO services. Contact us today for a free consult and evaluation. Thanks for visiting our blog.