A detailed explanation of the robots.txt + file how to install it
السبت، 25 يناير 2020
اقرأ ايضا
Explain how to create a robots.txt file in detail for beginners with a blogger photo, the correct way to create a robots.txt robot file specifically for bloggers blogger for beginners and what is the importance of a robot file in archiving your site content. To start with, let's clarify the meaning of the word robots.txt: -
What is Robots.txt robot file and why is it important?
Very briefly, a robots.txt file is a file that directs robots and search spiders to important pages on your site or pages that will be archived. This file tells the search spiders that these pages are the most important on your site and they will be archived, and also keeps them away from unimportant pages that should not be Search spiders archive them and show them on search engines.
Best custom robots.txt robot
A simple example of a robots file dedicated to Blogger blogs, and I personally use it on
Ezzsites4info
What is Robots.txt robot file and why is it important?
Very briefly, a robots.txt file is a file that directs robots and search spiders to important pages on your site or pages that will be archived. This file tells the search spiders that these pages are the most important on your site and they will be archived, and also keeps them away from unimportant pages that should not be Search spiders archive them and show them on search engines.
Best custom robots.txt robot
A simple example of a robots file dedicated to Blogger blogs, and I personally use it on
Ezzsites4info
User-agent: Mediapartners-Google
Disallow:
User-agent: *
Sitemap: http://www.arabic-blogger.com/sitemap.xml
Allow: /
The robot file consists of 3 custom parts, which we will explain in detail: - Part one: User-agent: Mediapartners-Google It is mainly intended for advertisements on your blog, specifically Google Adsense, where your blog is analyzed after adding this code to know the content of your site and adding ads that suit your site better. Part Two: User-agent: * This part of the code is intended to prevent and allow crawling of specific files within the content of your site. For example, if you want to allow the archiving of all the content of your site, we will add immediately after this command the word Allow: / as it is in the robot file attached in the explanation. If you want to prevent crawling of searches, for example within Your site add this command Disallow: / search. Part three: Sitemap It is a file that contains the content of your entire website in a renewed manner. This file is continuously examined every time search spiders enter your site in the event that you add a new post to your site in order to be archived. Add a robots.txt robot for Blogger blogs After entering your blog on Blogger, enter the settings and search preferences as shown in the image, then press Modify: Create a custom Robots.txt file for Blogger blogs Enter the code for the robots.txt file after copying it from here: a dedicated robot file and do not forget to replace the shaded part in the following image with your site link then click on save changes after you are done. Create a custom Robots.txt file for Blogger blogs
إرسال تعليق