Robots.txt is a file that exists on the foundation directory of each Web site and may be used to instruct engines like google on which directories/files of the website they can crawl and incorporate in their index. Now that you've a clear concept of what Search engine optimization is and https://news.rafeeg.ae