They're pieces of code tucked from the "" section of the webpage's HTML. Think of them as labels that explain to the various search engines, what your webpage is about And the way it should really surface A robots.txt file is a simple text file that instructs World-wide-web crawlers about https://www.seoprd.com