How to use your robots.txt file
Copy the generated text into a file named robots.txt and upload it to the root of your website, so it's reachable at yoursite.com/robots.txt. Search engines read this file before crawling to learn which parts of your site to skip. Adding your sitemap URL helps Google discover all your pages faster.