Robots.txt generator is an online tool for creating robots.txt files for your website. You can either open and edit an existing file or create a new one using the output of this generator. Robots.txt file is a very important aspect of SEO. You have the option to easily pick which types of crawlers (Google, Yahoo, Baidu, Alexa, etc.) to allow or disallow depending on your preferences.