Robots.txt module settings only work if there is no robots.txt file
>>> [!note] Migrated issue <!-- Drupal.org comment --> <!-- Migrated from issue #3500113. --> Reported by: [pameeela](https://www.drupal.org/user/1431110) Related to !703 >>> <h3 id="summary-problem-motivation">Problem/Motivation</h3> <p>The SEO tools recipe adds Robots.txt module to manage this via the UI. But the module only works if there is no robots.txt file in the web root. The file is provided by core and is needed by default, because the SEO tools recipe is optional.</p> <h4 id="summary-steps-reproduce">Steps to reproduce</h4> <ol> <li>Install Drupal CMS</li> <li>Apply the SEO tools recipe</li> <li>See the warning on the status page, and see that the changes in Robots.txt settings do not have any effect</li> </ol> <h3 id="summary-proposed-resolution">Proposed resolution</h3> <p>Lets investigate moving the Robotstxt module and configuration to the basic SEO recipe.<br> We'd have to then alter the sitemap config in the Advanced.</p> > Related issue: [Issue #3326881](https://www.drupal.org/node/3326881)
issue