Edit robots.txt to disallow search pages without a trailing slash

Bill Seremetisrequested to merge
issue/drupal-3550083:3550083-robots.txt-search into main

Closes #3550083

Merge request reports