Skip to content
Snippets Groups Projects
Verified Commit 505a6460 authored by Alex Pott's avatar Alex Pott
Browse files

Issue #3389611 by pfrenssen, cilefen, xjm, poker10: Update robots.txt with all... 

Issue #3389611 by pfrenssen, cilefen, xjm, poker10: Update robots.txt with all README files core ships with
parent 9d83a203
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
core/assets/scaffold/files/robots.txt
+ 9
− 1
View file @ 505a6460
...@@ -37,7 +37,15 @@ Allow: /profiles/*.svg ...@@ -37,7 +37,15 @@ Allow: /profiles/*.svg
Disallow: /core/ Disallow: /core/
Disallow: /profiles/ Disallow: /profiles/
# Files # Files
Disallow: /README.txt Disallow: /README.md
Disallow: /composer/Metapackage/README.txt
Disallow: /composer/Plugin/ProjectMessage/README.md
Disallow: /composer/Plugin/Scaffold/README.md
Disallow: /composer/Plugin/VendorHardening/README.txt
Disallow: /composer/Template/README.txt
Disallow: /modules/README.txt
Disallow: /sites/README.txt
Disallow: /themes/README.txt
Disallow: /web.config Disallow: /web.config
# Paths (clean URLs) # Paths (clean URLs)
Disallow: /admin/ Disallow: /admin/
......
robots.txt
+ 9
− 1
View file @ 505a6460
...@@ -37,7 +37,15 @@ Allow: /profiles/*.svg ...@@ -37,7 +37,15 @@ Allow: /profiles/*.svg
Disallow: /core/ Disallow: /core/
Disallow: /profiles/ Disallow: /profiles/
# Files # Files
Disallow: /README.txt Disallow: /README.md
Disallow: /composer/Metapackage/README.txt
Disallow: /composer/Plugin/ProjectMessage/README.md
Disallow: /composer/Plugin/Scaffold/README.md
Disallow: /composer/Plugin/VendorHardening/README.txt
Disallow: /composer/Template/README.txt
Disallow: /modules/README.txt
Disallow: /sites/README.txt
Disallow: /themes/README.txt
Disallow: /web.config Disallow: /web.config
# Paths (clean URLs) # Paths (clean URLs)
Disallow: /admin/ Disallow: /admin/
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment