Commit ab62f773 authored by omega8cc's avatar omega8cc

Block aggressive crawler SWEBot in the main Nginx config.

parent 745f476c
......@@ -151,8 +151,8 @@ map $request_uri $key_uri {
### Deny crawlers without 403 response.
###
map $http_user_agent $is_crawler {
default '';
~*HTTrack|MJ12|HTMLParser|libwww|PECL|Automatic|Click|SiteBot|BuzzTrack|Sistrix|Offline|Screaming|Nutch|Mireo is_crawler;
default '';
~*HTTrack|MJ12|HTMLParser|libwww|PECL|Automatic|Click|SiteBot|BuzzTrack|Sistrix|Offline|Screaming|Nutch|Mireo|SWEB is_crawler;
}
###
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment