Add option to fallback to GET if HEAD fails

bwaindwainrequested to merge
issue/linkchecker-3334240:3334240-use-get-method-2.0.x into 2.1.x

Closes #3334240

Merge request reports