Issue #3409733 by james.williams, fjgarlin, poker10: Test-only job does not detect failures correctly
mentioned in commit cdd8d3cc
mentioned in commit 2d0757fd
mentioned in commit 1c3d9629