Issue #3409733 by james.williams, fjgarlin, poker10: Test-only job does not detect failures correctly