Issue #3632309: loadSingleCardinalityFields() flips the field column map for every row and field

This checks the field columns directly with array_any() instead of flipping and intersecting them for every row. The patch on the issue is our 11.4.x version of the same thing.