Fix summary facet filtering for multiple facet summaries

Move facet summary facet filtering to the build method so that it doesn't affect subsequent summary builds.

Closes #3415552