Show add-between-buttons in a row again, fixes #3503130

Stephan Huberrequested to merge
issue/paragraphs_features-3503130:3503130-styling-issues-with into 2.x

Closes #3503130

Merge request reports