Remove contextual links outside the layout

Srishti Bankarrequested to merge
issue/drupal-3028191:3028191-when-using-layout into 11.x

Closes #3028191

Merge request reports