As in this picture:
The #808080 colored line here is actually transparent, and anything from the window below will show here.
Just so happened that the background was #808080-colored here.
As you can see here, in a non maximized state the taskbar area is (correctly) three pixels higher which then covers the transparent area.
Which tree should I be barking up first to try to fix this?