Hi @mattiasstrubbe,
Thanks a lot for reaching out.
It is highly likely that there is some CSS being injected into your site that is causing the issue.
Kindly try replicating this issue with one of the WP stock themes with no additional plugins and let me know if the issue persists.
Hope this helps.