Solved it!
There was an error in a plugin I was using: Polylang plugin
In the settings there was an error saying that not every page and/or post had a language setup. Selected option to set standard language for every page and post and everything was fine!
