Thanks for the response Juraj, that gave me a clue I needed.
After more digging, I had to go to the database and look in [CMS.DocumentAlias] to see what is going on.
It seems there was a rogue entry for an entirely different page with that same alias /plan-ahead. I removed that other page, added a single alias for /plan-ahead with (all) cultures and now it works as intended.